Curator note: This article was originally published in 2017 but we thought it would make a great addition to this week. We often rerun articles as part of our “Best of AEA365 series.”
Happy LGBTQ+ Evaluator Week! I’m Joseph Van Matre, an institutional research analyst at the University of California*.
Surveys are an integral part of evaluation, and when designing a survey, gender is often the second question after name. We add it to our surveys without a second thought. But do we need to know?
Evaluators are, by our nature, curious people, but evaluations are not fishing expeditions. Look carefully at the program’s theory of action and your own evaluation plan.
Cool Trick: Ask yourself:
- Is this program targeted at a particular sex or gender (they’re different!)?
- Is there reason to believe that this program will have a differential impact on participants/subjects of different genders or sexes?
- Do you need to collect gender/sex information of everyone involved in the program, or just some participants (e.g. teachers and students?)
- Do you have the time, resources, and mandate to evaluate and report on gender/sex differentials?
While our first instinct is to collect as much data as possible about the programs and interventions that we evaluate, it is our responsibility not to collect and store personal information that we do not need. If you will not or cannot use information on someone’s sex or gender, you do not need to ask in the first place.
Ask for what you need to know. Unless you are evaluating a health-related program, you probably only want to ask about a person’s gender.
It is often best to allow people to identify their gender in an open ended way: I identify my gender as ___________. With large-scale surveys, you can provide male, female and an open response so that you only manually code responses that are not male or female.
Hot Tip:
Some government agencies or funders may require rigid gender reporting. The Integrated Postsecondary Education Data System (IPEDS) requires colleges and universities to report the gender of every student as either male or female. Even unknown or missing is not an option, leading to some very strange reporting outcomes.
While dreadfully cliché, the adage, “say what you mean and mean what you say,” is an important rule when reporting evaluation outcomes related to sex and gender. Your forethought and planning will make your communication inclusive and accurate.
Cool Trick:
For example, when you ask people to identify their gender on a survey, the phrase, “there were 24 men in our sample” can be replaced by, “27 people in our sample identified themselves as male.”
It is our job to continually educate ourselves about the people and programs we evaluate, and any population is likely to include people who do not fall within the gender binary. Asking for exactly what you need (or not asking at all!) is a simple way to create more inclusive evaluations.
* The views and opinions expressed in this post are those of the author and do not necessarily reflect the views, positions or policy of the University of California.
The American Evaluation Association is celebrating LGBT TIG Week with our colleagues in the Lesbian, Gay, Bisexual & Transgender Issues Topical Interest Group. The contributions all this week to aea365 come from our LGBT TIG members. Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for Evaluators.
Hi there,
Thank you for sharing your thoughts and ideas on using sex and gender in surveys. What first caught my eye about your article was the title: LGBTQ Week: Do you need to ask about sex and gender on your survey? The SOGI rep at the school I currently work at speaks about this topic a lot. As we continue to learn more and more about gender identity and the importance of reciting each persons’ pronouns correctly, the more and more I ensure that my classroom is a safe environment for students (and colleagues) to express themselves, even if they are still learning about who they are. One way that I attempt to do this is trying hard not to refer to my class as “boys and girls”.
While reading the questions you posted, I thought back to any survey I have ever completed… One of the first questions always asked is what my gender is. I don’t think my gender has ever been an “important” detail in the surveys that I have completed. I really appreciated that you changed the language of how to ask what your gender is. Leaving space to openly answer what your gender is provides you an open way to state your answer instead of just checking off ‘male’ or ‘female’. As schools often preach being inclusive in their learning and their approach to teaching, we need to ensure that we do the same within various aspects; our language and we address individuals being extremely important. The “cool tricks” you provided throughout your article were extremely helpful, and something that I will keep in mind moving forward with my teaching.
Overall, this was a great blog post and I really grateful to have learned so much from it!
Thank you,
Brianne
Hi Sheila,
I’m a PME student at Queen’s University and while scrolling through the titles of posts on the AEA365 yours immediately stood out to me. I’m not surprised by how many other students have also chosen your post – it is extremely relevant and on a topic we all need to be reflecting on.
The part of your post that stood out most to me was when you said “Do you have the time, resources, and mandate to evaluate and report on gender/sex differentials?”. Even if a question in added in about sex or gender in an effort to gain as much information as possible, I can imagine that due to limited resources it could often become a piece of information that isn’t analyzed. If it’s not going to be used, we could be doing damage to the responses that we are getting from people for no reason. As you mentioned, we don’t need to be collecting unnecessary data on our participants, but we also need to recognize how questions can make people feel, and how those feelings could impact their answers to more relevant questions. Even if a question is set up properly as per your suggestions for open ended gender data, by asking the question it may cause participants to pause and think that their gender is relevant to their answers. In some cases it may be, but in others it is a completely irrelevant piece of information that has just become a habit to ask for.
Clara
Hello Joseph,
I really enjoyed reading your article, as gender pronouns are becoming more and more important each year. I agree that in surveys that gender is not going to be considered, that gender questions are not necessary. If anything, I feel like most surveys should have a “prefer not to answer” questions, which are typically used for race and ethnicity. I enjoyed your tips for having open-ended questions set up for gender questions if gender is required for data entry. Thank you for your suggestions, Joesph!
Hi there Joseph! I loved the content of your article. I have always thought and reflected on the topic of sex/gender being asked on surveys. There have been times when I was asked for my sex/gender when completing surveys and questionnaires and often times I would think it was insignificant to the survey or questionnaire I was completing at the time. I love the four questions you made a point to include in terms of how significant putting gender/sex orientation questions in a survey. I believe that in order for things like this to be included on surveys that it should in fact have a significant role in the survey itself. It should definitely not be used in times where it would be deemed useful to the surveyor. The tips you mentioned in your article are great guides that surveyors can use to help resonate and be better equipped for theirselves as well as those completing the surveys.
Hello there!
Thank you for sharing your thoughts and ideas on using sex and gender in surveys. The title of your article grabbed my attention right away because it’s something my fellow teacher colleagues and I discuss frequently. As we all learn more about the role of gender identity I find that part of my role as an early-primary teacher is to create a safe space for children to express themselves and discover who they are. I try to use inclusive wording in daily practice and I like your “Cool Trick” for rephrasing to make the sentence person-centric instead of gendered. I have tried to remove “boys and girls” from my vocabulary when talking to the class, instead using “my friends, my class, folks, learners, etc.”
In terms of surveying groups I agree that asking gender is almost never necessary. We must ask ourselves before conducting an evaluation “Why does this matter? How will it impact my report? Do I really need this information?”
My personal frustration with limiting people to a male/female gender stems from a school environment. Every spring when it comes time to make class groupings for the next year we are instructed to write the boys names on blue paper and the girls on pink. For years these so-called “pinks and blues” have been the go-to system for sorting our students into potential class groupings. Every year the teachers raise a complaint that this system is archaic and doesn’t leave room for students anywhere else on the gender identity spectrum. If teachers are supposed to foster self-acceptance and expression, how can we group our students into such rigid binary categories? My hope is that in the very near future the class groupings will be done only via personality traits, character, and possibly “how much of the teachers attention does this student take”. These qualifications are more valuable than gender anyway and allow teachers to make more meaningful class cohorts.
Thank you for getting me thinking!
Charlie
Hello!
My name is Courtney McLaughlin and I am a Professional Master of Education student at Queens University in Kingston, Ontario (Canada). As part of our assignment, we are to read a blog post of our choice and respond to it to build insight, connections and deeper thinking.
I chose this article as it really interests me. In my grade 5/6 class, we were practicing taking surveys as part of our data management unit in math. One student asked if they were required to ask the respondents gender on the survey. One student shouted “who cares?!” while other students believed it was valuable information. We actually ended up having a really interesting discussion about gender and sexual identity, which really had me thinking deeply. I came across this blog post at the perfect time!
I really like how you included “tricks” to help surveyors evaluate if the information of respondent’s gender is valuable to the program’s theory of action and evaluation plan. I truly think you “hit the nail on the head” by encouraging researchers to ask themselves the following questions: “Is this program targeted at a particular sex or gender (they’re different!)? Is there reason to believe that this program will have a differential impact on participants/subjects of different genders or sexes? Do you need to collect gender/sex information of everyone involved in the program, or just some participants? Do you have the time, resources, and mandate to evaluate and report on gender/sex differentials?
Once the researcher asked themselves these incredibly valuable and thought-provoking questions, this should give them a clear indication of if they should be asking for gender identity’s on the survey or not. I also like how you mentioned using gender-inclusive language by rephrasing the statistic “27 respondents were male” to “27 people in our sample identified themselves as male.” This is incredibly important. We must remain inclusive, respectful and supportive of everyone participating. Educating ourselves is the key when dealing with these topics.
Overall, this was a great blog post and I am grateful to have learned so much from it!
Thank you,
Courtney McLaughlin
Hi Joseph,
Your article is so timely and relevant, even when published again 3 years later. I work in a post-secondary institution and we have been moving the needle steadily towards being more inclusive and moving away from only the gender binary. While we do still ask our students to declare, however we have more options than just male and female now. As well, students, faculty and staff are free to not declare/disclose. It’s an important move towards acknowledging the many wonderful differences that exist.
I am currently taking a course in program evaluation and as you can imagine, much of our evaluation design includes the use of surveys and questionnaires to generate data. Your post has caused me to pause and reflect to consciously decide when the data regarding gender is really necessary. As you so perfectly put it, “asking for exactly what you need (or not asking at all!) is a simple way to create more inclusive evaluations”. With the current focus (rightly so) on equity, diversity and inclusion, your post helps us all to make more thoughtful choices in program evaluation.
Thank you!
Warmly,
Sabrina
This article really resonated with me. As part of a team at my school that has conducted a few school-wide surveys, we have questioned ourselves in whether or not to include gender/sex as one of the questions. As you note, we really need to decide if the information is truly relevant. I feel that the age of the audience is also important to consider. If the information is necessary, but the audience is younger, then the phrasing really needs to reflect that. I like the idea of allowing for respondents to fill in their own answer, in lieu of a multiple-choice style response.
If the information will be collected but not used, then we need to reflect on why we feel the need to include the question. If the survey is about students feeling respected and valued, this might be important information. But, if the survey is about course offerings, then the information is irrelevant.
This post really forces us to evaluate our thinking and approach. For so many of the rest of the questions, unnecessary information is avoided, so why not re-imagine our questions that put people into categories?
Hi,
I’m an PME student taking a course in evaluation this semester and one of our assignment is to reach out to the community and comment on an article of our choosing. I’m really glad I found your article on the necessity of collecting sex & gender in a survey. I agree that as curious beings we sometimes collect more data than needed when designing a survey. In my own professional work, I have recently reviewed an existing survey after taking a course on Gender Base Analysis. I realized that not only do we collect sex & gender information, we also use gender and sex interchangeably!
I find the tips provided in your article very useful and I’m happy to see changes in our surveys. I understand that sometimes government agencies have a more rigid approach; but being in a government section; I’m happy to say that we are making changes in including diversity and inclusion.
Thank you!
Hello Joseph Van Matre,
My name is Alexa Cabral and I am a teacher in Ontario, Canada. I am currently enrolled in the Professional Maters of Education program at Queen’s University and have come across your article entitled “LGBTQ Week: Do you need to ask about sex & gender on your survey?” for my Program and Inquiry course.
The idea around gender and constantly feeling the need to ask has sparked my interest over the last two years. As an educator, I was quick to realize how many adults still carried around bad ‘gender-specific’ habits within our schools and classrooms. Things such as, “ girls line up here and boys line up there” or “boy homework bins go here and girl homework bins go there” or “boys VS girls” in sports or games. It blows my mind that such things still happen but it’s even scarier that it often happens without them even realizing they are doing something (and something not morally right either)… would you agree?
I have found myself diving into LGBTQ events and communities to allow myself the space and time to learn and understand. Having close friends and family members who don’t conform to one specific gender, I do take this with a big heart and understand that my students will never be the same. No two are alike and it’s beautiful. I do agree that one of the most important things we need to do and ensure moving forward is educating ourselves. I hope to continue to bring these dilemmas and topics into the classroom in order for students to chime in and have their voice hear over the matter.
I appreciated your ‘hot tips’ and ‘cool tricks’ . I do believe that we can word things differently in order to create more inclusion in our learning communities. Using a different language (terminology) can help ensure everyone feels safe and welcomed and will contribute to our growth. I hope to implement some of these tricks in my classroom this year to ensure no student feels left out or left behind.
I look forward to hearing from you.
Stay safe and be well,
Alexa
P.S. If you have any great advice for a new teacher stepping back into the classroom with regards to inclusivity, I would love to hear it 🙂
Sheila,
This is a great article! The idea of always asking about gender is something that has come up with surveys we have conducted at the school where I teach. I really like the Cool Trick in the article. If we ask ourselves why we include the gender question in the survey, then perhaps we will rethink including it. One of the ideas presented is to give three options for answers: Male, Female, Other (with a space to fill in an answer). While I understand that this allows for a myriad of answers, I do worry that, particularly youth, may feel “less than” in this situation. If gender is essential, perhaps the suggested question of “I identify my gender as ___________” is the best option, even in larger surveys?
This article really has me questioning the usefulness of the inclusion of gender in most surveys. If the gender data is of no consequence, then asking for it is unnecessary. It would be interesting to see if there are any impacts to survey completion by eliminating this, when possible.
Thank you for including this really important article. As my city’s pride month is underway, and the school year is about to start, you have really got me thinking. I know that this will impact the intro questionnaires I use for my classes this fall.
Erin