Hello! I am Beverly Peters, an assistant professor of Measurement and Evaluation at American University. This is the final article in a 6 part series on Using Focus Groups for Monitoring and Evaluation. The articles in this series have discussed when to use focus groups, planning for the focus group including who to invite, developing questions and a questioning route, and moderating the focus group. This final article will review managing and analyzing focus group data.
Directly after you conduct a focus group, I would urge you to take the time to sit down and debrief with other members of the evaluation team, including your notetaker. Take debriefing notes around your initial thoughts, before you transcribe any tapes. Highlight areas where you felt that there was agreement, controversy, or confusion. Consider if there were questions that confused participants, or questions that were particularly (un)successful in facilitating conversation. Note where you think you may need to collect additional data. If it is early in your focus group research, you might consider tweaking the questions or questioning route if needed.
If you are like me, you ruminate on the focus group for a couple of days after its moderation. I keep my debriefing notes handy, and make additional comments as they come to mind.
The next step is transcribing your focus group, which can be extremely time consuming, particularly you are conducting a focus group in a language which needs translation. Your organization might have budgeted for transcription services, or perhaps you will use one of the services available online.
Once you have a transcription, I recommend comparing it to the notetaker’s and debriefing notes for areas of agreement and concern. Highlight areas of confusion, and be sure to follow up with the notetaker or other members of the evaluation team to clarify.
In order to ensure the reliability of data, I write debriefing notes, transcribe the focus group, and refer to the notes of my notetaker as soon as possible after the focus group. The longer you leave this initial analysis, the more you will potentially forget about the focus group. As you analyze one focus group, you should try to find themes, ask what was surprising, flesh out when people agreed and disagreed and why, and ask yourself what interpretations a particular focus group produced.
As you analyze and compare the data from multiple focus groups, look for major themes that cut across all of your focus groups. You should also look for aspects that are mentioned only a few times. You should analyze groups by categories of who participated, and you should identify areas of agreement and disagreement, within and across focus groups.
Throughout this series, I have cited several Rad Resources, which include:
Kruger and Casey’s Focus Groups: A Practical Guide for Applied Research, 5th ed.
Beverly Peters, Introduction to Qualitative Research Methods for Monitoring and Evaluation. Washington, DC: American University.
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to firstname.lastname@example.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.