My name is Hope Gilbert, and I am an evaluation specialist at Deloitte Consulting LLP. Like many in our field, as we review proposals and design our methodologies in response to potential projects, our teams engage in planning sessions about the various evaluation tools we might consider and that are most appropriate for implementation. After reading a proposal, my mind inevitably turns to the tried-and-true multi-method or mixed-method models using standard quantitative and qualitative approaches. This year I want to be more forward thinking, as projects allow, to incorporate those ‘out-of-the-norm’ data collection tools we rarely use. Now of course, as evaluators, we must apply the most appropriate methodologies to the evaluations we are tackling; however, why can’t we also incorporate some creativity as well?
Lesson Learned
One of the most powerful data collection efforts I’ve participated in was a relatively small project that included the use of photovoice. I’ll admit, I was skeptical at first, because my training is in hardcore biostatistics, so this foray into a new qualitative data collection tactic for me was a stretch; however, it proved to be a valuable lesson. I learned that alternative data collection approaches have the potential to not only capture the data needed for targeted findings, but the experience can also be empowering for data collection participants as well. For my first time using this data collection tactic, my participants found their voice – simply through pictures.
Hot Tips
If you’re going to incorporate an alternative data collection effort, like photovoice, for the first time, I would suggest using the approach in concert with other data collection methods. Alternative data collection approaches can yield powerful results; however, they take time to master. I find photovoice to be a tremendous supplementary approach to a brief survey and/or interviews, and a way to extend data collection efforts for quick follow-ups or intermediate check-ins, particularly for longitudinal evaluations. When evaluators incorporate the photovoice data collection approach for long-term evaluations, participant fatigue is less likely while simultaneously promoting a more engaging and fresh data collection experience for participants.
I find that including an alternative data collection approach to evaluation efforts, leads to strong stakeholder buy-in not only for participants but also for funding agencies. I am the first to admit that it is easy to get lost in developing a data collection protocol that is pristine on paper; however, the practicality is lost on participants due to complexity and length. Alternative data collection approaches, like photovoice, allow participants to engage with data collection efforts on a creative level yielding a depth/breadth of results that would likely be missed through traditional data collection approaches.
Alternative approaches are a unique way to ensure inclusivity. For example, photovoice is a tremendous alternative approach for data collection where participants with varying degrees of literacy or comfort level in speaking during focus groups/interviews can easily be lost in the shuffle. The pressures of participating in long surveys or engaging in conversations with evaluators can induce stress. Photovoice directions can be provided via multiple ways to meet participants’ needs and then allows them to collect data on their own – and again, in a space that encourages creativity and autonomy.
Have you incorporated alternative data collection methods in your evaluation efforts beyond our standard norms of surveys, interviews, focus groups and observations? I’d love to hear about your successes and any lessons learned from your alternative approaches.
Please share your experiences in the comment box below.
The American Evaluation Association is hosting Health Evaluation TIG Week with our colleagues in the Health Evaluation Topical Interest Group. The contributions all this week to AEA365 come from our Health Evaluation TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the AEA365 webpage so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? Please send a note of interest to AEA365@eval.org. AEA365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.