Ann Emery on Aha Moments for Novice Evaluators
Lessons Learned: Are you a recent graduate or novice evaluator? If so, you’ve probably already made tremendous professional and personal growth. Congratulations! However, you’ve probably also learned that evaluation is challenging! As I followed the #evalAHA hashtag on Twitter during the AEA conference, I started reflecting on my own aha moments. When faced with new evaluation challenges, celebrating my past aha moments gives me fuel and pushes me forward.
Hot Tips: Here are the aha moments I experienced during my first few years in evaluation:
- Evaluation isn’t research. This realization is especially common for those of us who entered evaluation from the social sciences. Hallie Preskill’s graphic about research and evaluation and Jane Davidson’s article about Unlearning Some of our Social Scientist Habits have been invaluable during my transition from research into evaluation.
- Data will always be missing and messy. Despite your best precautions, you’ll need to budget plenty of time for data cleaning. One of my favorite resources is Missing Data: A Gentle Introduction by Patrick McKnight, Katherine McKnight, Souraya Sidani, and Aurelio José Figueredo.
- Evaluation takes time. The evaluation planning and the process itself can take months (if not years!) and the resulting programmatic and policy changes can take years (if not decades!). I remind myself that evaluation is a marathon – not a sprint – and I rejoice in all victories, no matter how small.
- Qualitative methods rock. Qualitative data are meaningful and useful for program staff, and qualitative approaches are often a better fit for newer or not-yet-evaluated programs than quantitative approaches.
- Randomized control trials are no longer the gold standard. Or appropriate for some programs.
- Jargon’s unacceptable – well, most of the time. Just when I figured out how to really, truly banish jargon from my reports, I started working on an evaluation project for economists, and they loved reading statistical details. That old saying “The only constant is change, continuing change, inevitable change” certainly rings true in my own evaluation practices. I re-visit and re-question my assumptions, approaches, and techniques with every new project.
Lesson Learned: Have you had similar aha moments? What types of evaluations, events, and experiences have prompted your own insights?
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to firstname.lastname@example.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluator.