This is John LaVelle, Louisiana State University, and Yuanjing Wilcox, EDucation EValuation EXchange, members of AEA’s Competencies Task Force. Task Force members recently shared the 2/24/16 draft AEA evaluator competencies in five domains: professional, methodology, context, management, and interpersonal. Feedback in coming months will enable us to finalize the set in preparation for two very important engagement activities: (1) a survey of all members to determine the extent to which they agree that these competencies are the right ones for AEA, and (2) a formal vote on the competencies, including a process for their routine revision, thereby making them an official AEA document.
Hot Tip: Keep your eyes open because he Task Force is working on creating professional development materials to enable evaluators, wherever they work, to use the competencies to reflect on their practice and to assess specific needs. We believe that it is in the reflection process that the explicit value of the competencies will shine as evaluators use them to shape effective practice. For example:
- Novice evaluators, those entering the field who want to identify areas of strength and need for development
- Accidental evaluators, people who may not have formal training, but who are responsible for conducting evaluations
- Professionals in transition, such as those who may be experts in a particular field, but who want to become competent evaluators in that specific area
- Experienced professional evaluators, who want to stay abreast of changes in the field’s practice and theory
We envision an individual assessment process similar to that used for the Essential Competencies for Program Evaluators (http://www.cehd.umn.edu/OLPD/MESI/resources/ECPESelfAssessmentInstrument709.pdf) and an interactive process that groups of evaluators (e.g., members of a firm, students in a cohort) could use to customize the competencies to their specific settings.
Lessons Learned: Feedback on the first draft of AEA competencies raised the question of to what extent individual evaluators need to demonstrate each of the competencies because many evaluators work in collaborative groups. We added one competency (Interpersonal Domain 5.7) to address the fact that for many evaluators teamwork skills are essential. We believe that the question of whether the entire set of competencies should apply to individual evaluators versus teams is context-dependent; we invite people to use the competencies as suits their settings and practice.
Rad Resources: If you are interested in a quick orientation to the world of evaluator competencies, consider these three readings:
- King, J. A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22(2), 229-247.
- Russ-Eft, D., Bober, M. J., de la Teja, I., Foxon, M. J., & Koszalka, T. A. (2008). Evaluator competencies: Standards for the practice of evaluation in organizations. San Francisco, CA: Jossey-Bass.
- Wilcox, Y., & King, J. A. (2014). A professional grounding and history of the development and formal use of evaluator competencies. Canadian Journal of Program Evaluation, 28(3), 1-28.
- Buchanan, H., & Kuji-Shikatani, K. (2014). Evaluator competencies: The Canadian experience. Canadian Journal of Program Evaluation, 28(3), 29-47.
Hot Tip: See you at #eval17 where we hope to unveil the final draft competencies!
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to firstname.lastname@example.org . aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.