AEA365 | A Tip-a-Day by and for Evaluators

TAG | CREATE

Hi, I am Paula Egelson, research director at the Southern Regional Education Board in Atlanta. For this week of the AEA 365 blogs, board members from the Consortium for Research on Educational Assessment and Teaching Effectiveness (CREATE) will be sharing blogs associated with the tenants of the CREATE organization: assessment, teacher and principal effectiveness, program evaluation and accountability.

CREATE has a long history with the Joint Committee on Standards for Educational Evaluation (JCSEE) that has been housed over the years at Western Michigan University’s Evaluation Center, University of Iowa and Appalachian State University. Begun in 1974, JCSEE members representing research and practitioner organizations both nationally and internationally have created and revised the Program Evaluation Standards, Personnel Evaluation Standards and Classroom Assessment Standards.

Hot Tips:

Our focus today is on the Program Evaluation Standards and some of its uses. The Program Evaluation Standards apply to a wide variety of settings in which learning takes place. This includes schools and universities to nonprofits and the military. These 30 standards are organized around the five key attributes of utility, feasibility, propriety, accuracy and accountability. Each attribute includes the key concepts related to it, standards statements implementation suggestions, hazards to avoid, case narratives and references for further reading.

The program evaluation standards provide guidance and support reflective practice associated with:

  • Whether and when to evaluate,
  • How to select evaluators and other experts,
  • The impact of cultures, contexts and politics,
  • Communication and stakeholder engagement,
  • Technical issues in planning, designing and managing evaluations,
  • Uses and misuses of evaluations,
  • Issues related to evaluation quality, improvement and accountability.

Among other things, program evaluation standards can help evaluators resolve some common evaluation issues that are found below:

  • Stakeholder over-involvement in the evaluation,
  • Agency disagreement over the evaluation recommendations,
  • A contractor desiring an evaluation report with predetermined outcomes,
  • Stakeholders “sitting on” an evaluation report, and
  • A lack of data collection integrity (lack of timeliness related to data collection, supervisor review of employees’ survey responses, teachers reviewing an online test or survey before the administration begins, not following random sampling guidelines).

I encourage you take an opportunity to access The Program Evaluation Standards to determine how these standards can be of best use to you and your colleagues. I look forward to hearing from you about your uses of the standard and obtaining your feedback of the standards.

Rad Resources:

Detailed information about the Program Evaluation Standards

Information about the work of the Joint Committee on Standards for Educational Evaluation

For more information about CREATE, please go to www.createconference.org. CREATE’s annual research and evaluation conference will take place at William and Mary College in Williamsburg, Virginia, on October 11 and 12, 2018. We hope to see you there!

 

The American Evaluation Association is celebrating Consortium for Research on Educational Assessment and Teaching (CREATE) week. The contributions all this week to aea365 come from members of CREATE. Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.

 

Archives

To top