AEA365 | A Tip-a-Day by and for Evaluators

TAG | Knowledge Economy

Stephen J. Gill

Stephen J. Gill

Organizations (business, non-profits, and government) are paying more attention to the impact of employee training and learning programs. They recognize that in this Knowledge Economy, learning and change must be a core competency. I’m Stephen J. Gill and I have been evaluating the impact of learning interventions in organizations for the past 35 years. Recently, LAD Global, an affiliate of the Singapore Training and Development Association, asked me to record a free, online, short course for them titled, Measuring and Evaluating Learning in the Knowledge Economy.  In that course, I summarize lessons I’ve learned from the evaluation of many different learning interventions in organizations. I cover the following topics in the course:

  1. Introduction to Measurement and Evaluation of Learning
  2. Purpose of Measurement and Evaluation
  3. Methods of Measurement and Evaluation
  4. Process of Training, Learning and Achieving Results
  5. Designing Measurement and Evaluation
  6. Using Evaluation Results to Make a Difference

These topics are addressed over 72 minutes broken up into 6 modules. The course is designed to be an introductory look at the issues and practices that confront evaluators who want to enhance the impact of employee learning and development programs in their organizations.

The course covers the purpose of measuring and evaluating learning in the Knowledge Economy, some practical information about why evaluation is important in organizations, the different methods of measurement, how proficient practitioners need to be with technology and analytics, the best ways of presenting information to stakeholders, why learners and their managers need to be held accountable for results, how to approach designing measurement and evaluation for your organization, and using the evaluation results to make a difference in your organization.

Lessons Learned:

  1. Engage stakeholders (learners, their managers, executives, team leaders, etc.) in designing evaluation of learning interventions.
  2. Emphasis should be on improving the learning intervention, not proving that it works or not.
  3. Do not use evaluation findings to find fault with people.
  4. Match the evaluation method with the questions you are trying to answer. Kirkpatrick’s Four Levels, Phillip’s ROI, and Brinkerhoff’s Success Case Method are three commonly used options.
  5. Engage stakeholders in reflecting on the meaning of evaluation findings and the implications for their work.
  6. Achieving positive results from a learning intervention has as much if not more to do with the culture of the organization and the support from managers. Evaluate those elements.

Measuring and Evaluating Learning in The Knowledge Economy

 

Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.

· ·

Archives

To top