Welcome to aea365! Please take a moment to review our new community guidelines. Learn More.

Tech TIG Week: Harnessing Machine Learning for Ethical and Effective Evaluation by Peter York

Hello! I’m Pete York, an evaluator for more than 25 years, and I’ve been integrating machine learning and AI into evaluation for the past decade. I teach courses introducing machine learning to evaluators at The Evaluator’s Institute (TEI) and the International Program for Development Evaluation Training (IPDET). Hot Tip As demand for big data science, …

Tech TIG Week: Harnessing Machine Learning for Ethical and Effective Evaluation by Peter York Read More »

Tech TIG Week: The Use of AI for Qualitative Analysis – What Is the Harm? by Carolyn Fonseca

Hi I’m Carolyn Fonseca, PhD, Technical Director at Management Systems International (MSI) TetraTech. I have experience conducting evaluations for clients such as USAID, managing third-party monitoring platforms, and conducting special studies/research activities testing new technologies and methods. I, like many of you, am often under time, budget, and data constraints when carrying out work for …

Tech TIG Week: The Use of AI for Qualitative Analysis – What Is the Harm? by Carolyn Fonseca Read More »

Tech TIG Week: Hot Tips: Using ChatGPT to Transcribe and Summarize In-person Meetings by Noah Goodman

Hi, I am Noah Goodman, an evaluator and researcher at Education Development Center. Recently, one of my projects held a planning meeting with school leaders to help them reflect on results from a youth health and risk behavior survey we administered in their districts. During that meeting, participants used post-its to reflect on the data, …

Tech TIG Week: Hot Tips: Using ChatGPT to Transcribe and Summarize In-person Meetings by Noah Goodman Read More »

Tech TIG Week: “I Need Another Me”: Leveraging AI as a Solution to Increase Personal Capacity in the Evaluation Industry by Emily Smith

Greetings from Vermont! I am Emily Smith, Director of Program Evaluation for the Division of Family and Child Health in the Department of Health. My journey from research and academia to evaluation in the public sector has contributed to my current perspective on ethical and creative integration of artificial intelligence (AI) tools into my everyday …

Tech TIG Week: “I Need Another Me”: Leveraging AI as a Solution to Increase Personal Capacity in the Evaluation Industry by Emily Smith Read More »

Tech TIG Week: The Evaluation Time Machine: Charting the Course of Evaluation Intelligence by Zach Tilton

Greetings, colleagues. I’m Zach Tilton, Evaluation Specialist at The MERL Tech Initiative and Sandbox Working Group Co-lead for the MERL Tech Initiative Natural Language Processing Community of Practice (NLP-CoP). Today, I’d like to take you on a journey through the evolution of our field and introduce a concept I call “Evaluation Intelligence.” Imagine, if you …

Tech TIG Week: The Evaluation Time Machine: Charting the Course of Evaluation Intelligence by Zach Tilton Read More »

Tech TIG Week: A Snapshot of the State of Artificial Intelligence in Evaluation Practice by John Baek

I’m John Baek, Senior Education Evaluator at the National Oceanic and Atmospheric Administration and chair of the Integrating Technology in Evaluation (Tech) TIG. Along with Noah Goodman (Wednesday’s author), I’m curating this week’s AEA365 blogs from evaluators who are actively exploring the use of artificial intelligence tools as part of their evaluation practice. Tools like …

Tech TIG Week: A Snapshot of the State of Artificial Intelligence in Evaluation Practice by John Baek Read More »

Canadian Evaluation Society (CES) Adopts Values-based Ethics Guidance by the Ethics Guidance Working Group of the Canadian Evaluation Society

Hello from the Ethics Guidance Working Group of the Canadian Evaluation Society (CES). We are excited to tell you about the recently adopted CES Ethics Guidance, a foundational document that advances ethical considerations in evaluation in Canada, and can also serve as a valuable resource for evaluators globally. 

Navigating Challenges and Unveiling Insights: A Reflection on Evaluating the Young Emerging Evaluators (YEE) Program in Mongolia by Shelli Golson-Mickens, Nada Mousa, and Jennifer Ottolino

Greetings! We are Shelli Golson-Mickens, Nada Mousa, and Jennifer Ottolino, alumni of American University’s Measurement and Evaluation Program, which has a partnership with the Mongolian Evaluation Association (MEA) to collaborate on evaluations, trainings, and other projects. 

San Francisco Bay Area Evaluators Week: Leveraging Advisory Committees for Impact Evaluation: The JVS Bay Area Experience by Yana Kusayeva

I am Yana Kusayeva, the Director of Evaluation and Impact at JVS, a Bay Area-based workforce development nonprofit that creates opportunities for equitable economic mobility for all Californians. I’ve been leading our impact evaluation efforts over the past three years. Recently I joined the San Francisco Bay Area Evaluators (SFBAE), where I was already acquainted with several members through previous professional collaborations. Our discussions about innovative impact measurement and stakeholder engagement in change management highlighted how local evaluation communities can help build local measurement, evaluation, and learning (ME&L) capacity at local nonprofit organizations through formal and informal networks. I want to share the success of JVS’s Impact Measurement Committee (IMC), and the valuable lessons learned from our efforts.

San Francisco Bay Area Evaluators Week: Towards and Emancipatory Inquiry Method: The Work at Flourish Agenda Inc., by Oscar Cerna

Greetings fellow evaluators! I am Oscar Cerna, a member of the San Francisco Bay Area Evaluators (SFBAE) and the Director of Evaluation, Research and Impact (ERI) at Flourish Agenda, Inc., which is a national education consulting firm based in Oakland, CA. For more than 30 years, our training and youth camp teams have worked with schools, youth-serving organizations and government agencies to build and implement strategies that allow young people of color to flourish. Flourish Agenda’s healing centered engagement (HCE) introduces a more holistic approach to fostering well-being by recognizing that trauma is not an isolated experience—but instead that trauma and healing from trauma are experienced collectively. We equip system leaders and youth service providers with curricula, training, and tools that are grounded in this understanding.