Welcome to aea365! Please take a moment to review our new community guidelines. Learn More.

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton

Hi, we are Michael Harnar and Zach Tilton, Co-Principal Investigator on the EvaluATE grant and Doctoral Research Associate, respectively. Our research-on-evaluation (RoE) study investigates evaluation use in NSF’s Advanced Technological Education (ATE) program. ATE grantees spend an average of 8 percent of their grant budgets on evaluation—almost $5 million annually. With so much evidence of …

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton Read More »

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki

I’m Mike Lesiecki, with EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. With colleagues at EvaluATE, I’ve been conducting research on how PIs in the ATE program select and contract with evaluators. This research-on-evaluation (RoE) study looks at a problem common to many institutional grantseekers and evaluators: Funders, PIs, …

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki Read More »

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman

Hi! We’re the team behind a sentiment analysis study of EvaluATE’s open-ended survey responses. Larry is a professor of engineering management at WMU, and Nolen is a former Fortune 500 data scientist consulting on data analytics projects. EvaluATE hosts webinars and workshops about evaluation topics, and attendees submit feedback in the form of open- and …

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman Read More »

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate

We’re Kelly Robertson and Lori Wingate from The Evaluation Center at Western Michigan University. We are part of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. Our recent research on evaluation (RoE) study involved collecting data from participants weekly and monthly over the course of a year, and we’re …

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate Read More »

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey

Hello! We are Ayesha Boyce (Arizona State University) and Tiffany Tovey (UNC Greensboro). This year, we’ve been working with Ph.D. students Jeremy Acree (UNCG), Onyinyechukwu Onwuka (UNCG), and Neelakshi Tewari (ASU) to investigate the feasibility of measuring diversity, equity, and inclusion (DEI) in the National Science Foundation’s (NSF’s) ATE program using indicators recommended by the …

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey Read More »

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald

We are Lori Wingate and Kelly Robertson of The Evaluation Center at Western Michigan University (WMU) and Michael FitzGerald and Lana Rucks of The Rucks Group (TRG). We collaborated on a study of the impact of the evaluation capacity-strengthening efforts of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education program.  In …

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald Read More »

RoE TIG Week with EvaluATE: Funding Your Research on Evaluation Initiatives by Megan Zelinsky and Lyssa Wilson Becho

Hello! We are Megan and Lyssa from EvaluATE, the evaluation hub for the National Science Foundation’s (NSF’s) Advanced Technological Education (ATE) program. NSF’s ATE program aims to promote the development of innovative programs for the education of technicians in the high-technology fields. EvaluATE enhances evaluation capacity in the ATE community, including among project staff, evaluators, …

RoE TIG Week with EvaluATE: Funding Your Research on Evaluation Initiatives by Megan Zelinsky and Lyssa Wilson Becho Read More »

Locally-led MEL Week: A Loop, not a Line: Engaging Beneficiaries in Dissemination and Feedback by Brooke Hill

My name is Brooke Hill and I am an international development evaluation expert, with a focus on large-scale quantitative surveys throughout the Middle East, Africa, and Asia. In a typical evaluation, my workplan includes at least one dissemination and feedback workshop. Participants typically include the client or donor, government officials, and sector experts. While these …

Locally-led MEL Week: A Loop, not a Line: Engaging Beneficiaries in Dissemination and Feedback by Brooke Hill Read More »

Locally-led MEL Week: Four Lessons on Localising CLA by Abhirup Bhunia

My name is Abhirup Bhunia, and I am an international development Monitoring, Evaluation, and Learning (MEL) Expert. I have worked on MEL and Collaborating, Learning, and Adapting (CLA; adaptive management) mandates across sectors for several years with many bilateral/multilateral institutions including USAID, United Kingdom’s Foreign, Commonwealth and Development Office, Australia’s Department of Foreign Affairs and …

Locally-led MEL Week: Four Lessons on Localising CLA by Abhirup Bhunia Read More »

Locally-led MEL Week: Localization in Research and Evaluation: a Challenging but Worthwhile Journey to Sustainable Development by Phuong Pham

Hi, I’m Phuong Pham. In my current role as Research Director for the USAID Learns activity, I lead a team providing research services to USAID/Vietnam and its implementing partners. We try to ensure that our values around engaging local stakeholders in evidence generation and use, and prioritizing local voices in our work spread to our …

Locally-led MEL Week: Localization in Research and Evaluation: a Challenging but Worthwhile Journey to Sustainable Development by Phuong Pham Read More »