Research on Evaluation

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton

Hi, we are Michael Harnar and Zach Tilton, Co-Principal Investigator on the EvaluATE grant and Doctoral Research Associate, respectively. Our research-on-evaluation (RoE) study investigates evaluation use in NSF’s Advanced Technological Education (ATE) program. ATE grantees spend an average of 8 percent of their grant budgets on evaluation—almost $5 million annually. With so much evidence of …

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton Read More »

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki

I’m Mike Lesiecki, with EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. With colleagues at EvaluATE, I’ve been conducting research on how PIs in the ATE program select and contract with evaluators. This research-on-evaluation (RoE) study looks at a problem common to many institutional grantseekers and evaluators: Funders, PIs, …

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki Read More »

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman

Hi! We’re the team behind a sentiment analysis study of EvaluATE’s open-ended survey responses. Larry is a professor of engineering management at WMU, and Nolen is a former Fortune 500 data scientist consulting on data analytics projects. EvaluATE hosts webinars and workshops about evaluation topics, and attendees submit feedback in the form of open- and …

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman Read More »

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate

We’re Kelly Robertson and Lori Wingate from The Evaluation Center at Western Michigan University. We are part of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. Our recent research on evaluation (RoE) study involved collecting data from participants weekly and monthly over the course of a year, and we’re …

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate Read More »

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey

Hello! We are Ayesha Boyce (Arizona State University) and Tiffany Tovey (UNC Greensboro). This year, we’ve been working with Ph.D. students Jeremy Acree (UNCG), Onyinyechukwu Onwuka (UNCG), and Neelakshi Tewari (ASU) to investigate the feasibility of measuring diversity, equity, and inclusion (DEI) in the National Science Foundation’s (NSF’s) ATE program using indicators recommended by the …

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey Read More »

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald

We are Lori Wingate and Kelly Robertson of The Evaluation Center at Western Michigan University (WMU) and Michael FitzGerald and Lana Rucks of The Rucks Group (TRG). We collaborated on a study of the impact of the evaluation capacity-strengthening efforts of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education program.  In …

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald Read More »

RoE TIG Week with EvaluATE: Funding Your Research on Evaluation Initiatives by Megan Zelinsky and Lyssa Wilson Becho

Hello! We are Megan and Lyssa from EvaluATE, the evaluation hub for the National Science Foundation’s (NSF’s) Advanced Technological Education (ATE) program. NSF’s ATE program aims to promote the development of innovative programs for the education of technicians in the high-technology fields. EvaluATE enhances evaluation capacity in the ATE community, including among project staff, evaluators, …

RoE TIG Week with EvaluATE: Funding Your Research on Evaluation Initiatives by Megan Zelinsky and Lyssa Wilson Becho Read More »

The invisible labor of women of color and indigenous women in evaluation, Part 2 by Vidhya Shanker

Vidhya Shanker of Minneapolis here, with another attempt to repair the miseducation of evaluators regarding the contributions of women of color and indigenous women, particularly their understanding of systemic oppression, to evaluation’s history. Today I highlight Dr. Kien Lee, Principal Associate/Vice President of Community Science. Lee has advanced not just a structural analysis, but also …

The invisible labor of women of color and indigenous women in evaluation, Part 2 by Vidhya Shanker Read More »

RoE TIG Week: The Power of Valuing in Evaluation: How the Layering of Qualitative and Quantitative Data in Program Evaluation Enhances the Value to the People Served by Programs by Sondra LoRe

My name is Sondra LoRe and I often have the pleasure of evaluating STEM education programs which include the training and development of students, educators, and community advocates in outreach and information science education. I work as the evaluation manager for the National Institute for STEM Evaluation & Research (NISER) and as an adjunct professor …

RoE TIG Week: The Power of Valuing in Evaluation: How the Layering of Qualitative and Quantitative Data in Program Evaluation Enhances the Value to the People Served by Programs by Sondra LoRe Read More »

RoE TIG Week: Institutionalizing Evaluation in the U.S. Federal Government by, Esther C. Nolton, PhD

Greetings! I am Esther Nolton and I recently completed my PhD in Research and Evaluation Methods at George Mason University. As a GEDI Scholar, I had an opportunity to witness large-scale changes in the culture of valuing and capacity for using evaluation in the U.S. Federal government when the Evidence Act (P.L. 115-435) was enacted. …

RoE TIG Week: Institutionalizing Evaluation in the U.S. Federal Government by, Esther C. Nolton, PhD Read More »