Welcome to aea365! Please take a moment to review our new community guidelines. Learn More.

Research on Evaluation

RoE TIG Week: What’s a Girl Gonna Do?: Understanding Evaluation Theory From A Postcolonial Lens Resources and References by Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark

Our names are Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark. We are three Black, cisgender, female doctoral candidates in the UNC Greensboro Educational Research Methodology department specializing in Program Evaluation. We recognize that our experiences in the field are often influenced by our positionality and as graduate students, we find value in acknowledging those …

RoE TIG Week: What’s a Girl Gonna Do?: Understanding Evaluation Theory From A Postcolonial Lens Resources and References by Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark Read More »

RoE TIG Week: Who is Doing Research on Evaluation, and Where is It? by Dana Linnell, Esther Nolton, Michael, Harnar, Seema Mahato, and Travis R. Moore

Hello! My name is Dana Linnell (formerly Dana Wanzer). Along with my colleagues Esther Nolton, Michael Harnar, Seema Mahato, and Travis R. Moore, we are going to share information about research on evaluation (RoE) presented at the American Evaluation Association conference.  For context, here is the definition of RoE that guided our work: “Any purposeful, …

RoE TIG Week: Who is Doing Research on Evaluation, and Where is It? by Dana Linnell, Esther Nolton, Michael, Harnar, Seema Mahato, and Travis R. Moore Read More »

ROE TIG Week: How Published Research on Evaluation Influences Evaluators’ Thinking by Chris Coryn and Lyssa Wilson

Today’s post, originally published in 2015, is being resurfaced in memoriam of Chris L. Coryn. Dr. Coryn was the director of the Interdisciplinary Ph.D. in Evaluation at Western Michigan University. The blog post was authored by Dr. Coryn and Lyssa Wilson Becho, who currently serves as a principal research associate with The Evaluation Center at …

ROE TIG Week: How Published Research on Evaluation Influences Evaluators’ Thinking by Chris Coryn and Lyssa Wilson Read More »

RoE TIG Week: Research, Evaluation, Research ON Evaluation?! by Dana Linnell

Hello! My name is Dana Linnell (formerly Dana Wanzer). I’m an assistant professor of psychology in evaluation at University of Wisconsin-Stout where I teach evaluation, statistics, and research methods and I’m the program director for our MS in Applied Psychology program, which has a concentration in evaluation. Today I’ll be sharing a simple framework that …

RoE TIG Week: Research, Evaluation, Research ON Evaluation?! by Dana Linnell Read More »

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton

Hi, we are Michael Harnar and Zach Tilton, Co-Principal Investigator on the EvaluATE grant and Doctoral Research Associate, respectively. Our research-on-evaluation (RoE) study investigates evaluation use in NSF’s Advanced Technological Education (ATE) program. ATE grantees spend an average of 8 percent of their grant budgets on evaluation—almost $5 million annually. With so much evidence of …

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton Read More »

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki

I’m Mike Lesiecki, with EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. With colleagues at EvaluATE, I’ve been conducting research on how PIs in the ATE program select and contract with evaluators. This research-on-evaluation (RoE) study looks at a problem common to many institutional grantseekers and evaluators: Funders, PIs, …

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki Read More »

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman

Hi! We’re the team behind a sentiment analysis study of EvaluATE’s open-ended survey responses. Larry is a professor of engineering management at WMU, and Nolen is a former Fortune 500 data scientist consulting on data analytics projects. EvaluATE hosts webinars and workshops about evaluation topics, and attendees submit feedback in the form of open- and …

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman Read More »

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate

We’re Kelly Robertson and Lori Wingate from The Evaluation Center at Western Michigan University. We are part of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. Our recent research on evaluation (RoE) study involved collecting data from participants weekly and monthly over the course of a year, and we’re …

RoE TIG Week with EvaluATE: Keeping Participants Involved in Long-term Studies by Kelly Robertson and Lori Wingate Read More »

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey

Hello! We are Ayesha Boyce (Arizona State University) and Tiffany Tovey (UNC Greensboro). This year, we’ve been working with Ph.D. students Jeremy Acree (UNCG), Onyinyechukwu Onwuka (UNCG), and Neelakshi Tewari (ASU) to investigate the feasibility of measuring diversity, equity, and inclusion (DEI) in the National Science Foundation’s (NSF’s) ATE program using indicators recommended by the …

RoE TIG Week with EvaluATE: Defining and Measuring Diversity, Equity, and Inclusion by Ayesha Boyce and Tiffany Tovey Read More »

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald

We are Lori Wingate and Kelly Robertson of The Evaluation Center at Western Michigan University (WMU) and Michael FitzGerald and Lana Rucks of The Rucks Group (TRG). We collaborated on a study of the impact of the evaluation capacity-strengthening efforts of EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education program.  In …

RoE TIG Week with EvaluATE: Using Evaluation Plans to Study Evaluation Capacity by Lori Wingate, Kelly Robertson, Lana Rucks, and Michael FitzGerald Read More »