Research on Evaluation

RoE TIG Week: What are Evaluator Beliefs on Knowledge and Participation? An Instrument Design and Validation Study by Amanda Sutter

Hello! I am Amanda Sutter, long time evaluator, current doctoral student, and newbie researcher. I am excited (and nervous!) to share my first research on evaluation study, give back YOUR data, and share some tips I’ve been learning.  Study Overview This study was a response to a literature gap on understanding evaluation practice.  Perhaps no …

RoE TIG Week: What are Evaluator Beliefs on Knowledge and Participation? An Instrument Design and Validation Study by Amanda Sutter Read More »

RoE TIG Week: Evaluators’ Values and How They “Show Up” in Evaluation Practice: An Empirical Study by Rebecca Teasdale, Jennifer McNeilly, and María Isabel Ramírez Garzón

Hello! We are Rebecca Teasdale (University of Illinois Chicago, USA), Jennifer McNeilly (University of Illinois Urbana-Champaign, USA), and María Isabel Ramírez Garzón (Pontificia Universidad Javeriana, Colombia). We are excited to share key takeaways from a research study we recently published with Judit Novak (University of Oslo, Norway) and Jennifer Greene (University of Illinois Urbana-Champaign, USA) …

RoE TIG Week: Evaluators’ Values and How They “Show Up” in Evaluation Practice: An Empirical Study by Rebecca Teasdale, Jennifer McNeilly, and María Isabel Ramírez Garzón Read More »

RoE TIG Week: Concentrating on Collaboration: How we Used the CAE Principles in an Online Evaluation by Paisley Worthington

Hey there! I’m Paisley Worthington, a doctoral candidate studying program evaluation at Queen’s University (Kingston, Canada). Today’s post is about research on evaluation that digs into how the Collaborative Approaches to Evaluation (CAE) principles can be used to foster high levels of participation and co-creation in an online environment. This project was led by myself, …

RoE TIG Week: Concentrating on Collaboration: How we Used the CAE Principles in an Online Evaluation by Paisley Worthington Read More »

RoE TIG Week: What’s a Girl Gonna Do?: Understanding Evaluation Theory From A Postcolonial Lens Resources and References by Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark

Our names are Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark. We are three Black, cisgender, female doctoral candidates in the UNC Greensboro Educational Research Methodology department specializing in Program Evaluation. We recognize that our experiences in the field are often influenced by our positionality and as graduate students, we find value in acknowledging those …

RoE TIG Week: What’s a Girl Gonna Do?: Understanding Evaluation Theory From A Postcolonial Lens Resources and References by Brianna Hooks Singletary, ‘Malitšitso Moteane, and Tyler Clark Read More »

RoE TIG Week: Who is Doing Research on Evaluation, and Where is It? by Dana Linnell, Esther Nolton, Michael, Harnar, Seema Mahato, and Travis R. Moore

Hello! My name is Dana Linnell (formerly Dana Wanzer). Along with my colleagues Esther Nolton, Michael Harnar, Seema Mahato, and Travis R. Moore, we are going to share information about research on evaluation (RoE) presented at the American Evaluation Association conference.  For context, here is the definition of RoE that guided our work: “Any purposeful, …

RoE TIG Week: Who is Doing Research on Evaluation, and Where is It? by Dana Linnell, Esther Nolton, Michael, Harnar, Seema Mahato, and Travis R. Moore Read More »

ROE TIG Week: How Published Research on Evaluation Influences Evaluators’ Thinking by Chris Coryn and Lyssa Wilson

Today’s post, originally published in 2015, is being resurfaced in memoriam of Chris L. Coryn. Dr. Coryn was the director of the Interdisciplinary Ph.D. in Evaluation at Western Michigan University. The blog post was authored by Dr. Coryn and Lyssa Wilson Becho, who currently serves as a principal research associate with The Evaluation Center at …

ROE TIG Week: How Published Research on Evaluation Influences Evaluators’ Thinking by Chris Coryn and Lyssa Wilson Read More »

RoE TIG Week: Research, Evaluation, Research ON Evaluation?! by Dana Linnell

Hello! My name is Dana Linnell (formerly Dana Wanzer). I’m an assistant professor of psychology in evaluation at University of Wisconsin-Stout where I teach evaluation, statistics, and research methods and I’m the program director for our MS in Applied Psychology program, which has a concentration in evaluation. Today I’ll be sharing a simple framework that …

RoE TIG Week: Research, Evaluation, Research ON Evaluation?! by Dana Linnell Read More »

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton

Hi, we are Michael Harnar and Zach Tilton, Co-Principal Investigator on the EvaluATE grant and Doctoral Research Associate, respectively. Our research-on-evaluation (RoE) study investigates evaluation use in NSF’s Advanced Technological Education (ATE) program. ATE grantees spend an average of 8 percent of their grant budgets on evaluation—almost $5 million annually. With so much evidence of …

RoE TIG Week with EvaluATE: Finding Out How Programs Actually Use Evaluation by Michael Harnar and Zach Tilton Read More »

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki

I’m Mike Lesiecki, with EvaluATE, the evaluation hub for the National Science Foundation’s Advanced Technological Education (ATE) program. With colleagues at EvaluATE, I’ve been conducting research on how PIs in the ATE program select and contract with evaluators. This research-on-evaluation (RoE) study looks at a problem common to many institutional grantseekers and evaluators: Funders, PIs, …

RoE TIG Week with EvaluATE: Smoothing the Evaluator Procurement Process by Mike Lesiecki Read More »

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman

Hi! We’re the team behind a sentiment analysis study of EvaluATE’s open-ended survey responses. Larry is a professor of engineering management at WMU, and Nolen is a former Fortune 500 data scientist consulting on data analytics projects. EvaluATE hosts webinars and workshops about evaluation topics, and attendees submit feedback in the form of open- and …

RoE TIG Week with EvaluATE: Analyzing Unstructured Evaluation Data by Larry Mallak and Nolen Akerman Read More »