Welcome to aea365! Please take a moment to review our new community guidelines. Learn More.

Search Results for: data analysis

Experiments TIG Week: More Things You Thought You Couldn’t Learn from a Randomized Experiment… But You Can… by Steve Bell

Hello, again!  It’s Steve Bell here, that evaluator with Abt Associates who is eager to share some insights regarding the learning potential of social experiments. In a week-long blog series, we are examining concerns about social experiments to offer tips for how to avoid common pitfalls and to support the extension of this powerful research …

Experiments TIG Week: More Things You Thought You Couldn’t Learn from a Randomized Experiment… But You Can… by Steve Bell Read More »

Experiments TIG Week: What Can Experimental Evaluations Tell Us? And Why We Should Not Be So Doubtful About What They Won’t Tell Us by Laura Peck

Hello AEA365 readers!  I am Laura Peck, founder and co-chair of the AEA’s recently-established (and growing) Design & Analysis of Experiments TIG.  I work at Abt Associates as an evaluator in the Social & Economic Policy Division and director of Abt’s Research & Evaluation Expertise Center.  Today’s AEA365 blogpost recaps what experimental evaluations typically tell …

Experiments TIG Week: What Can Experimental Evaluations Tell Us? And Why We Should Not Be So Doubtful About What They Won’t Tell Us by Laura Peck Read More »

Experiments TIG Week: The Ethics of Using Experimental Evaluations in the Field by Laura Peck and Steve Bell

Greetings, and welcome to a week’s worth of insights sponsored by the Design and Analysis of Experiments TIG!  We are Laura Peck and Steve Bell, program evaluators with Abt Associates. When deciding how to invest in social programs, policymakers and program managers increasingly ask for evidence of effectiveness.  A strong method for measuring a program’s …

Experiments TIG Week: The Ethics of Using Experimental Evaluations in the Field by Laura Peck and Steve Bell Read More »

MSI Fellowship Week: Cirecie West-Olatunji and Chandra Story On Intellectual Colonization and Exporting Pejorative Attitudes in Program Evaluation: 3 Hot Tips

We are both AEA Minority Serving Institution (MSI) Fellows this year with specialization in two related disciplines. The first author, Cirecie West-Olatunji is a counselor educator at Xavier University of Louisiana and Chandra Story is a faculty member in Health Education and Promotion/Pubic Health at Oklahoma State University. As we conclude our year long fellowship …

MSI Fellowship Week: Cirecie West-Olatunji and Chandra Story On Intellectual Colonization and Exporting Pejorative Attitudes in Program Evaluation: 3 Hot Tips Read More »

Sheila B Robinson on Blogging in the New Year!

Season’s Greetings and Happy Holidays loyal AEA365 readers! I’m Sheila B. Robinson, Lead Curator and sometimes Saturday contributor with a few tips and tools for bloggers, and a quick update to our contribution guidelines.   Evaluation and blogging go together like apple pie and ice cream – each great on its own, but together? Fabulous! Many …

Sheila B Robinson on Blogging in the New Year! Read More »

Experiments TIG Week: Laura Peck on The Origins and Meaning of the “Black Box” Label and How Innovative Experimental Research is Working Shake It

Hi again, it’s Laura Peck here, that evaluator from Abt Associates.  To close out the Design & Analysis of Experiments TIG’s first week of contributions to the AEA365 blog, I focus on one of the main critiques of experimental evaluations, that known as the “black box” criticism. Experimentally-designed evaluations can isolate the impact of an …

Experiments TIG Week: Laura Peck on The Origins and Meaning of the “Black Box” Label and How Innovative Experimental Research is Working Shake It Read More »

Experiments TIG Week: Keith Zvoch on Strong Program Evaluation Design Alternatives

Keith Zvoch here. I am an Associate Professor at the University of Oregon. In this post, I would like to discuss regression discontinuity (RD) and interrupted time series (ITS) designs, two strong and practical alternatives to the randomized control trial (RCT). Cool Trick: Take Advantage of Naturally Occurring Design Contexts Evaluators are often charged with …

Experiments TIG Week: Keith Zvoch on Strong Program Evaluation Design Alternatives Read More »

Experiments TIG Week: William Faulkner on A Righteous Cover-up: Behind the Scenes of the Most Famous “Experiment” in International Development History

Hello! I’m William Faulkner, Director of Flux, an M&E consultancy based in New Orleans. I want to pull back the curtain on perhaps the most famous experiment in international development history – the one conducted by Washington DC’s IFPRI on Mexico’s largest anti-poverty program, PROGRESA (now Prospera).  The Down-Low: Basically, the mainstream narrative of this …

Experiments TIG Week: William Faulkner on A Righteous Cover-up: Behind the Scenes of the Most Famous “Experiment” in International Development History Read More »

Experiments TIG Week: Allan Porowski on How to Make Your Chances of Conducting A Successful RCT Seem a Little Less…Random

I’m Allan Porowski, a Principal Associate at Abt Associates and a fan of experiments – when they’re conducted under the right circumstances. Experiments, commonly referred to as RCTs (randomized controlled trials) go through three stages: (1) crazy start-up period, (2) normal data collection period, and (3) crazy analysis period. Hot Tips:  Here are some tips …

Experiments TIG Week: Allan Porowski on How to Make Your Chances of Conducting A Successful RCT Seem a Little Less…Random Read More »

Dena Lomofsky on Monitoring, Evaluation and Learning of Policy Influence for Think Tanks

Dena Lomofsky, managing member of Southern Hemisphere and Vanesa Weyrauch, co-founder of Politics & Ideas work together to deliver specialist online courses on MEL for think tanks, in the field of policy influence. There are many exciting ways of doing MEL for think tanks, which we would love to share with you. The complexity of …

Dena Lomofsky on Monitoring, Evaluation and Learning of Policy Influence for Think Tanks Read More »