Quantitative Methods: Theory and Design

Michelle Baron on What Evaluators Have to Be Thankful For

Hi, my name is Michelle Baron. I am the Associate Director of The Evaluators’ Institute, an evaluation training organization, and the chair of the curating team for aea365. On this Thanksgiving Day in the United States, there are many things for which evaluators have to be thankful. Four topics come readily to mind: 1. Automation: …

Michelle Baron on What Evaluators Have to Be Thankful For Read More »

Leland Lockhart on Cross Classified Random Effects Models in Evaluation

My name is Leland Lockhart, and I am a graduate student at the University of Texas at Austin and a research assistant at ACT, Inc.’s National Center for Educational Achievement (NCEA).  The NCEA is a department of ACT, Inc., a not-for-profit organization committed to helping people achieve education and workplace success. NCEA builds the capacity …

Leland Lockhart on Cross Classified Random Effects Models in Evaluation Read More »

Lacie Barber on Survey Methodology Tips for Improving Quantitative Data Quality

Hi, my name is Lacie Barber and I am the Statistics Counselor at Smith College in the Spinelli Center for Quantitative Learning. I have a Ph.D. in Industrial-Organizational Psychology and a minor in Research Methodology. Many researchers and practitioners work hard to develop and/or select psychometrically sound quantitative measures for their projects. Unfortunately, less attention …

Lacie Barber on Survey Methodology Tips for Improving Quantitative Data Quality Read More »

Ehren Reed and Johanna Morariu on New Research: The State of Evaluation 2010

We are Ehren Reed and Johanna Morariu, Senior Associates of Innovation Network. We work with foundations and nonprofits to evaluate and learn from programs, projects, and advocacy endeavors. For more than fifteen years, Innovation Network has been an intermediary in the philanthropic and nonprofit sectors—our mission is to build the evaluation capacity of people and …

Ehren Reed and Johanna Morariu on New Research: The State of Evaluation 2010 Read More »

Poster Week: Kai Chi Yam on Using Exploratory Factor Analysis in Evaluation

My name is Kai Chi Yam, and I am a graduate student at Washington State University. I recently had an opportunity to evaluate a university-based mentoring program. Exploratory Factor Analysis (EFA) was used to provide score validity evidence through the examination of internal structure of study-specific measures. Such evidence can increase the utility of the …

Poster Week: Kai Chi Yam on Using Exploratory Factor Analysis in Evaluation Read More »

E. Jane Davidson on Evaluative Rubrics

My name is Jane Davidson and I run an evaluation consulting business called Real Evaluation Ltd. In my work, I advise and support organizations on strategic evaluation; provide evaluation capacity building and professional development; develop tools and templates to help organizations conduct, interpret, and use evaluations themselves; and conduct independent and collaborative evaluations and meta-evaluations. …

E. Jane Davidson on Evaluative Rubrics Read More »

Susan Kistler on TED Talks for Evaluators

My name is Susan Kistler. I am the Executive Director of the American Evaluation Association and I contribute each Saturday’s aea365 post. Resource: Have you ever wanted to hear “riveting talks by remarkable people?” That is the tagline for TED Talks, brought to you by TED, a nonprofit dedicated to “ideas worth spreading.”  TED hosts …

Susan Kistler on TED Talks for Evaluators Read More »

Christopher Moore on Structural Equation Modeling for Theory-Driven Evaluation

Hi, my name is Christopher Moore.  I am a doctoral student in Quantitative Methods in Education at the University of Minnesota and a Quantitative Analyst at the Minnesota Department of Education.  My interests include preventing educational and health disparities, latent variable models, spatial statistical methods, and causal theory and inference. Hot Tip: So you’re conducting …

Christopher Moore on Structural Equation Modeling for Theory-Driven Evaluation Read More »

Leigh Wang on Database Design

Hi, I’m Lihshing Leigh Wang, and I’m an Associate Professor of Psychometrics and Quantitative Methodology at University of Cincinnati. Today I want to share with you a tip about database design. Evaluation research that involves large-scale, multi-level, multi-year, and multi-cohort data presents special challenges to evaluators. Most training programs and publication venues focus on the …

Leigh Wang on Database Design Read More »

Mende Davis and Mei-kuang Chen on Estimating Power and Sample Size

Hi, we are Mende Davis (assistant research professor) and Mei-kuang Chen (advanced graduate student) in the department of Psychology at the University of Arizona. We are also members of the Evaluation Group for Analysis of Data (EGAD) led by Lee Sechrest. G*power is a useful tool to estimate minimum sample size or possible power of …

Mende Davis and Mei-kuang Chen on Estimating Power and Sample Size Read More »