Hi everyone, Elizabeth DiLuzio here. I’m the newest AEA365 curator and Manager of Evaluation and Strategy at Good Shepherd Services in NYC. Today, I want to share a semi-new approach to impact evaluation called lean data.
The use case for a lean data approach is quite compelling: it’s a decision-making tool for when time and money are short and there is a pressing need to make rapid operational decisions. Who of us hasn’t been in that position before? The lean data approach can also help if you feel most of your time is spent satisfying funder requirements, or if the data collection process is so lengthy that any findings are irrelevant by the time you share them with program staff.
But what exactly is this seeming panacea? Let’s take a closer look.
What is it?
Lean data is a survey approach to measuring and managing a program’s impact that was first piloted by Acumen in 2014. A lean data approach does not replace but rather complements your current impact evaluation method(s). It applies three lean experimentation principles:
- Customer First – goodbye compliance mindset, hello value for customers and program staff
- Low-Cost Technology – finding ways to harness technology to create rapid feedback loops
- Data-Driven Decision Making – asking the essential questions that, when answered, can aid in deciding on next steps
How does it work?
Rather than taking a “what data do we need?” approach, lean data takes a “what am I trying to accomplish and what information would help me to get there?” approach. The whole process consists of 4 stages:
- Get Started. In this stage, you will identify the impact you are trying to achieve and what information you need in order to get there.
- Choose Your Technology. Here, you’ll want to choose the type of data collection technology that works the best for your population.
- Choose Your Questions and Method. When identifying or creating your questions, be sure that each is relevant to what you need to know, and that the response you receive will drive some type of action. When it comes to methods, you’ll want to map out the program’s user journey in order to pinpoint the times that staff are already in contact with your surveyees. Any of those moments, called touchpoints, are when your questions can be embedded into already existing operations. This is designed to lessen the burden on the clients and staff.
- Take Action. This might be the most important stage! The purpose of this approach is to inform a concrete decision, so be sure to take action once you get the information you need.
Wondering how this approach looks in action? Stay tuned for my next blog on Saturday, December 7th where we will explore a couple of case studies. See you then!
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to firstname.lastname@example.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.