Hello! My name is Stephanie Mui, and I am a Senior Program Analyst at Good Shepherd Services, evaluating afterschool programs serving elementary and middle school participants. One of my favorite parts of my job is involving afterschool youth council participants in the program performance management cycle, which has served to enrich and expand the impact of our afterschool programs. While youth council participants are involved in each part of the evaluation cycle, I would like to focus on their involvement in helping program leadership learn from the data collected.
Once the program data is collected, we learn by analyzing that data and reviewing the results with our youth participants. This data includes participant experience surveys, attendance data, and program observations reports. Once the results are available, we host a Youth Council Forum in order to discuss the data. The day begins with teaching the participants how to read and understand the results. The youth council participants then participate in several in-depth discussions with their peers and their program staff including:
- Examining the results from their program to identify areas of strength and areas of concern.
- Making recommendations to their program leadership for action steps to help program improve identified areas of concern.
- Planning presentations to share the results and proposed actions steps with the rest of the afterschool participants in the programs they represent. Often the youth will create their own charts to help explain the data to the younger peers. These presentations also include discussions seeking feedback on their proposed action steps.
Lesson Learned: The biggest lesson I’ve learned from incorporating youth into the evaluation cycle is that they have powerful insights that go far beyond the data we receive from the participant experience surveys. For example, the surveys ask participants to identify favorite and least liked activities. When discussing the results, youth council participants provide additional context to what is and isn’t working about those activities.
Lesson Learned: Another big lesson learned is that youth will rise to the occasion. When discussing their data, the youth often discuss not only what the program needs to change but also what they need to change. Youth see themselves as stakeholders and hold themselves accountable to program performance too.
Hot Tip: Create a simplified version of the data reports in order to help youth understand what they are looking at but try to let them see as much of the data as is relevant to them.
Rad Resources: One resource that has helped me in planning data discussions with youth has been “Dabbling in the Data: A Hands-On Guide to Participatory Data Analysis” by Public Profit. This guide includes several activities to help people become more familiar with data analysis and many of the activities are great for youth populations.
For more information about how Good Shepherd Services involves Youth Councils in the Performance Management Cycle process, feel free to download our poster submitted to the 2020 Annual AEA Virtual Conference.
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to firstname.lastname@example.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.