Hi! We are Krista Collins, Director of Strategy & Innovation at Boys & Girls Clubs of America (BGCA), and Mike Armstrong, Vice President of Club Operations and Evaluation at Boys & Girls Clubs of Metro Atlanta (BGCMA). Together we seek to understand how our professional development courses and youth programs work in tandem to support the 58,000 staff members in local communities and across the nation that create opportunities for approximately 4 million youth each year to achieve great futures through our priority focus on Academic Success, Good Character and Citizenship, and Healthy Lifestyles.
Since 2011, BGCA has conducted the annual National Youth Outcomes Initiative (NYOI) to measure how effectively the Club experience is being implemented and its’ impact on our members. Built on research-informed indicators of youth achievement that align with our priority outcomes, and benchmarked against other leading national youth surveys, NYOI data is used to drive continuous quality improvement efforts and communicate our impact to key stakeholders across the youth development field.
Rad Resource: Looking for comparison data to understand the impact of youth development programs? Download our 2015 National Outcomes Report: Measuring the Impact of Boys & Girls Clubs. A few highlights from our report:
- 74% of members aged 12-17 who attend the Club regularly say they earn mostly A’s and B’s, compared to 67% of youth nationally.
- By 12th Grade, Club members’ rate of monthly volunteering is more than double that of the national average for same-grade peers.
- Teens who stay connected to the Club as they get older seem better able to resist high-risk behaviors than teens nationally at the same ages.
Hot Tip: Sharing Club-level results and training on data-utilization promotes survey participation
In four years the number of NYOI participants has grown from 2,800 Club members to 165,000 – that is an increase of almost 6000%! Much of this growth can be attributed to BGCA’s efforts to demonstrate the value of data to local Clubs. BGCA prepares reports for each participating Club organization, and provides local trainings and consultations to ensure that the results are interpreted correctly and used to drive improvement.
Hot Tip: Data-utilization requires learning that is strategic and intentional.
To fully realize the value that formal measurement and evaluation brings, local clubs have employed continuous quality improvement systems that integrate knowledge generation and decision-making at all levels of their organization. Decision making that affects everything from resource allocation at the corporate level to programmatic foci and staff assignments at the club-site level only occurs if a formal and iterative process of reflection and dialogue practiced.
We’re looking forward to October and the Evaluation 2016 annual conference all this week with our colleagues in the Local Arrangements Working Group (LAWG). Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to contribute to aea365? Review the contribution guidelines and send your draft post to email@example.com.