Hello, AEA365 community! Liz DiLuzio here, Lead Curator of the blog. This week is Individuals Week, which means we take a break from our themed weeks and spotlight the Hot Tips, Cool Tricks, Rad Resources and Lessons Learned from any evaluator interested in sharing. Would you like to contribute to future individuals weeks? Email me at AEA365@eval.org with an idea or a draft and we will make it happen.
This post was originally published on February 23, 2021
Hi, We’re Leah Josephson (she/her) and Lauren Beriont (she/her) with Emergence Collective, and Alex Bauer with a family foundation in Nebraska. This year our two teams collaborated to support some of the foundation’s grant partners in building evaluation capacity.
As a foundation that takes a relationship-based grantmaking approach, trust and shared values and goals are crucial to grantmaking. Creating those relationships in rural areas of the state can be challenging, so the foundation saw this as an opportunity to understand where there was alignment between grantee partners and the work of the foundation. It would also provide an asset to the grantees that they could utilize beyond the foundation’s purposes.
At Emergence Collective, we wanted our nonprofit partners to understand “evaluation” holistically – not just as data collection and reporting, but as an ongoing process of learning, growth, and curiosity. We started by designing a new self-assessment tool focused on internal learning culture.
The survey tool includes assessment items focused on four areas of evaluation capacity and learning culture, designed in consideration of the guiding questions below. Embedded throughout the assessment are questions focused on equitable evaluation practices and approaches. Other themes include participatory approaches, the ways team members relate to one another, and perceptions of management and leaders.
- Capacity: Are we investing in evaluation: people, data systems, time? Do we have the technical skills to do the kind of evaluation we want?
- Praxis: What does evaluation look like in practice? How are we taking time to theorize, act, and learn in real time? Can we point to concrete changes?
- Learning: Is there space to reflect? Is feedback taken seriously across the organization? Which core beliefs drive our evaluation?
- Strategy: Is our vision and mission clear? What is our evaluation plan? Does the way we measure our work make sense?
At Emergence Collective, our team didn’t draw any conclusions from the results of the assessment. Instead, we pulled out composite scores for each practice area, plus other key data, into a colorful one-pager. We then led partner teams through an engaging, facilitated process of interpreting the findings themselves. Based on these conversations and a brainstorming session, we provided a few ideas for next steps for evaluation capacity building, and the partners all chose their next moves, identifying the path forward for the rest of the capacity-building year.
What set this process apart from others that the foundation has seen evaluation firms use in the past is that the tool identified areas of strength and opportunities for growth rather than assuming where capacity building was needed. Emergence Collective was able to tailor the capacity building process to each organization to meet their needs.
Rad Resource:
We pored over many existing assessment resources in conducting research to develop our own Culture of Learning Self Assessment. One was The Performance Imperative, a free organizational assessment tool developed by Leap of Reason. Though our assessment is geared more toward curiosity and learning than the pursuit of excellence, we were inspired by this tool.
Lesson Learned:
“It was an extremely valuable process in terms of clarifying nonprofits’ goals. Now we can have productive conversations based on the theory of change that the nonprofit generated themselves.”- Tyler, program officer at the foundation
Lesson Learned:
We were pleasantly surprised by how thoughtfully our partners interpreted their own assessment findings – reminding us once again that they’re truly the experts! Throughout this ECB process we continue to consider our role as that of facilitator more than anything else.
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.