AEA365 | A Tip-a-Day by and for Evaluators



IE TIG Week: Laura Beals and Rachel Albert on TIERS: A Tool for Allocating Evaluation Resources at Nonprofit Agencies

Hello evaluation colleagues! We’re Rachel Albert, Vice President of Learning and Impact, and Laura Beals, Director of Evaluation, from Jewish Family and Children’s Service (Boston, MA). Our department is responsible for the internal evaluation of 44 programs, collectively serving over 17,000 people a year.

At JF&CS, we face two challenges in evaluation management. First, we have multiple external and internal stakeholders – including foundations, federal and state grantors, individual donors, agency leadership, program managers, and staff – each of whom has a different perspective on what sorts of data they need. Second, instead of grants dictating the evaluation resources available to each program, our department is funded by overhead. This means it’s up to us to apportion our department’s evaluation resources thoughtfully across all 44 programs for maximum benefit.

Lessons Learned: To meet this challenge, we developed a tool we call TIERS (“Tool for Intra-agency Evaluation Resource Sharing”). TIERS helps us leverage our resources on each program to answer the questions most relevant to its stakeholders.

Albert Beals

As you go higher in the pyramid, you are looking for stronger and stronger evidence that your program is achieving its intended impact. The pyramid is intended to be both cumulative and sequential: a program should not go up a tier until it has a robust implementation of the previous tier in place.

 Hot Tips:

  • This is not a race: It’s ok to stop at whatever the right tier is for a given program based on its evaluation needs and staff resources.
  • Higher tiers require more resources from both the internal evaluator and program staff.
  • Do not underestimate the difficulty of establishing even just a rigorous Tier 1 across a large agency!

We presented this tool in a demonstration session at Eval 14; check out the AEA e-library for our slides and handout.

Rad Resources: If you are looking for additional information about resource allocation for evaluation, here are a few places to start:

The American Evaluation Association is celebrating Internal Evaluation (IE) Topical Interest Group Week. The contributions all this week to aea365 come from our IE TIG members. Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.

No tags


  • “Learning Conversations”: A Strategy for Achieving High-Quality Data in Nonprofit Agencies - nFocus Solutions · June 15, 2018 at 11:20 am

    […] question: “who are you serving and how?” This is the first level of evaluation questions in our TIERS framework—monitoring. We believe strongly that an understanding of who a program is serving and how is a […]


  • The Challenges of Achieving High-Quality Data in Nonprofit Agencies - nFocus Solutions · June 15, 2018 at 11:01 am

    […] that Rachel Albert, Vice President of Evaluation and Learning for the agency, and I created called TIERS (“Tool for Intra-agency Evaluation Resource Sharing”) that indicates the expectations for the amount and complexity of the data being collected for each […]


  • Ann Gillard · December 11, 2014 at 10:06 am

    Thanks for this! Really great info as we’re building and implementing our strategic plan for research and evaluation. This info helps me communicate with the organizational leadership about scope of work.


  • Seana Hasson · December 6, 2014 at 8:30 am

    This was one of my favorite presentations at AEA! Thank you Rachel and Laura for providing this framework. I have already started stealing — I mean, adapting — it for use at YMCA of the USA.


    • Laura Beals · December 6, 2014 at 9:29 pm

      Thanks, Seana! Great to know that you are finding it useful–please let us know if you have any questions!


Leave a Reply




To top