My name is Femi Gisanrin, and I have spent the past 12 years providing monitoring, evaluation, and learning support to donors and implementers across Nigeria. These experiences have led me to reflect on the importance of engaging the implementer in evaluation and how inclusion impacts the effectiveness of our work. The implementers and other stakeholders provide clarity on the relevance of evaluation questions, propose methods to assess the beneficiaries and opinions to make evaluation recommendations actionable.
Lesson Learned:
Engage Implementers in Evaluations
Why engage implementers during the evaluation process? I guess most implementers will see evaluation as a learning process that can improve their implementation, especially for midline evaluations. We should consider shifting our thinking about evaluations from something that happens to implementers into something that is directly tied to how an implementer learns from and engages with its daily environment. Implementers spend months and years developing relationships with external stakeholders, and evaluations could be an opportunity for strengthening those relationships and increasing stakeholders’ input into evaluation.
We should foster an implementing partner’s commitment to an evaluation from the onset—through development of evaluation questions, stakeholder mapping etc. This serves as a means of building trust and understanding. It also enhances stakeholder’s confidence in recognizing that evaluation is a learning tool that can help to improve the quality of their work and not an activity for fault finding. This will in turn improve the use of evaluation findings by the implementer and other stakeholders. At the end, it has an added benefit of eliminating bureaucratic letters of differences that may come out of poor engagement of the implementer and their insufficient understanding of the evaluation processes. Most implementers see evaluations as scrutinizing their work and often assume that an independent evaluator cannot understand what they do. This misconception of what evaluation is not can be clarified from the onset.
Why is documenting key lessons from the implementer important? —the people who carry out the daily work—can also help in refining evaluation questions to better enable adaptive management of the implementing partners in the field. Implementing partners also facilitate acceptance of the evaluation team during data collection and field work. They can provide unique access and insight to the local context, both by explaining the depth of their engagement with stakeholders (and how the evaluation team can best engage with stakeholders) and the types of interferences that have arisen throughout implementation. By interference, I mean other contextual information in the field that may be making implementation difficult. A typical example is providing technical assistance while others are providing hand-outs to beneficiaries in the same environment. These hand-outs are short-term help that address immediate needs of beneficiaries. Often, beneficiaries will prefer these over the technical assistance that attempts to solve longer-term problems, thus undermining the implementer’s progress.
In conclusion, early engagement of the implementing partners in the evaluation can improve learning and knowledge development among all stakeholders, particularly to understand the experiences of stakeholders and project beneficiaries working with different donors. Ultimately, creating more opportunities for engagement promotes wider dissemination and use of your evaluation results.
Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the AEA365 webpage so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? Please send a note of interest to AEA365@eval.org. AEA365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.e.
Nice read. This engagement is very important
This is quite correct to a large extent.
From my little experience in building construction, It does make a lot of sense to involve implementers in the evaluation process for the following reasons:
1. The sharing of the first hand/field experience of the implementer can highlight areas I.e. the challenges/obstacles/ prospects of work/implementation process that the evaluator may or could not have considered in his evaluation if he carries out this without input from the implementer.
2. The inclusion of the implementer in evaluation process may improve even the fundamentals in the design of the evaluation questions for greater/optimal results which are germane for feedbacks.
3. The social interaction between the implementer and evaluator may create a synchronized relationship which will increase the yields or results of the output.
In conclusion, this synergy will not only ultimately result in a win-win situation for both parties and to the overall success of the project but also reduce the time lags in going back and forth for clarifications and feedbacks from both parties.
Please how can we better understand this? Do you engage only donors? What of NGOs do you work with them? Possibly to train them in early monitoring of their projects too? Thanks