Evaluation Guidance for Project Managers

PLANNING FOR AN EVALUATION AT THE DESIGN STAGE

Programmes and projects need to be designed with evaluation in mind as evaluation is an essential part of their life cycle. See Evaluation in the Project/Programme Cycle

When formulating a new project/programme or a revision, the Programme Manager should: 1) Review prior evaluation results to inform the design; 2) Review evaluation plans to ensure coordination and coherence; 3) Carefully plan the timing of the evaluation; and, 4) Ensure sufficient funding (calculated with the Evaluation Budget Matrix). 

All evaluations are further guided by the principles of human rights, gender equality and leaving no one behind. See Human Rights and Gender Equality

Evaluation Handbook (Overall context of evaluation)

APPROVING PROCESS OF EVALUATION IN A PROJECT

All programme and project documents and revisions thereof are required to include a tentative evaluation plan. IES reviews and clears such in the Direct Approval process and the UNODC Programme Review Committee (PRC). To avoid last minute changes, pre-consultation with IES is recommended.

There is a Template for the evaluation paragraph in the project document, (Spanish) and the project revisions(Spanish). Required details include: 1) Type of evaluation; 2) Quarter and year to initiate the evaluation; 3) Budget (calculated with the Evaluation Budget Matrix) 4) Use of evaluation results; 6) Prior evaluations; and, 7) whether a Cluster evaluation is planned. See Guidelines for Cluster Evaluation  

Evaluation Handbook (Overall context of evaluation)

INDEPENDENT PROJECT EVALUATION

The responsibility for managing Independent Project Evaluations (IPEs) lies with the Manager of the programme/project being evaluated. An IPE is conducted by independent external evaluators. IES backstops the process, including reviewing and clearing all deliverables in the process, as well as provides quality assurance and guidance throughout the process.

An IPE is initiated 8 months prior to the planned date of completion of the project (final evaluation) or half way through the duration of the project (mid-term evaluation) by the Manager in the on-line evaluation management application Unite Evaluations. See Unite Evaluations User Manual for Programme Managers. See also Evaluation Step by Step

Flowchart 

Template Evaluation ToR 

Template Inception ReportGuidelines 

Template Evaluation Report; Template Evaluation Brief;

Typographic StylesUN Spelling

Evaluation Handbook (Guide for project/programme managers and evaluators;  and Practical guide to carry out high quality evaluations)

See also Evaluation during COVID19 Crisis 

IN-DEPTH EVALUATION

In-depth Evaluations (IDEs) are usually large-scale strategic evaluations of corporate-level initiatives, policies, approaches, country/regional/thematic or global programmes. An IDE is undertaken by independent external evaluators or specialized companies, is managed by IES and also involves staff from IES as part of the evaluation team. IES further initiates the IDE in the on-line evaluation management application Unite Evaluations.

IDEs usually require extensive consultation, take longer to complete, command significantly larger budgets, and the reports are shared with a wider audience. IDEs are initiated 10-12 months prior to the planned date of completion of the intervention. See also Evaluation Step by Step

Flowchart 

Template Evaluation ToR 

Template Inception ReportGuidelines 

Template Evaluation Report; Template Evaluation Brief

Typographic StylesUN Spelling 

Evaluation Handbook (Guide for project/programme managers and evaluators; and Practical guide to carry out high quality evaluations)

See also Evaluation during COVID-19 Crisis 

FOLLOW-UP & USING THE EVALUATION

The evaluation process does not end with the final evaluation report. In the light of the evaluation recommendations, Programme/Project Managers discuss and liaise with relevant parties, including senior management, other UNODC sections, donors, etc. and and prepare a Management Response (MR). The MR is included in a table in the final evaluation report, indicating whether each recommendation is accepted/partially accepted or rejected, together with action to be taken to implement. For an IDE, a written narrative (approximately 1–2 pages) is further added to the final report. 

Managers are also responsible for the development of the Evaluation Follow-up Plan (EFP) on the implementation of the evaluation recommendations. The EFP is prepared  in the on-line evaluation management application Unite Evaluations and is reviewed and cleared by IES. See Guidance for the drafting and monitoring of the Follow-up Plan. The Manager is required to update the follow-up plan once a year. IES further reports on the implementation of recommendations to the Executive Director and Member States on an annual basis.

The evaluation report is further disseminated by Programme/Project Manager for learning and improved UNODC programming. IES shares evaluation results with Member States and UNODC's Executive Director, as well as publishes Evaluation Reports and Evaluation Briefs on its website. All UNODC Evaluation Reports further undergo an external quality assessment (Quality Assessment of Independent Project and In-Depth Evaluation Reports). See the Evaluation Quality Assessment Report 2019 and the 2-page Summary.