Individual Consultant- Final Evaluator of the project ''Breaking the Silence'' PHASE II

OVERVIEW

Parent Sector : Communication and Information Sector (CI)

Duty Station:  Remote with expected missions to Iraq

Job Family: Communication and Information

Type of contract : Non Staff- Individual Consultancy

Duration of contract :2 months

Recruitment open to : Internal and external candidates

Application Deadline (Midnight Paris Time) : 22-05-2025

UNESCO Core Values: Commitment to the Organization, Integrity, Respect for Diversity, Professionalism

1. Introduction

1.1 Background 

Breaking the Silence: enhance accountability and prosecutions for safety of journalist and fighting impunity, is a joint initiative between United Nations Educational, Scientific and Cultural Organization (UNESCO), Free Prees Unlimited (FPU) a Dutch NGO funded by the Netherlands government. The project seeks to consolidate the national mechanism for the safety of journalists and the fight against impunity that it established in its first phase. Over an initial period of four years (2021-2025), with a total budget of 888407 USD, the goal is to reach a stable national mechanism for the safety of journalists and the issue of impunity. 
The project received two no-cost extensions, six months, and concluded on 31 March 2025. The project included key achievements including the successful establishment of the Media and publishing courts, the judiciary council of Freedom of Expression (FoE), an AI-integrated Information and Communication Technology (ICT) platform for female journalist protection, the delivery of specialized training sessions for judges, police officers, and journalists across Baghdad, Erbil, and Sulaymaniyah, and the procurement of essential ICT equipment to the women journalists digital reporting platform. Notably, the platform is now under the management of the National Committee for the Safety of Journalists in Iraq. Despite some initial delays due to procurement procedures and coordination among stakeholders.
The project aims to:
-    Raise awareness and understanding of good international practices relating to protection mechanisms on freedom of expression, the mitigation of security threats (on- and offline) and effective reporting of security incidents to the relevant authorities;
-    Increase the ability of Iraqi Federal and Kurdish authorities to receive and follow-up on reports of incidents, abuse, harassment and violence against journalists and media professionals through the Special Investigative Unit for freedom of expression related threats and attacks at Ministry of Interior (MoI);
-    Enhance the capacity of the High Judiciary Council (HJC) staff and judges to conduct more efficient judicial follow-up on cases of threats and attacks against journalists; an improved understanding of the journalistic profession and support for media professionals in conducting their work
-    Integrate efforts to address crimes against Iraqi media professionals, ensuring they operate in a coordinated fashion between security forces, the judiciary authority, and other partners.

Long Description

1.2 Beneficiaries, Partners, and Stakeholders

Primary beneficiaries include journalists, particularly those facing legal and safety threats—judges, law enforcement officials, and media institutions. Project partners include Media outlets, NGOs, and HJC which provided technical support for the AI platform, and various Iraqi government entities. Key stakeholders also include the National Committee for the Safety of Journalists, judicial authorities, police training academies, UNESCO, and civil society organizations advocating for press freedom and journalist safety in Iraq.

1.3 Project outcomes and outputs

The project’s expected outcomes are the National mechanisms established, and the capacities of stakeholders enhanced to ensure the safety and protection of male and female journalists. The project is expected to deliver the following outputs:
Output 1:   Capacities of Iraqi Federal and Kurdish authorities, Human Rights defenders, civil society and journalists strengthened to report, monitor and follow-up on cases of violence against journalists Iraqi Federal and Kurdish authorities, Human Rights defenders, civil society and journalist enhanced capacities to report, monitor and follow-up on cases of violence against journalists 
Output 2: Journalists and their families trust and make use of legal and additional mechanisms established to access justice for violations against journalists through enhancing the capacities of stakeholders 
Output 3: Female media professionals in federal Iraq and the KRI with increased safety through awareness raising, training and advice to keep themselves safe.
Output 4: Selected media organizations in federal Iraq and the KRI with assessed security situation, mitigated (on and offline) threats, and reported incidents to the appropriate institutions.
 

2. Purpose and use of the Evaluation

As the project has reached the final point in its four-year life span, a formative evaluation is being commissioned by UNESCO. Conducted an independent external expert it will examine progress and achievements as well as challenges to implementation of programme interventions at the country level for the period of May 2021 to April 2025. The overall purpose of this final evaluation is to assess the progress towards the Programme’s intended outcomes and objectives. It will identify strengths and weaknesses in implementation as well as lessons learned and provide evidence-based recommendations for the refinement of the project’s approach as necessary. The findings of the evaluation will inform decision-making with regard to potential modifications to increase the safety of journalists in future projects. The findings will also serve to guide better, more effective project planning processes for future projects.
 

Long Description

Specifically, the main objectives of the evaluation are to:

1.    Review progress based on an assessment of the project outputs and outcomes to determine the extent to which its objectives are being achieved, including identification of pathways to impact.; 
2.    Assess the relevance, effectiveness, and sustainability of the interventions conducted in the framework of the Joint Programme;
3.    Assess the efficiency in the use of resources by assessing the scope and quality of the outputs delivered, the beneficiaries reached, and contributions to intended outcomes;
4.    Identify lessons learned, and suggest action-oriented recommendations to enhance FoE and the safety of journalists based on the established safety mechanism.
The evaluation report will be shared with relevant key stakeholders. The primary users of the evaluation will be a diverse audience, including UNESCO HQ and field offices concerned, the Iraqi National Safety Journalists Committee, and the donor.

3. Scope of the Evaluation

The evaluation will cover all project components, including capacity-building initiatives, legal and policy interventions, awareness campaigns, and media safety mechanisms. The evaluation will focus on key stakeholders, including government institutions, media organizations, civil society actors, and journalists, to determine the extent to which the project has contributed to improving journalist safety, combating impunity, and strengthening public accountability. The evaluation should be conducted between May and August 2025 within 45 working days.

The evaluation should adopt a mixed-methods approach, incorporating qualitative and quantitative data collection. It should include a review of project documents, stakeholder interviews, focus group discussions, and surveys with beneficiaries. The assessment will consider both intended and unintended outcomes, identifying best practices and lessons learned to inform future interventions. Special attention will be given to gender considerations, particularly the impact of the project on female journalists. The geographic scope will cover both Federal Iraq and the Kurdistan Region, ensuring a comprehensive understanding of the project’s reach and contextual differences.

Long Description

A. Relevance (including Appropriateness)
1.    To what extent does the project align with national and international frameworks and Iraq’s commitments on press freedom, journalist safety, and combating impunity, including the UN Plan of Action?
2.    How well does the project address existing gaps in protection mechanisms, legal accountability, and the specific needs of vulnerable groups, including female journalists?
3.    To what extent is the project contextually appropriate for both Federal Iraq and the Kurdistan Region, considering their distinct media environments?

B. Coherence (including Stakeholder Engagement & Coordination)
4.    To what extent did coordination with UN agencies, donors, and implementing partners support coherent and synergized implementation and monitoring?
5.    How did the project’s design and visibility contribute to consolidated planning, delivery, and potential replication or resource mobilization?
C. Effectiveness (Outcomes & Capacity Building)
6.    To what extent have the project’s intended outcomes been achieved, particularly in enhancing journalist safety and reducing impunity?
7.    What tangible improvements have been observed in journalists’ ability to report and follow up on violence, and how effective were the training activities for journalists, government, and human rights actors?
8.    To what extent has the project increased trust in legal mechanisms among journalists and their families, and led to greater utilization of support systems? 
9.    Were there any unintended outcomes—positive or negative—and what key lessons have emerged from project implementation? 
10.    How effectively has the project engaged key government institutions and promoted multi-stakeholder collaboration with media, civil society, and international partners?
D. Efficiency
11.    To what extent were financial, human, and technical resources used efficiently to achieve the intended results, and were timelines and budgets respected?
12.    How effective were implementation and coordination mechanisms across regions and agencies, and what improvements could enhance delivery?
E. Impact
13.    What are the project’s short- and pathways towards impacts on journalist protection, particularly regarding institutional responses, policy reform, and impunity?
14.    What has been the specific impact on female journalists and other vulnerable groups, and what enabling factors or barriers shaped these results?
F. Sustainability
15.    What mechanisms and levels of institutional ownership have been established to ensure the sustainability and scalability of project outcomes, including legal, digital, and capacity-building components?
 

4. Evaluation Approach and Methodology 

The evaluation will adopt a mixed-methods approach, combining both qualitative and quantitative data collection to ensure a comprehensive assessment of the project. Data will be gathered through document reviews, stakeholder interviews, focus group discussions, and surveys with key beneficiaries, including journalists, government officials, and civil society actors. A comparative analysis will be conducted to measure changes before and after the project’s implementation. The evaluation will also incorporate case studies to highlight specific success stories and challenges. Triangulation of data from multiple sources will enhance the reliability and validity of findings, ensuring an objective assessment of the project’s outcomes.

4.1 Desk Review

-    Analysis of monthly reports, and annual review reports.
-    Review of the project documents, mission reports or summaries by UNESCO and partner agencies, minutes of the National Safety Committee meetings, minutes of the other meetings;
-    Analysis of country-level logical framework in view of:

• The linkages between the activities, expected outputs and outcomes were set out towards the objectives and goal;
• The scope of activities are achievable and realistic;
• The performance indicators defined at both output and outcome levels are appropriate;
• The targets were set based on the SMART criteria;

Baseline values were drawn from relevant surveys/studies conducted;
Gender equality considerations were reflected in the framework.

4.2 Reconstruction of a Theory of Change (ToC)

The ToC will be reconstructed by mapping the logical pathways that connect project activities to intended outcomes and long-term impact. This process will involve:

-    Identifying the Core Problem and Context-Specific Challenges
-    What are the key threats to journalist safety, freedom of expression, and media accountability in each country?
-    How do political, legal, and social factors influence these challenges?
-    Defining Expected Outcomes and Impact
-    What changes in journalist protection, media policies, and public accountability does the programme aim to achieve?
-    How will increased capacity, awareness, and institutional reforms contribute to long-term improvements in media freedom?
-    Mapping Causal Pathways
-    How do project activities (e.g., training, advocacy, legal support) lead to short-term outputs, such as increased reporting of violations, enhanced legal responses, and greater institutional commitment?
-    What are the intermediate changes required for achieving sustainable impact (e.g., improved trust in legal mechanisms, stronger enforcement of protection policies, and media organizations adopting safety protocols)?
 

4.3 Field-based Data Collection

The sampling approach is recommended to ensure diverse representation among beneficiaries, including journalists, judges, and police officers across project locations. Sampling should capture gender, regional, and professional diversity. Field visits to Baghdad, Erbil, and Sulaymaniyah are suggested to assess on-ground impact, National Safety Committee of journalists, and stakeholder engagement. These missions will allow evaluators to conduct interviews, observe training outcomes, and validate reported results. Coordination with local authorities and partners will be essential. Travel, security, and logistical support will be factored into the evaluation budget to ensure comprehensive coverage and credible, context-sensitive findings.
The evaluation will incorporate field-based data collection to ensure a comprehensive and contextually relevant assessment of the project’s results. This will involve on-site visits to key locations where project activities have been implemented, allowing for direct engagement with stakeholders, beneficiaries, and implementing partners.

Data will be gathered through the following suggested methods:

• In-depth interviews with journalists, government officials, legal experts, and civil society representatives to understand their perspectives on the project’s effectiveness (online or offline).
• Focus group discussions with media professionals, human rights defenders, and female journalists to assess the impact of capacity-building efforts and safety mechanisms.
• Surveys and questionnaires distributed to project beneficiaries to collect quantitative data on knowledge retention, behavioral change, and trust in legal protection mechanisms.
• Observational studies to document real-time interactions, challenges, and best practices in the implementation of journalist protection measures.
   

4.4 Participatory Consultation

The evaluation will adopt a participatory consultation approach to ensure inclusivity, transparency, and stakeholder ownership of the findings. This approach will actively engage key stakeholders—including journalists, media organizations, government representatives, civil society actors, and human rights defenders—in both the data collection and validation processes.
Key methods will include:

• Stakeholder Meeting: Bringing together diverse actors to discuss project outcomes, share experiences, and provide feedback on implementation effectiveness.
• Focus Group Discussions: Engaging journalists, particularly female media professionals, to assess their perspectives on safety mechanisms and legal protections.
• Key Informant Interviews: Conducting one-on-one consultations with government officials, judiciary representatives, and advocacy groups to evaluate institutional commitments and policy impact.

5. Planning and Implementation Arrangements 

5.1 Management and Implementation Responsibilities

The evaluation will be managed by the Communication and Information Sector of UNESCO Iraq office. It will be conducted by an external consultant and assistant (as applicable). 

The lead evaluator will be responsible for leading the evaluation efforts from a local perspective. S/he will develop a detailed work plan an evaluation methodology and data collection tools, to conduct data collection and analysis, as well as to conduct fieldwork and to prepare the draft and final evaluation report and a PowerPoint (PPT) presentation of the process and results in English. The lead evaluator will present findings and recommendations at the stakeholder meeting. 

The evaluator is expected to contribute specific knowledge of and experience in evaluating the national safety of journalists. CI is responsible for the overall management of the evaluation and quality assurance of the deliverables.
 

5.2 Evaluation Reference Group

A reference group will be established to ccompany the evaluation process and provide feedback on inception report, draft and final evaluation report. The reference group comprises members from UNESCO Field Office in Iraq, FPU team, IOS Regional Evaluation Associate based in Doha, and project partners; High Judiciary Council, the Ministry of Interior, the Communication and Media Commission, the Iraqi journalists syndicate in Baghdad and KRI, and NGOs of media and press freedom. The reference group shall liaise electronically and meet with the evaluation team during the evaluation, as necessary. 

5.3 Logistics

The CI sector in Iraq will assist in the preparation and organization of the evaluation exercise and will support the facilitation process in the field visits of the evaluator.  The evaluator will be expected to be self-sufficient for their own logistics: office space, telecommunications, printing of documentation, travel, etc. S/he will also be responsible for administering and disseminating all methodological tools such as surveys, and logistics related to travel. CI will provide access to all relevant documentation and contact details of all stakeholders concerned and distribution lists. It will also facilitate access to UNESCO, and FPU.

6. Deliverables and Timeline

The final evaluation is expected to be conducted between April and June 2025 for an indicative 45 working days from the day of signing the contract to complete the assignment. 

The evaluator will visit the main partners offices, conduct field site visits. In addition, to conduct interviews during the data collection phase, and to hold a stakeholders’ meetings for discussing and validating findings and recommendations. Some tasks may be conducted via Skype or video conference.

The evaluator will be required to deliver the following key deliverables:

• Inception report including an assessment of project design quality, a draft reconstructed Theory of Change, evaluation framework, detailed evaluation methodology, a detailed progress monitoring template and work plan.
• Workshop for the presentation and validation of the findings and recommendations to the Reference Group.
• Draft and Final Evaluation report of 20-30 pages excluding annexes to be structured as follows. Detailed specific evaluation reports to be attached in annexes, with no more than 20 pages and the same structure as outlined below. They can also include extracts from the overall Final Evaluation report.
• Executive summary (maximum four pages);
•  Purpose and use of the evaluation;
• Methodology (including challenges and limitations);
• Program description and Theory of Change of the project at the local level;
• Findings;
• Conclusions;
• Lessons learned;
• Recommendations;
• Annexes (including interview list, key documents consulted, the Terms of Reference and detailed evaluation reports). 

Required Qualifications

Academic Qualifications

• Advanced university degree in Education, Social Sciences, Political Sciences, Economics, or any other related field

Work Experience

• At least 10 years of relavent working experience is required;
•  Senior experience of at least 7 years in project and/or programme evaluation, planning and management;
• Knowledge of and experience in applying qualitative and quantitative data analysis techniques and RBM principles;
• Understanding and knowledge of the UN mandates and its programming in relation to Human Rights and Gender Equality issues;
• Excellent analytical and demonstrated drafting skills in English; 
• No previous involvement in the implementation of the activities under review;

Language
•  Excellent knowledge of English (written and spoken) is required
 

Desired Qualifications

Work Experience

• Work experience in the UN or experience with assignments for the UN;
• Experience with assignments focusing on multi-stakeholder partnerships, and/or media capacity building;

Language
•  Excellent knowledge of Arabic (written and spoken) is desirable
 

Application Process

Interested candidates should click on “Apply Now”, then download and complete the Employment History form (Word file). At the end of the Word file, insert extra pages with the following required information in English:
* Upon completing the Word file with all the requested information above, upload the file at the “My Employment History Form / My Documents” section of the online application form. Only applications with the below requested information will be considered.
1- A Technical Written proposal (2-3 Pages Maximum) consisting of:
•    Comments on the Terms of Reference, if any (in brief);
•    An up-to-date curriculum vitae (CV), and a statement indicating how your qualifications and experience make you suitable for the assignment.

•    A cover letter outlining their relevant experience and proposal /approach to the assignment.
•    A description of your proposed approach and methodology for undertaking the assignment.

•    Examples of previous work related to in- service teachers’ capacity development
•    A work plan with detailed milestones and key deliverables/activities as per the terms of reference.
•    List of work assignments and/or THREE (03) contacts as references – to be filled and returned to UNESCO as part of the submission.

2-A Financial proposal in US dollars. Any travel and subsistence requirements should be indicated separately. Please design the payment scheme against a clear and specific set of deliverables and milestones as reflected in the work plan.
 

Remuneration

The remuneration for this consultancy will be proportionate to the qualifications and experience of the consultant. Detailed budget proposals should be submitted as part of the application process.

Footer