External Evaluation Independent Contractor

Heartland Alliance - Chicago, IL3.6

Full-timeEstimated: $64,000 - $88,000 a year
EducationSkills
TERMS OF REFERENCE – EXTERNAL EVALUATION INDEPENDENT CONTRACTOR

1.0 Organizational Background

Heartland Alliance International (HAI) is the youngest and fastest growing part of Heartland Alliance for Human Needs & Human Rights, a family of organizations that has been leading anti-poverty and social justice work in Chicago for more than 125 years. HAI has significant expertise in the fields of trauma-informed mental health care and access to justice for survivors of rights abuses. Across all of its programs, HAI promotes progressive, innovative approaches to human rights protections and gender equality.

Heartland Alliance International (HAI) has been working in Iraq since 2004, providing legal, mental health and other services to vulnerable Iraqis throughout Federal Iraq and the Iraqi Kurdistan Region (IKR). Based in Sulimanyah, HAI works to protect, train, and educate through (i) direct legal and psycho-social services; (ii) training and capacity-building for local agencies, professionals, and service providers; and (iii) outreach sessions providing information about legal rights and other services available to those in need.

2.0 Project Background

With generous support from Bureau of Democracy, Human Rights and Labor (DRL), Heartland Alliance International (HAI) launched the REM-II project. In October 2016, HAI started implementing Restoring the Future: Helping Iraqi Religious and Ethnic Minorities Recover in the Aftermath of the Islamic State of Iraq and the Levant (Religious and Ethnic Minorities, REMII). The main purpose of the project is that Ethnic and religious minorities affected by ISIL recover their full political, social, and cultural rights.

In October 2016, Heartland Alliance International (HAI) stared implementing Restoring the Future: Helping Iraqi Religious and Ethnic Minorities Recover in the Aftermath of the Islamic State of Iraq and the Levant (Religious and Ethnic Minorities, REMII). The main purpose of the project is to support Ethnic and religious minorities affected by ISIL recover their full political, social, and cultural rights.

The project strategic objectives (SOs) are the following:
  • SO 1: REM are able to access legal protection, contest or prevent discrimination and continued violence, and recover assets as the threat from ISIL is contained and reversed.
  • SO 2: Religious and ethnic minorities develop the skills required to assert their interests and rights in territories liberated from ISIL and actively participate in post-ISIL transitional governance.
  • SO 3: REM victims of severe human rights abuses, particularly female abductees, recover socially and are empowered to participate in the social, cultural, and political life of their communities.
3.0 Evaluation Rationale:
HAI seeks a Contractor to conduct a final evaluation of the Restoring the Future (REM-II) project over the life of the project. The evaluation will measure the project’s effectiveness, efficiency, relevance, potential for impact, and potential for sustainability. HAI and the Contractor will collaboratively design the evaluation methodology to investigate evaluation objectives that include but are not limited to:

To determine effectiveness, efficiency, and relevance of the project interventions particularly focusing on each strategic objective.

To estimate impact of key interventions and their contribution to broader project aspirations using appropriate qualitative or quantitative tools.

Establish the sustainability of the project using appropriate sustainability evaluation criteria.

To document strengths/weaknesses, opportunities explored/missed, and threat of experience in both design and implementation of the project.

To highlight key programmatic lessons learned and recommendation for future programming for religious, and ethnic minorities.

Key Evaluation Objectives

Remarks

To determine effectiveness, efficiency, and relevance of the project interventions particularly focusing on each strategic objective.

It is expected that the consultant will ascertain how effective and efficient the project was in delivering anticipated results and how relevant the project was to targeted beneficiaries and in the Iraq post-war context. Based on this analysis, the consultant should draw lessons learned and necessary recommendations for future programming or program scale-up where applicable.

To estimate impact of key interventions and their contribution to broader project aspirations using appropriate qualitative or quantitative tools.

Guided by the program indicators outlined in the HAI monitoring and evaluation (M&E) documents, the consultant is expected to collect data on the impact of the project and demonstrate, using appropriate methods, how the project made breakthroughs in the targeted groups. The consultant is expected to review all M&E plans, documents, and narratives for the project to understand outcome and impact indicators and estimate impact of the project using appropriate contribution analysis tools or quasi experimental analysis where applicable. The consultant is expected to propose an appropriate methodology for this type of analysis and at the end provide necessary design and methodological recommendations.

Establish the sustainability of the project using appropriate sustainability evaluation criteria.

Using a standard approved sustainability assessment checklist and standards, the consultant is expected to ascertain the level of sustainability of the project. Appropriate system level analysis approaches should be adopted to guide the discernment of how the project contributed to sustainability.

To document strengths/ weaknesses, opportunities explored/missed, and threat of experience in both design and implementation of the project.
Using appropriate simplified social economic analysis approaches, the consultant is expected to analyze the strengths and opportunities explored and missed by the project during the implementation period. In addition, the consultant should also provide an analysis of the weaknesses and threat that the project design had from initiations to completion and threats manifested in the course of implementation and how they were addressed/should be addressed in future programming.

To highlight key programmatic lessons learned and recommendation for future programming for religious, and ethnic minorities.
The project had specific interventions targeting different project participants; the consultant should document what are the key achievements in reaching targeted groups, lessons learned, and recommendations for moving forward.

The evaluation will be shared both with HAI and the donor and will help inform the implementation of HAI’s future programming. The external evaluation will complement HAI’s internal assessment of the project, and HAI will share the evaluation with staff, partners, and other stakeholders as necessary.

Evaluation Design & Methodology
The design and methodology applied to this evaluation should generate the highest quality and most credible evidence to meet the evaluation objectives listed above, and should primarily focus on assessing project activities implemented under the Restoring the Future (REM-II) project. Prior to the start of data collection, the Contractor will develop and present, for HAI review and approval, a written methodology that details the evaluation activities, evaluation tools, and a data analysis plan for this evaluation. The written methodology should be guided by a participatory approach to evaluation, and will be comprised of a mix of quantitative and qualitative tools appropriate to the evaluation questions.

Though the Consultant will be required to develop his/her evaluation methodology in conformity with best practices, HAI expects the Consultant to provide quantitative and qualitative data through the following methods to supplement the evaluation outcomes:

Desk review of Project documents, including (but not limited to):

Project proposal

Project progress/activity reports (monthly, quarterly) from HAI & Partners

Design, Monitoring, Evaluation and Learning (DMEL) Plan

Other materials developed for the Project, including training materials, guides and other published materials

Other existing national and international laws and regulation supporting the relevance of the project

HAI project results framework should be the basic guiding and driving tool of this evaluation. HAI encourages Consultant to use ranking methods to validate the progress against each of the outcomes. Other relevant documents, as deemed appropriate by the consultant, should be reviewed as accordingly.

Data collection with partners, participants, staff and other stakeholders:

Quantitative mini survey of REM participants

Focus group discussions (FGDs)

Community needs and concerns ranking

Key informant interviews (KIIs)

Field observations; if required

In the expression of interest the consultant should express how the adopted methodology and data collection tools will meet the specific objectives of the study.

Stakeholders to be engaged during the Evaluation, including (but not limited to):

Project staff, including Project Manager, Project Coordinator, HAI partners’ staff, and all others directly associated with the Project activities, in IKR/Iraq and HQ as appropriate.

Project implementation partners

Project participants, to the extent feasible and approved by the Project Manager.

HAI will provide support in making available all the relevant and required documentation related to the Project, together with reasonable logistical and administrative support, including coordination with partners, participants and stakeholders.

5.0 Evaluation Deliverables

Evaluation Methodology & Work Plan: A written, draft methodology and work plan for the evaluation will be submitted to HAI for review and approval no later than the 7th day following the signing of this agreement. The methodology and work plan should include the evaluation design, data collection plan, instruments, tools, and an operational work plan, including a timeline. The methodology plan will be discussed with HAI prior to the start of any data collection activities. The Contractor may change the methodology but must submit any changes for approval to HAI prior to implementation.

Evaluation Data: All raw data used in the evaluation analysis should be submitted no later than two weeks after data collection activities are completed. The Contractor will provide data in an electronic file in an easy to read format; organized and fully documented for use by those not familiar with the project or evaluation.

Debriefing presentation with HAI and partner staff: The Contractor will present major accomplishments and findings from the evaluation to HAI and partner staff through PowerPoint presentation after completion of field-based data collection. The debriefing will include a discussion of achievements and issues as well as any recommendations the Contractor has for possible modifications to project approaches, results, or activities. The Contractor will consider HAI project staff comments and revise the evaluation report accordingly, as appropriate.

Draft Evaluation Report: The Contractor will submit a draft report of the findings and recommendations from the evaluation no later than 1st September 2018. Prior approval by the Company will be required should the Contractor want to revise this deadline. The format of the evaluation report should follow the template provided by HAI. The report must be submitted in English, electronically.

Final Report: HAI will provide the Contractor with written comments on the Draft Evaluation Report no later than 15th September 2018. The Contractor will submit a Final Evaluation Report that incorporates HAI’s responses to the Draft Evaluation Report no later than 30th September 2018. The format of the evaluation report should follow the guidelines provided to the Contractor by HAI. The final version of the Final Evaluation Report will be submitted in English, electronically no later than 4th October 2018.

Evaluation Team Composition & Desired Qualifications
The Contractor will receive support from HAI’s project team, as well as HAI’s Monitoring & Evaluation team. The Contractor should possess the following qualifications:

The consultant should have a Masters/advanced degree in a relevant field, (e.g., Human Rights, International Development, Criminal Law, Monitoring and Evaluation etc.);

Minimum five years’ experience in the relevant field (USG working experience preferred);

Prior experience in designing and preparing evaluations of rights/advocacy-based projects (USG funded preferred);

Excellent ability to assess, interpret, analyze and present qualitative and quantitative data;

Excellent writing skills;

Experience working with civil society organizations in conflict and post-conflict countries;

Excellent communication skills, including fluency in written and spoken English required, Arabic and/or Kurdish desirable;

Must be able to travel to within Iraqi Kurdistan;

IKR/Iraq/Middle East regional experience is a plus.

Evaluation Management
HAI will provide overall supervision to the Contractor during contract period. HAI will assist the Contractor with finalizing the evaluation methodology and work plan, and assist in identifying and providing key project documents for the Contractor to review during the contract period. HAI will provide overall logistical support and assistance to the Contractor, as needed and when possible. HAI will provide transportation, translation/interpretation during evaluation activities, etc., as approved in the evaluation work plan. HAI’s project-based staff will be made available to the Contractor for consultations during the evaluation process.

The Contractor is responsible for arranging and completing all evaluation-related activities listed in the approved methodology and work plan, in coordination with HAI’s local project and logistics staff. The Contractor will advise HAI prior to each of those activities. The Contractor will be responsible for completing and submitting to HAI the evaluation products listed in Section 5.0 of this document. The Contractor will be responsible for procuring his/her own work/office space, computers, Internet access, printing, and photocopying throughout the evaluation. The Contractor will be required to make his/her own payments for such services. The Contractor will be responsible for any expenses beyond the fee provided by the Company as determined in this document.

Payment Schedule
1st installment: 30% upon submission and HAI approval of Evaluation Deliverable 1 (evaluation methodology and work plan) and receipt of invoice from the Contractor.
2nd installment: 30% upon submission and HAI approval of Evaluation Deliverable 2 (evaluation data) and Evaluation Deliverable 3 (debriefing presentation with HAI and partner staff) and receipt of invoice from the Contractor.
3rd installment: 40% upon submission and HAI approval of Evaluation Deliverable 4 (draft evaluation report) and Evaluation Deliverable 5 (final report) and receipt of invoice from the Contractor.

9.0 Submission Process

To be considered for this contract, please submit the following to Saali@heartlandalliance.org and bkasundu@heartlandalliance.org.

A letter of interest, indicating how your skills and experience meet the qualifications listed above;

A resume or CV (no more than four pages);

A writing sample of related assignments (no more than three pages);

A draft itemized budget, including consultation fees and all other evaluation-related expenses, including travel, with a maximum amount of $7800 USD.

Incomplete submission packages and submission packages that do not adhere to the page limits stated above will not be considered. Present employees of HAI or HAI’s implementing partners need not apply.