TERMS OF REFERENCE (TOR)

1. Introduction/Background

District Umerkot, located in the southeastern part of Sindh province, Pakistan, faces long-standing challenges related to poverty, social inequality, and limited access to basic services. The district has a population of over 1.07 million (Census 2017), with overall literacy at 40 percent and female literacy only 20 percent. Livelihoods are largely dependent on agriculture and livestock, with irrigated farming in the western parts and rain-fed, drought-prone areas in the east, particularly in Kunri subdistrict. Land distribution is highly unequal, with landless agricultural workers (haris) living under dependency and intergenerational debt. Women bear additional burdens through household work, water collection, childcare, and agricultural labor, often facing protection risks and limited rights.

The district has experienced recurring droughts since 2013, causing declining water availability, agricultural productivity, and increasing food insecurity. Prior to 2022, the food security situation in Kunri was classified as IPC Phase III (Crisis). This was further exacerbated by the 2022 floods, which caused widespread destruction of housing, infrastructure, farmland, and livestock, pushing Umerkot into IPC Phase IV (Emergency).

In response to these challenges, Pak Mission Society, with support from Federal Ministry for Economic Cooperation and Development and Humedica International implemented the project “Enhancing Resilience through Disaster Risk Management, Hygiene, and Drinking Water Supply in Umerkot, Sindh” (Project No. 4416) from December 2019 to October 2022. Project 4416 targeted 60 villages in Kunri subdistrict, aiming to strengthen resilience of vulnerable small tenant farmers and landless laborers through improved disaster preparedness, access to safe drinking water, better hygiene practices, and support for livelihoods and food security.

Building on the achievements and lessons learned from Project 4416, a follow-up project “Strengthening resilience of vulnerable rural groups in Umerkot, through income generation, adapted methods of farming, and WaSH” was designed to expand similar interventions with additional components in 30 more villages in Kunri subdistrict. Village selection prioritized communities with basic infrastructure still intact and that were less severely affected by the 2022 floods, ensuring feasibility and a focus on recovery. The follow-up project represents a continuation of the objectives of the project 4416, while adapting to the changed context created by the floods and increasing water scarcity.

Project 4416 achieved notable results that provided a foundation for the follow-up project. Access to drinking water significantly improved through provision hand pumps, water reservoirs, and locally adapted water filtration systems. Hygiene awareness regarding the hazards of open defecation among target communities has been reported to be increased, leading to widespread construction of household latrines. Community-based savings and credit groups enabled small-scale income generation, and disaster preparedness capacities were strengthened through first aid training and improved coordination between communities and authorities. Preliminary evaluations also highlighted areas for improvement, including smaller and more frequent training sessions, stronger post-training follow-up, greater involvement of government stakeholders, and enhanced integration of technical expertise in microfinance and savings groups.

The 2022 floods significantly impacted on the context. Approximately 59 percent of houses in the target villages were partially or fully destroyed. Infrastructure, including 330 km of roads, was heavily damaged, 340 hectares of farmland were flooded, standing crops were lost, and over 400 livestock died. Damage to project infrastructure included four out of eight water reservoirs and 18 out of 60 hand pumps. Households lost livelihoods, increasing debt and vulnerability, while waterborne and skin diseases became more widespread. These changes highlight the need to reassess the relevance, effectiveness, and sustainability of interventions under the current conditions.

The final evaluation is therefore essential to provide an independent assessment of the follow-up project. It will examine the achievements in light of project objectives and impact frameworks, assess the sustainability of results, and generate lessons learned for future programming. The evaluation is closely linked to the findings of Project 4416, as well as the evolving needs of the communities affected by floods, ongoing water scarcity, and socio-economic vulnerabilities.

Description of the Project

Humedica and Pak Mission Society initiated a three-year project titled, “Strengthening Resilience of Vulnerable Rural Groups in Umerkot through Income Generation, Adapted Farming Methods, and WaSH”. The project serves 90 rural communities in Taluka Kunri, Umerkot District, including 60 villages from a previous project (project no. 4416), and 30 new villages. Funded by the German Federal Ministry for Economic Cooperation and Development (BMZ) and Humedica International, the project runs from January 2023 to December 2025, with a No-Cost Extension (NCE) through June 30, 2026.

During project implementation, an amendment was approved with the consent of the donor to utilize savings generated mainly through exchange rate gains. These savings were reallocated within the project budget to increase the targets of selected ongoing activities in line with emerging needs in the target communities. The revision was made to enhance project reach and improve the efficiency of resource utilization without changing the overall objectives, geographic scope, or intervention logic of the project. The evaluation is expected to take these approved adjustments into account when assessing achievement against targets, performance against indicators, and overall efficiency and effectiveness of project implementation.

The project is designed to strengthen the resilience of highly vulnerable rural communities in Kunri Taluka of Umerkot District, Sindh, which are repeatedly affected by floods, drought, water scarcity and climate-related shocks.  The project builds on an earlier intervention implemented in 60 villages, also funded by BMZ and humedica, expanding support to 30 additional high-need villages, while also restoring and reinforcing assets and livelihoods in previously supported communities that were severely damaged by recent floods.

The target population mainly consists of marginalized Hindu households, predominantly landless agricultural laborers and small tenant farmers living under long-standing poverty, debt dependency and social exclusion. In total, about 28,756people across 90 villages are covered under the project.

The project follows an integrated approach combining safe water and sanitation, disaster risk reduction and climate adaptation, and livelihood and food security interventions, with a strong emphasis on community institutions, women’s participation, and linkages with local government systems to ensure sustainable and locally owned resilience outcomes.

The project interventions included the formation and strengthening of Village Development Committees (VDCs) and community-level disaster management structures, supported through structured trainings, participatory planning exercises, coordination meetings, and provision of basic emergency response equipment. The project placed strong emphasis on disaster risk reduction and preparedness through hazard, capacity and vulnerability assessments, development of village disaster management plans, establishment of early warning systems, and first aid training conducted in both communities and schools. Community Emergency Response Teams (CERTs) were formed and trained to enhance local first response capacity, while additional capacity building of DRR forums and coordination platforms at district and community level helped strengthen overall preparedness and response mechanisms.

The project also promoted improved and climate-adapted agricultural and livelihood practices through kitchen gardening training and provision of kitchen gardening kits to support household food production. Support was also provided in the form of seeds, fertilizers, and fruit plants and shrubs to enhance household-level agriculture and nutrition. Livelihood diversification was strengthened through the formation and capacity building of self-help groups (SHGs), along with training on micro-business development and internal lending mechanisms to support community-based financial support systems. In addition, the project supported livestock-based livelihoods through the provision of goats to vulnerable households and training of community-based livestock extension workers, along with livestock vaccination campaigns to improve animal health. A model farm and farmer field school approach was also introduced to demonstrate improved agricultural and livestock practices. These interventions were further supported by a pilot solar-powered tube well to enhance water access for productive use and strengthen resilience against water scarcity.

Furthermore, the project included rehabilitation and improvement of water access and sanitation-related infrastructure through construction of water ponds, installation and rehabilitation of hand pumps, provision of Nadi filters, hygiene promotion sessions, and Community-Led Total Sanitation (CLTS) activities. Support was also extended to the construction and rehabilitation of WASH facilities in schools and health institutions to improve basic service delivery at community level.

Project outcome and outputs to be achieved are:

Project Outcome:

90 village communities in Kunri sub-district are more resilient to disaster events and have achieved significant improvement in their livelihoods and health situation.

Indicators of outcome:

• · At the end of the project, 70% of community members surveyed (approximately 360 households) from the 15 of 30 newly adopted villages report that they feel more secure to cope with disaster risks and could name at least two local disaster protection measures.
• · 90% of all disaster preparedness committees have contacts with sub-district and district disaster management authorities.
• · By the end of the project, 90 % of the targeted community members from 30 new communities shared that they have access to safe drinking water through wells with hand pumps, each of which has a functioning maintenance committee and 80 % of users regularly pay their user fees to maintain.
• · 70% of residents surveyed (approximately 360 households in 15 villages) have reduced their spending on treatment for water-related illnesses (diarrhea) by at least 20%, compared to the baseline study figures at the start of the project.
• · 75 interviewed members of the population of 47 villages severely affected by flooding reported that they (again) have access to drinking water of good quality and sufficient quantity from wells, water reservoirs and water filters.
• · 60% of craft training participants surveyed (100 out of 200 people) report generating 15% more income from craft skills taught to them by the project.
• · The surveyed members of the target population of 30 target villages who participated in agricultural trainings (100 out of 300 expected participants) reported a yield increase of at least 20% on average compared to the level at the beginning of the project as determined by the Base Line Study.
• · 75 surveyed beneficiaries of the target population in flood-damaged target villages report that their nutritional status has reached 95% of pre-flood levels.

Project Outputs

2. Purpose, Objectives and Use

The purpose of this evaluation is to provide an independent assessment against the indicators set the in approved logframe of the project of the follow-up project in Kunri subdistrict, building on the achievements and lessons of Project 4416. The evaluation will assess the project performance against OECD/DAC evaluation criteria that include relevance, efficiency, effectiveness, coherence, impact and sustainability. In particular, it will examine the social and economic viability of the structures, systems, and community-based organizations established under the project, including water infrastructure, hygiene facilities, and savings/credit groups.

The evaluation will focus on the following objectives:

• · To evaluate the project performance against the OECD/DAC criteria such as effectiveness, relevance, efficiency, impact and sustainability, with a priority on assessing the project expected results and outcomes.
• · To assess the project performance against the logframe indicators.
• · To identify key lessons and potential practices for learning.
• · To assess the challenges, best practices and document the outcome for future processes.
• · Recommendations for similar future interventions as well as for new interventions in the targeted areas.

The evaluation results are intended for multiple users, including project management and implementing partners, who will use the findings to refine ongoing and future interventions, particularly in areas affected by floods and water scarcity, and to strengthen the sustainability of community-based structures. Donors and funding agencies will benefit from evidence of project performance, impact, and cost-effectiveness, which will support accountability and inform future funding decisions. Government authorities and local institutions can utilize the findings to guide policy planning, disaster preparedness, water management, and broader community development initiatives in the district. Finally, the target communities themselves will benefit from lessons learned that are translated into practical recommendations, helping to improve living conditions, livelihoods, and resilience.

The evaluation will consider initiatives and projects with similar objectives implemented in comparable settings, particularly the preceding project, Project 4416, carried out in the same area. Findings from previous evaluation and surveys and midterm evaluation of the current project conducted in 2025, will be used to assess how past lessons have informed the design and implementation of the current project and to identify areas for improvement. Special attention will be given to the project’s ability to adapt to newly emerging needs in a disaster context, specifically the large-scale floods of 2022. The results will support Humedica and the local partner Pak Mission Society in evaluating the project’s achievements, sustainability, and prospects, and in identifying conditions and strategies for successful continuation or alternative approaches in future interventions.

3. Scope of Work

The scope of the evaluation shall encompass:

• · The achievements of the project against the set objectives, on outcome level
• · The status of the project against the work plan, on output level and activities level
• · The conceptual set up of the project, its feasibility and prospects of success
• · Vital lessons learned and best practices for future strategies and interventions
• · Recommendations for improving programme implementation and enhancing impact for any future interventions
• · The effectiveness of partnerships and coordination mechanisms.

3.1 EVALUATION QUESTIONS

The evaluation should, to the greatest extent possible, provide clear and evidence-based responses to the following research questions:

Relevance

• · Has the project been planned in a way that enables the assessment of achievements, including the clarity and consistency of the project logic and indicators, and how effectively any approved amendments during implementation have been reflected in the results framework?
• · Are the planned activities conducive to the achievement of outputs and outcomes?
• · Are assumptions and risks sufficiently pertinent?
• · To what extent is the project approach conducive to meaningful improvements of the target group’s situation?
• · To what extent did cultural norms have an influence on the project; to what extent was the project able to make use of them, and to minimize their negative influence?
• · To what extent can the project liaise with successful similar initiatives?

Efficiency

• · How well did the Programme complement other interventions in the area, including those by local government, other NGOs, and UN agencies?
• · How did the project deal with security concerns?

Effectiveness

• · Are the project’s achievements consistent with the project’s objectives (outcome and goal)? How has the project performed on impact level and output level?
• · To what extent did the project contribute to overcome the consequences of the large-scale floods of 2022?
• · How was access to marginalized groups ascertained, especially of women?

Impact

• · To what extent did the project contribute to overcome the consequences of the large-scale floods of 2022?
• · To what extent did the project foster or impede social cohesion in target communities?
• · What are the intended and unintended consequences as a result of the project activities?
• · Are there any significant changes in the context as a result of the project interventions?

Sustainability

• · What signs and mechanisms are in place to indicate that the benefits generated by the Programme will continue after external support ends?
• · What are the key factors/areas that will require additional support/attention to improve sustainability and replication potential?

Coherence

• · How well did the Programme complement other interventions in the area, including those by local government, other NGOs, and UN agencies?
• · To what extent can the project liaise with successful similar initiatives?

Cross-Cutting / Humanitarian Principles / Additional Evaluation Themes

• · To what extent were impartiality and neutrality achieved? Which challenges in this respect were addressed and how? How did the project deal with outside attempts to exert influence on the project?
• · How did the project deal with security concerns?
• · How was access to marginalized groups ascertained, especially of women?
• · To what extent did cultural norms have an influence on the project?

4. Timeframe

The estimated level of efforts is 25 – 30 consultancy days and should be carried out between May and June 2026.

5. Deliverables

The following outputs are expected by the end of the consultancy;

1. Inception Report detailing consultancy work-plan and proposed processes

2. Draft evaluation report

3. Data and analysis sheets

4. Final endorsed report incorporating comments from Humedica headquarters and PMS. The final report must include, but not necessarily be limited to up to 25 pages and have elements outlined in the quality criteria for evaluation reports.  The report however can have several annexes (as required by the Consultant or the Consulting Team)

5. Provide a Final report Soft PDF copy (in English).

6. Methodology  

The proposed methodology for the endline/final evaluation will combine qualitative and quantitative data collection and evaluation techniques. The methodology will be developed by the consultant, as well as all relevant tools and presented in the inception report. The data collection should include the use of a number of approaches to gain a deeper understanding of the outcomes of the project, including:

• · Desk-base review (all relevant documents, including project statistics, project documents, progress reports as well as publicly available relevant documents.)
• · Survey (In-depth Interviews)
• · Focus Group Discussions
• · Key Informant Interviews

7. Selection Criteria/Desired Competencies, Technical Background, and Experience

The Evaluator shall have the following expertise and qualifications:

• · At least a Master’s degree in Social Sciences/Management Sciences including Public Policy, International Development, Development Economics/Planning, Economics, International Relations/Diplomacy, or any other relevant field.
• · Demonstrated expertise, knowledge, and experience in monitoring and evaluation of humanitarian and development programmes/projects (with evidence of at least leading at least 2 external/third-party evaluations).
• · Sound knowledge and practical experience in humanitarian/development planning and implementation, especially in fields pertaining to this project (WASH, DRR, rehabilitation, rural development)
• · Experience of project formulation and evaluation and practical experience of end of project evaluation in Sindh or in similar context.
• · At least 10 years of experience in working in the senior leadership role with international organizations/national organizations.
• · Strong background in qualitative and quantitative evaluation methodologies, including data collection, analysis, and reporting.
• · Past experience in conducting surveys, especially evaluations of German Donors funded projects. (Optional)
• · Excellent written and verbal communication skills in English
• · Past experience of working in the region will be an asset.

Offers will be evaluated on these criteria as well as the quality of the technical offer (proposed methodology, capacity to mobilize qualified personnel in the field, etc.) and the soundness of the financial offer.

8. Evaluation Criteria

The following are the evaluation criteria for the consultant/firm:

• · Note: The applicant must adhere to ethical research/evaluations standards, ensuring:
• · Informed Consent: Participants are fully informed about the purpose of the research and consent to participate.
• · Confidentiality: Personal information of participants is protected.
• · Do No Harm: The research study does not adversely affect participants or communities.

9. Management and Logistics                                                      

The Lead Consultant report to MEAL department who will not have control over the professional work of the evaluators. The Project Manager along with MEAL office will provide technical guidance (guidance to reach targeted villages, stakeholders and key informants) for the evaluation to ensure the independence of the evaluation process. Logistical arrangements will not be provided by the PMS and is included in their (consultants’) budget.

10. Technical Proposal

• · Company profile including the proof of relevant experiences
• · Up to date CV of the lead consultant/evaluator and team (showing education and expertise).
• · Technical proposition detailing proposed evaluation design, methodology including evaluation framework, sampling and data collection methodology and resources needed.
• · An example of a report from similar work which demonstrates evidence of the skills and experience required and a list of past evaluation produced by the lead consultant/evaluator.

11. Financial Proposal

• · Proposed financial offer with a complete breakdown of activities.
• · The financial proposal must be submitted in PKR inclusive of all applicable taxes.
• · A list of all expenses expected to be incurred by the consultant including a daily rate.
• · The Consultant/Firm must be legally registered with the Federal Board of Revenue (FBR).

12. Payment Terms

All payments will be made through banking channels (cross-cheque). The disbursement schedule, including the amount and timeline, will be outlined in the agreement. Payments will be subject to the successful completion of agreed-upon deliverables and compliance with contractual obligations and submission of final report and database. Any applicable taxes or deductions will be as per prevailing government regulations.

13. How to Apply

Interested, qualified and experienced person, group of persons or firms must submit an Expression of Interest dossier by 1^st June 2026 till 5:00 pm, in a sealed envelope, outlining availability in line with the approximate timeline. The cover letter should be addressed to:

Pak Mission Society (PMS), Operations department, House no 333, Street no 29, G-14/4 Islamabad.

Online Submission (Compulsory): Also send a scanned digital file of technical proposal only in the form of an email* sent to the dedicated email address: [email protected] 

The expression of interest should contain: (a) a technical offer and (b) a financial offer.