Terms of Reference (ToR) to conduct End-line Evaluation

WaterAid Nepal

WaterAid is an international non-governmental organisation, focused on water, sanitation and hygiene. It was set up in 1981 as a response to the UN International Drinking Water decade (1981–1990). It operates in 34 countries as of 2018 The organization was first established by the UK water industry on 21 July 1981 as a charitable trust at their main office premises…

Terms of Reference (ToR) to conduct End-line Evaluation

Terms of Reference (ToR) to conduct End-line Evaluation of “Water Security and Climate Resilient WASH” project in Dolakha district

First date of publication: 6 July 2022 and End date: 12th July 2022.

Name of Project“Water Security and Climate Resilient WASH
Project LocationDolakha District
Project start date1st August 2018
Project end date30th September 2022
Implementing partnerCommunity Development Forum (CDF)

1. About WaterAid Nepal

WaterAid Nepal (WAN) was established in 1987 during UN Water and Sanitation Decade, 1981-1990. WAN has a particularly strong track record in supporting local partners for service delivery.  It pioneered the service delivery role of NGOs in the sector and lately has placed an increased emphasis on learning, advocacy and influencing the sector. WAN is continuously working in Water, Sanitation and Hygiene (WASH) which are basic building blocks of public health.

2. Background

The project “Water Security and Climate Resilient WASH” is being implemented in Shailung and Kalinchowk rural municipality of Dolakha district from 1st August 2018 to 30th September 2022. It has aimed to ensure water security for vulnerable and marginalised people through functional water supply schemes and equitable access to WASH facilities in communities and schools of two rural municipalities. Further, it aims to empower communities to better understand and exercise their rights, roles, and responsibilities in relation to WASH and strengthen the capacity of the municipal government to better deliver WASH services to their citizens as mandated by Nepal’s constitution. 

The project is underpinned by WaterAid Nepal’s programmatic approach, with ‘water security’ as an overarching theme and led by Recovery and Resilient WASH flagship programme but integrating elements of the organisation’s other three programmes: Reaching the Unreached, Hygiene and Sector Effectiveness. WaterAid’s Programmatic Approach enables us to influence systemic change through joined-up programmatic work that links practical interventions on the ground with capacity building, learning, influencing and advocacy at local, subnational, national and international levels.

The project outcomes are as follows:

  • Vulnerable and marginalised people are served with equitable access to safely managed water services at the household, community, and school levels. 
  • People in targeted communities and schools have access to basic sanitation facilities and are practicing good hygiene behaviours (including MHM)
  • Local government has enhanced capacity and takes action to ensure rights to WASH services (RTWS) and resilient WASH services for targeted communities

Community Development Forum (CDF) Dolakha is an implementing partner organization who has been working to deliver the project interventions with financial and technical support from WaterAid Nepal. 

WaterAid’s Global Evaluation Policy defines an evaluation as an assessment of an on-going or completed project, country programme or strategy, its design, implementation, and results. This evaluation will be the evaluation of project on its design, implementation, and results. WaterAid Nepal (WAN) intends to conduct an independent end-line evaluation to assess results, contextual relevance, quality, value for money, transformative change and sustainability of the project. 

This Terms of Reference (ToR) is developed to solicit consultancy service from a consultancy firm to undertake the End line evaluation. 

3. Scope and criteria

This evaluation will encompass the entire period of the project. The evaluation will consider minimum criteria and standards from WaterAid’s Global Evaluation Policy, ver. 10 July 2018. Within minimum criteria, the project is to assess based on below criteria. 

a) Contextual relevance assesses the appropriateness of the intervention design and approach in addressing the identified problems, considering the implementation context, adaptability in the context of Covid-19 pandemic and reaching the interventions to the marginalized people. 

b) Results measures the extent to which an intervention has achieved or is likely to achieve its intended, immediate results, i.e. the outputs (efficiency) and outcomes (effectiveness) against results framework (see at the end of ToR). It includes identification of major reasons for achievement or nonachievement of results, and key lessons to inform further implementation or future interventions. 

c) Quality assesses the extent to which the intervention meets WaterAid’s Quality Programme Standards and minimum WASH resilience characteristics. 

d) Transformative change and sustainability assess the potential for, or contribution and progress made in, achieving lasting solutions and behaviour changes through assessing the (a) catalytic effect, (b) scalability and (c) sustainability of interventions. More focussed on sustainability and the extent to which the net benefits of the intervention continue or are likely to continue.

4. Methodology and approaches

The evaluation will use mixed method approach. Both quantitative and qualitative approaches will be used. Document review, household survey, key information interviews, focus group discussions followed by observations and collection of case studies. 

Evaluation Study Area

The evaluation will be conducted in two Rural Municipalities (RM) of Dolakha district. All 17 wards (9 wards of Kalinchowk and 8 wards of Sailung) of both RM will be visited to collect the evaluation data. Diverse communities will be identified for inclusive representation of all community of geography in consultation with key stakeholders especially Chairperson, Chief Executive Officer (CAO), Ward Chairpersons, Ward Members, Teachers, Female Community Health Volunteer and Non-Governmental Organization members. 

Sampling and Sampling procedure

Baseline of the project used 750 sample, 375 for each municipality. The evaluation will follow the same number of sample size. The sample will be proportionately distributed to each ward in both municipalities. Stratified cluster random sampling will be applied to identified households. However, the minimum sample in the smallest strata will not be less than 19 households to represent enumeration or supervision area. All the schools will be surveyed. 

5. Roles and responsibilities 

The evaluation will be completed with joint responsibility of WaterAid Nepal, partner NGO and consultant. All parties will have separate roles and responsibilities. 

Responsibilities of Consultant 

  • Establish inclusive research team from technical and social backgrounds
  • Prepare inception report, final tools, translation of tools and study plan of action 
  • Train and equipped evaluation team, collect formal consent from RM 
  • Meeting with partner NGOs and R/Ms representatives  
  • Mobilization and monitoring team while undertaking data collection process
  • Data presentation and analysis as per project results framework and baseline 
  • Prepare draft report in agreed time and ask for feedbacks/inputs,
  • Finalize and submit the report incorporating comments from WaterAid Nepal 

Responsibilities of WaterAid Nepal

  • Share relevant documents such as project plan and report, baseline report and other study and learning documents 
  • Support for the finalization of methodology and tools, 
  • Provide information of partner NGOs and study areas, and support to establish linkages
  • Provide timely inputs and comments on draft reports 

Responsibilities of partners 

  • Support providing field level social, political, geographical information 
  • Support coordination and communication with surveyors’ team and enumerators and R/Ms

6. Ethics and risks

This review must comply with WaterAid’s Global Evaluation Policy, which sets out our ethical considerations when conducting reviews. Additionally, the consultant/s must follow all WaterAid’s other policies relevant to this work as included in our consultancy contracts. The evaluation report may share externally. The consultancy team should carefully consider any implications this may have for the methodology including the proposed data and information collection methods.

7. Outputs and timeline

Evaluation outputs: 

  1. Inception Report consisting clear plan of action with complete tools and methodology
  2. The End-line Evaluation report addressing the evaluation objectives with clear and actionable recommendations. (Page limit max. 40 pages, excluding annexes) 
  3. At least 3 case studies that best highlight critical learning, innovative and/or replicable approaches, stories of change or key contributions from the project. The case studies should be collected from field visits but can refer to project stories to elaborate them.  
  4. Presentation of findings and recommendations. The consultancy team will present the report to WaterAid Nepal Office. 
  5. Complete synchronization of data on digital portal with correct images and correct GPS locations,

The consultant must accomplish the assignment within two months from the date of signing contract. 

  • First month: Inception Report, Training, Data Collection and real time data quality assurance,
  • Second month: Data Analysis, Draft report presentation and Report finalization.

Consultants should propose a more detailed timeframe and work plan based on the structure of the team. 

8. Estimated Budget 

Applicant consultant should propose estimated budget which will be mutually agreed with the successful firm. Consultant should submit separate financial proposal with budget breakdown. 

9. Reporting Line 

The consultant will report to WaterAid Nepal’s focal person as stated in the contract. 

10. Evaluation team and qualification

Consultant should propose separate team for the evaluation. 

Team composition for evaluation: A team leader or evaluation expert, data expert, WASH resilience expert, study coordinator/supervisor 2, and data collectors. All experts should be at least master’s degree on relevant educational background and should have experience of evaluation of similar projects in similar context. Consultants are requested to provide brief CV/resume (not exceeding 3 pages) of each expert and inclusive team. 

11. Terms and Conditions

WaterAid reserves the right to accept & reject any proposal without giving any verbal and /or written rationale. WaterAid will deduct Tax and VAT at source according to the government policy. Delay and untimely deliverables and poor-quality deliverables will effect on contract amount payment. The objective of the consultant/firm should be in line with the assignment. 

12. Selection Criteria

There will be technical and financial criteria for the assessment of the proposal. The proposal assessment criteria or bases will be as follows: 

  • All the minimum required documents (Company Registration, VAT certificate, Tax clearance 2077/78. 
  • Clear proposal and quality, sequence, writing of the technical proposal as per ToR 
  • Clarity of Methodology and tools in the proposal
  • Team Composition: relevant qualification and experience of proposed key personnel.  Inclusive social and technical team. 
  • Sharing list of evidence/reports of similar works 

We accept only online proposal through below email with the subject line mentioning “EOI for Evaluation of Water Security and Climate Resilient WASH Project” by 12th July 2022

Result Framework: Water Security and Climate Resilient WASH

WaterAid Nepal

JM Road 10, Pabitra Tole

Nakhipot- 14, Lalitpur

Phone: +977 1 5230210/5230864/5230365

P.O. Box: 20214

Email: nepal-procurement@wateraid.org