Ex-Post Evaluations > Ex-Post Evaluation: Environmental Services Program (ESP)
The Indonesia Environmental Services Program (ESP) was implemented between 2004 and 2010 under the leadership of Development Alternatives, Inc. (DAI). The program worked with the government, private sector, NGOs, community groups, and other stakeholders to improve the management of water resources and expand access to safe water by strengthening watershed management and delivery of key environmental services, including clean water supply, wastewater collection and treatment, and solid waste management.
What We Did
The sustainability of municipal water utility capacity building efforts is critical to the provision of safe, piped water to urban populations, yet the WASH sector lacks substantial research on the subject. This evaluation helps fill that knowledge gap by examining the sustainability of water utility capacity building, microcredit, and financial outcomes associated ESP. Specifically it looked at:
How We Did It
The evaluation team took a primarily qualitative approach to data collection, conducting 37 semi-structured interviews and 12 focus group discussions with water utility staff, water utility customers, government representatives and participants in ESP’s microcredit program. These interviews were conducted in April 2017.
The team also used data from government-collected water utility performance reports to compare the proportion of a utility’s catchment area population that has a piped connection and the number of household connections between 2010 and 2015. The team updated and applied the water utility performance index tool, which was developed and used annually by ESP to monitor utilities’ management and financial capacity.
What We Learned
Water access improved in most areas since project close, and management tools remain in use, such as standard operating procedures. In comparison to 2010:
Results from this evaluation demonstrate how indicate tools such as standard operating procedures or regular performance benchmarking processes can help sustain continued operational improvements over time.
However, financing for water utilities remains a critical issue to resolve, particularly in Indonesia, where many water utilities amassed tremendous debt to the central government in the 2000s. Understanding this challenge helps inform the design of future water utility capacity building efforts, as well as current programs such as the IUWASH PLUS Program (the second follow-on activity to ESP), which is currently being implemented in Indonesia.
About the Ex-Post Evaluation Series
The USAID Water Office is conducting a series of independent ex-post evaluations of the Agency’s water, sanitation, and hygiene (WASH) activities to inform future USAID investments in the sector and to better understand the long-term impact and sustainability of its interventions several years after projects close.
This evaluation series will help USAID understand whether and how its activity results have been sustained. All activities included in the series must have been closed for a minimum of three years and could not be recipients of Office of U.S. Foreign Disaster Assistance or Food for Peace funding. Preference is given to USAID missions that are at a point in their design cycle to incorporate learnings into upcoming WASH programs.
This evaluation series builds upon USAID and Rotary International’s WASH Sustainability Index Tool, a framework to assess a WASH activity’s likelihood to be sustainable according to the following factors: availability of finance for sanitation; local capacity for construction and maintenance of latrines; the influence of social norms; and governance.