Impact Evaluation of PNPM Generasi Program 2008-2009
PNPM Generasi known as the National Community Empowerment Program - Healthy and Smart Generation (Program National Pemberdayaan Masyarakat-Generasi Sehat dan Cerdas) began in mid-2007 in rural areas of five Indonesian provinces selected by the government: West Java, East Java, North Sulawesi, Gorontalo, and Nusa Tenggara Timur. The Generasi project is implemented by Indonesia’s Ministry of Home Affairs, and is funded through government of Indonesia resources, loans from the World Bank and grants from several bilateral donors.
In Generasi, all participating villages receive a block grant each year to improve education, and maternal and child health in their villages. The village block grants ranged from an average of $8,500 in 2007 up to an average of $18,200 in 2009.
In order to evaluate the overall impact of Generasi, as well as to separately identify the impact of Generasi's performance incentives, program locations were selected by lottery to form a randomized, controlled field experiment. Each location was randomly allocated to one of two versions of the program: an "incentivized" treatment with the pay-for-performance component (treatment A) and an otherwise identical "non-incentivized" treatment without the pay-for-performance incentives (treatment B).
The impact evaluation project was conducted from 2007 until 2010, in three waves. Documented here is the second round, carried out from October 2008 to January 2009.
The sample for the research covered each of the 300 subdistricts that were included in the original Generasi randomization. In each subdistrict, eight villages were randomly selected (unless the subdistrict had fewer than eight villages, in which case all were selected). Overall, 2,313 villages were sampled in each of the three survey waves.
The data for the impact analysis was gathered from surveys of households, mothers, health service providers, and school and village officials.
Kind of data
Sample survey data [ssd]
Edited, anonymized datasets
West Java, East Java, North Sulawesi, Gorontalo, and Nusa Tenggara Timur provinces
Unit of analysis
- Married women, age 16-49,
- Children age 6-15, respondent: mother of the child,
- Children age < 3, respondent: mother of the child,
- Community health centers (Puskesmas),
- Village midwives,
- Village health posts,
- Junior secondary schools.
Producers and sponsors
Ministry of Home Affairs
Government of Indonesia
Spanish Impact Evaluation Fund, World Bank
Government of Indonesia
In order to evaluate the overall impact of Generasi, as well as to separately identify the impact of Generasi's performance incentives, Generasi locations were selected by lottery to form a randomized, controlled field experiment.
The Generasi randomization was conducted at the subdistrict (kecamatan) level, so that all villages within the subdistrict either received the same treatment of Generasi (treatment A or treatment B) or were in the control group. Randomizing at the subdistrict level is important since many health and education services, such as community health centers (puskesmas) and junior secondary schools, provide services to multiple villages within a subdistrict.
The Generasi locations were selected through the following procedure. First, 300 target subdistricts were identified, targeting poor, rural areas that had an existing community-driven development infrastructure.
Each subdistrict was then randomly assigned by computer into one of three equal-sized groups: treatment A, incentivized (100 subdistricts); treatment B, non-incentivized (100 subdistricts); or control (100 subdistricts). Within a subdistrict, all villages received the same treatment. The randomization was stratified by district (kabupaten), to ensure a balanced randomization across the 20 different districts in the study.
The sampling design for the household component of the Generasi surveys was chosen to ensure adequate coverage in the key Generasi demographic groups: mothers who recently were pregnant or gave birth, children under age three, and children of school age. Within each village, one hamlet (dusun) was randomly selected, and a list of all households was obtained from the head of the hamlet. Five households were randomly sampled from that list to be interviewed. These households were stratified so that two selected households had at least one child under age two, two selected households had a child under age 15 but no children under age two, and one household had no children under age 15.
Dates of collection
Mode of data collection
University of Gadjah Mada
Use of the dataset must be acknowledged using a citation which would include:
- the identification of the primary investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download.
Susan Wong, World Bank; Junko Onishi, World Bank; Ben Olken, Massachusetts Institute of Technology; Ministry of Home Affairs, Government of Indonesia. Indonesia - Impact Evaluation of PNPM Generasi Program (PNPM) 2008-2009, Second Wave. Ref. IDN_2008_PNPM_v01_M_v01_A_PUF. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Development Data Group
Generation of DDI documentation
First version of metadata documentation (July 2012)