WSP Global Scaling Up Rural Sanitation Access (TSSM) Impact Evaluation, Madhya Pradesh State, Baseline and Endline Surveys 2009-2011
India, 2009 - 2011
Get Microdata
Reference ID
IND_2009_WSPIE_v01_M_v01_A_PUF
Producer(s)
Water and Sanitation Program, Network for Engineering and Economics Research and Management
Collection(s)
Metadata
Created on
Jul 24, 2014
Last modified
May 11, 2015
Page views
177765
Downloads
19500
Identification
Survey ID Number
IND_2009_WSPIE_v01_M_v01_A_PUF
Title
WSP Global Scaling Up Rural Sanitation Access (TSSM) Impact Evaluation, Madhya Pradesh State, Baseline and Endline Surveys 2009-2011
Country/Economy
| Name | Country code |
|---|---|
| India | IND |
Study type
Other Household Health Survey [hh/hea]
Series Information
In response to the preventable threats posed by poor sanitation and hygiene, in December 2006 the Water and Sanitation Program (WSP) launched two related large-scale projects, Global Scaling Up Handwashing and Global Scaling Up Rural Sanitation. These hygiene and sanitation interventions are designed to improve the health and welfare outcomes for millions of poor people. Local and national governments are implementing these projects with technical support from WSP.
The goal of Global Scaling Up Rural Sanitation is to reduce the risk of diarrhea and therefore increase household productivity by stimulating demand for sanitation in the lives of people in India, Indonesia, and Tanzania. The project approach demands involvement from communities, local government, and the private sector. It aims to trigger the desire for an open-defecation free community by raising collective awareness of the open defecation problem. Facilitators are sent to communities to initiate participatory analysis of the communities' existing sanitation practices, and the consequences and implications of such practices for themselves. This process is designed to catalyze collective community desire and action to become Open Defecation Free (ODF). The community must forge their own plan for making this happen with only limited follow-up support and monitoring from the program. Communities claiming to have become ODF are verified by local government agencies. ODF achievement by a community brings recognition and commendation from local and provincial governments. The project also seeks to stimulate the supply of appropriate sanitation products and services by conducting market research and training local artisans to build the relevant facilities.
To measure the magnitudes of the impacts, the project is implementing randomized-controlled trial impact evaluations (IE) study in order to establish causal linkages between the intervention (treatment) and the outcomes of interest. The IE uses household surveys to measure the levels of key outcomes.
The goal of Global Scaling Up Rural Sanitation is to reduce the risk of diarrhea and therefore increase household productivity by stimulating demand for sanitation in the lives of people in India, Indonesia, and Tanzania. The project approach demands involvement from communities, local government, and the private sector. It aims to trigger the desire for an open-defecation free community by raising collective awareness of the open defecation problem. Facilitators are sent to communities to initiate participatory analysis of the communities' existing sanitation practices, and the consequences and implications of such practices for themselves. This process is designed to catalyze collective community desire and action to become Open Defecation Free (ODF). The community must forge their own plan for making this happen with only limited follow-up support and monitoring from the program. Communities claiming to have become ODF are verified by local government agencies. ODF achievement by a community brings recognition and commendation from local and provincial governments. The project also seeks to stimulate the supply of appropriate sanitation products and services by conducting market research and training local artisans to build the relevant facilities.
To measure the magnitudes of the impacts, the project is implementing randomized-controlled trial impact evaluations (IE) study in order to establish causal linkages between the intervention (treatment) and the outcomes of interest. The IE uses household surveys to measure the levels of key outcomes.
Abstract
In India, WSP's Global Scaling Up Rural Sanitation Program is supporting the Government of India's Total Sanitation Campaign (TSC) in two states: Himachal Pradesh and Madhya Pradesh. TSC is an ambitious countrywide, scaled-up rural sanitation program launched in 1999, which seeks to attain an Open-Defecation Free (ODF) India by 2012. In contrast to earlier, hardware-centric supply approaches to rural sanitation, TSC aims to generate demand for and adoption of improved sanitation at the community level.
This impact evaluation aimed at better understanding what health and welfare impacts can be expected from rural sanitation improvements. Researchers hypothesized that promotion of rural sanitation through community-led total sanitation (CLTS) and social marketing campaigns will improve the health of the population especially children under five years old, a population that is vulnerable to unsafe disposal of feces in the environment and fecal-oral contamination.
This impact evaluation consisted of baseline and endline surveys. In collaboration with the government of Madhya Pradesh, two districts - Dhar and Khargone - were selected. In each district, 80 Gram Panchayats were chosen and randomized into two groups: 1) treatment group (to participate in Total Sanitation Campaign immediately following the baseline survey) and 2) control group (to receive TSC after follow-up data collection).
The baseline survey collected information from a representative sample of the population targeted by the intervention. This baseline survey was administered to approximately 2,000 households between June and July 2009. The survey provided information on the characteristics of household members, access to sanitation facilities, self-reported open defecation, prevalence of child diseases such as diarrhea and respiratory infection, and child growth and development.
The endline survey was carried out in February-March 2011. It followed the same households sampled in baseline, as well as additional children to increase statistical power.
This impact evaluation aimed at better understanding what health and welfare impacts can be expected from rural sanitation improvements. Researchers hypothesized that promotion of rural sanitation through community-led total sanitation (CLTS) and social marketing campaigns will improve the health of the population especially children under five years old, a population that is vulnerable to unsafe disposal of feces in the environment and fecal-oral contamination.
This impact evaluation consisted of baseline and endline surveys. In collaboration with the government of Madhya Pradesh, two districts - Dhar and Khargone - were selected. In each district, 80 Gram Panchayats were chosen and randomized into two groups: 1) treatment group (to participate in Total Sanitation Campaign immediately following the baseline survey) and 2) control group (to receive TSC after follow-up data collection).
The baseline survey collected information from a representative sample of the population targeted by the intervention. This baseline survey was administered to approximately 2,000 households between June and July 2009. The survey provided information on the characteristics of household members, access to sanitation facilities, self-reported open defecation, prevalence of child diseases such as diarrhea and respiratory infection, and child growth and development.
The endline survey was carried out in February-March 2011. It followed the same households sampled in baseline, as well as additional children to increase statistical power.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
- Household
- Person
- Caregiver
- Child (under 5 and under 2)
- Person
- Caregiver
- Child (under 5 and under 2)
Version
Version Description
Version 01 - edited, anonymized datasets for public distribution. The public version does not include addresses and telephone numbers, names of respondents, supervisors and coders.
The datasets include information from baseline and endline surveys.
The datasets include information from baseline and endline surveys.
Scope
Notes
Household:
- Geographic Identification/Location and Administrative/Supervision Information
- Household Roster
- Dwelling Characteristics
- Drinking Water Sources
- Drinking Water Storage and Treatment
- Sanitation Facilities
- Program Exposure
- Knowledge and Access to Toilet technology
- Education
- Labor (for members 15 years and above)
- Household Income
- Assets
- Mortality
Observation of household:
- Observations of Dwelling Characteristics
- Observations of Food Storage
- Observations of Handwashing Facilities
- Observations of Toilet Facility
- Observations of Animals and Feces
Primary caregiver:
- Perceptions of Illness (each primary caregiver of children under 5)
- Child Health Calendar (each primary caregiver of children under 5)
- Breastfeeding (each primary caregiver of children under 5)
- Infant/Young Child Feeding (each primary caregiver of children under 5)
- Self - Reported Handwashing Behavior
- Latrine/Sanitation Determinants (JD/JM)
- Caregiver Time Use
- Support for Learning / Stimulating Environment
Anthropometry (only for children under 5 years)
- Geographic Identification and Administrative/Supervision Information
- Observations of Children (JC, LF/TK)
- Anthropometry and Anemia
Water and stool samples:
- Geographic Identification and Administrative/Supervision Information
- Fecal Sampling
- Household Drinking Water Sample
- Water Collection Point and Source Sample
Community:
- Geographic Identification and Administrative/Supervision Information
- List of Villages
- Access to Facilities and Service
- Water Supply in GP
- Schemes
- Sanitation Program
- Public Toilet
- Geographic Identification/Location and Administrative/Supervision Information
- Household Roster
- Dwelling Characteristics
- Drinking Water Sources
- Drinking Water Storage and Treatment
- Sanitation Facilities
- Program Exposure
- Knowledge and Access to Toilet technology
- Education
- Labor (for members 15 years and above)
- Household Income
- Assets
- Mortality
Observation of household:
- Observations of Dwelling Characteristics
- Observations of Food Storage
- Observations of Handwashing Facilities
- Observations of Toilet Facility
- Observations of Animals and Feces
Primary caregiver:
- Perceptions of Illness (each primary caregiver of children under 5)
- Child Health Calendar (each primary caregiver of children under 5)
- Breastfeeding (each primary caregiver of children under 5)
- Infant/Young Child Feeding (each primary caregiver of children under 5)
- Self - Reported Handwashing Behavior
- Latrine/Sanitation Determinants (JD/JM)
- Caregiver Time Use
- Support for Learning / Stimulating Environment
Anthropometry (only for children under 5 years)
- Geographic Identification and Administrative/Supervision Information
- Observations of Children (JC, LF/TK)
- Anthropometry and Anemia
Water and stool samples:
- Geographic Identification and Administrative/Supervision Information
- Fecal Sampling
- Household Drinking Water Sample
- Water Collection Point and Source Sample
Community:
- Geographic Identification and Administrative/Supervision Information
- List of Villages
- Access to Facilities and Service
- Water Supply in GP
- Schemes
- Sanitation Program
- Public Toilet
Coverage
Geographic Coverage
The surveys covered Dhar and Khargone districts in Madhya Pradesh state.
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| Water and Sanitation Program | World Bank |
| Network for Engineering and Economics Research and Management | NEERMAN |
Producers
| Name | Role |
|---|---|
| GfK Mode | Implementation of the baseline survey |
| Kimetrica International | Data reduction endline |
Funding Agency/Sponsor
| Name | Role |
|---|---|
| Bill & Melinda Gates Foundation | Primary funding source for the impact evaluation |
Other Identifications/Acknowledgments
| Name | Affiliation |
|---|---|
| Alicia Salvatore | Stanford University |
Sampling
Sampling Procedure
The selection of the sample in Madhya Pradesh was completed in several stages. First, at the design stage of the project, MP was selected a priori as one of two states to participate in the IE. Second, two districts in MP - Dhar and Khargone were selected by WSP in collaboration with the state government. Third, within each of these districts, a total of 80 Gram Panchayats (GP) were selected as candidates for Total Sanitation Campaign (TSC) implementation. In the fourth stage, one village from each candidate GP was identified by the GP as a community that is suitable for implementing TSC yielding a list of 80 villages in each of the four districts. Within each district, 40 of the candidate GPs (and their appointed village) were randomly assigned to the treatment group, and the remaining 40 were assigned to the control group.
Approximately, 1,000 households were sampled in each district to achieve a total sample size of 2,000 households. The final selection of households to participate in the IE survey was carried out by the survey firm contracted to conduct the IE baseline data collection. A household listing of all participating villages was conducted and from this list, 25 households with children under two years old were randomly selected for participation. When 25 eligible households were not available in the listed village, a neighboring village was listed and sampled to achieve the desired number of households in the GP.
Approximately, 1,000 households were sampled in each district to achieve a total sample size of 2,000 households. The final selection of households to participate in the IE survey was carried out by the survey firm contracted to conduct the IE baseline data collection. A household listing of all participating villages was conducted and from this list, 25 households with children under two years old were randomly selected for participation. When 25 eligible households were not available in the listed village, a neighboring village was listed and sampled to achieve the desired number of households in the GP.
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2009-06 | 2009-07 | Baseline survey |
| 2011-02 | 2011-03 | Endline survey |
Data Collection Mode
Face-to-face [f2f]
Data Collection Notes
Protocols and instruments used for data collection were designed by the WSP global impact evaluation team and adapted and piloted by the India principal investigators. All data collection activities were conducted in Hindi. Study protocols and instruments are available from the authors upon request.
GfK Mode, Ltd. was contracted to conduct the fieldwork for the baseline survey. The India principal investigators, Global Team experts and GfK Mode researchers trained field supervisors on all data collection protocols and instruments. GfK Mode researchers and supervisors then trained field teams. Four field teams, each with four interviewers, one supervisor, and one editor conducted the fieldwork. Two additional specialized teams collected the anthropometric measurements of children and the fecal and water samples. Two field executives and one field coordinator handled oversight of the work.
GfK Mode, Ltd. was contracted to conduct the fieldwork for the baseline survey. The India principal investigators, Global Team experts and GfK Mode researchers trained field supervisors on all data collection protocols and instruments. GfK Mode researchers and supervisors then trained field teams. Four field teams, each with four interviewers, one supervisor, and one editor conducted the fieldwork. Two additional specialized teams collected the anthropometric measurements of children and the fecal and water samples. Two field executives and one field coordinator handled oversight of the work.
Questionnaires
Questionnaires
Household Questionnaire: The household questionnaire collected information about household membership and demographics, income, assets, dwelling characteristics, access to water and sanitation, sanitation- and hygiene-related behaviors, maternal depression, mortality, exposure to health interventions, and other outcomes. Enumerators also conducted standardized observations of dwellings and child cleanliness and of sanitation and handwashing facilities at the time of the HH interviews.
Health Questionnaire: The health questionnaire collected information about children’s diarrhea prevalence, acute lower respiratory infection (ALRI), other health symptoms, and child development and growth. As part of this questionnaire, hemoglobin concentrations were measured in children younger than two years of age at the household level using the HemoCueTM Hb201 photometer, a portable device that allows for immediate and reliable quantitative results. Anthropometric (child growth) measures were made according to standardized protocols using portable stadiometers, scales, and measuring tape (Habicht 1974).
Community Questionnaire: The community questionnaire was administered at the GP-level to collect information about GP and district-level characteristics that could influence the intervention or the outcomes of interest (e.g., ongoing health and sanitation programs, connectivity to district headquarters, and other factors).
Water Samples: Water samples were collected from sources at the GP-level and at the household level for a subset of the households (n = X GP-level source samples; n = 354 HH samples). All of the water samples were analyzed by an accredited lab in Indore to determine presence of E. coli and other types of coliforms. The samples were collected within the household, inoculated using the Colilert reactive, and transported to a lab. At the lab, samples were incubated at 35 degrees Celsius for 24 hours, and results were read using an ultraviolet lamp. This procedure precluded sampling in areas where a cold chain could not be maintained.
Stool Samples: Stool samples were collected from children to examine the prevalence of parasites. These were collected from a subset of sampled households (n=216). The same lab in Indore analyzed these samples.
Health Questionnaire: The health questionnaire collected information about children’s diarrhea prevalence, acute lower respiratory infection (ALRI), other health symptoms, and child development and growth. As part of this questionnaire, hemoglobin concentrations were measured in children younger than two years of age at the household level using the HemoCueTM Hb201 photometer, a portable device that allows for immediate and reliable quantitative results. Anthropometric (child growth) measures were made according to standardized protocols using portable stadiometers, scales, and measuring tape (Habicht 1974).
Community Questionnaire: The community questionnaire was administered at the GP-level to collect information about GP and district-level characteristics that could influence the intervention or the outcomes of interest (e.g., ongoing health and sanitation programs, connectivity to district headquarters, and other factors).
Water Samples: Water samples were collected from sources at the GP-level and at the household level for a subset of the households (n = X GP-level source samples; n = 354 HH samples). All of the water samples were analyzed by an accredited lab in Indore to determine presence of E. coli and other types of coliforms. The samples were collected within the household, inoculated using the Colilert reactive, and transported to a lab. At the lab, samples were incubated at 35 degrees Celsius for 24 hours, and results were read using an ultraviolet lamp. This procedure precluded sampling in areas where a cold chain could not be maintained.
Stool Samples: Stool samples were collected from children to examine the prevalence of parasites. These were collected from a subset of sampled households (n=216). The same lab in Indore analyzed these samples.
Data Processing
Data Editing
Baseline: The baseline survey was processed using the assistance of Sistemas Integrales in Chile.
Endline: Kimetrica International was contracted to design the data reduction system to be used during the endline. The data entry system was designed in CSPro (Version 4.1) using the DHS file management system as a standard for file management. Details of the system can be found in the attached manual entitled: Data Entry Manual for the Endline Survey.
The data entry system was based on a full double data entry (independent verification) of the various questionnaires. CSPro supports both dependent and independent verification (double keying) to ensure the accuracy of the data entry operation. Using independent verification, operators can key data into separate data files and use CSPro utilities to compare them and produce a report that indicates discrepancies in data entry.
The DHS system uses a fully integrated tracking system to follow the stages in the data entry process. This includes the checking in of questionnaires; the programming of logic in what is known as a system controlled environment. System controlled applications generally place more restrictions on the data entry operator. This is typically used for complex survey applications. The behavior of these applications at data entry time has the following characteristics:
- Some special data entry keys are not active during data entry.
- CSEntry will keep track of the path.
- 'Not applicable' or blanks values will not be allowed. Missing values have to be coded.
- More appropriate to the heads up methodology of data capture.
- Logic in the application is strictly enforced; operator cannot bypass or override.
Files were processed using the unique cluster number and then concatenated after a final stage of editing and output to both SPSS and STATA.
Furthermore, attempts were made to respect the values and the naming conventions as provided in the baseline. This required using non-conventional values for "missing" such as -99. In most cases the same value sets were applied or during the questionnaire review process the WSP was alerted to such discrepancies.
Endline: Kimetrica International was contracted to design the data reduction system to be used during the endline. The data entry system was designed in CSPro (Version 4.1) using the DHS file management system as a standard for file management. Details of the system can be found in the attached manual entitled: Data Entry Manual for the Endline Survey.
The data entry system was based on a full double data entry (independent verification) of the various questionnaires. CSPro supports both dependent and independent verification (double keying) to ensure the accuracy of the data entry operation. Using independent verification, operators can key data into separate data files and use CSPro utilities to compare them and produce a report that indicates discrepancies in data entry.
The DHS system uses a fully integrated tracking system to follow the stages in the data entry process. This includes the checking in of questionnaires; the programming of logic in what is known as a system controlled environment. System controlled applications generally place more restrictions on the data entry operator. This is typically used for complex survey applications. The behavior of these applications at data entry time has the following characteristics:
- Some special data entry keys are not active during data entry.
- CSEntry will keep track of the path.
- 'Not applicable' or blanks values will not be allowed. Missing values have to be coded.
- More appropriate to the heads up methodology of data capture.
- Logic in the application is strictly enforced; operator cannot bypass or override.
Files were processed using the unique cluster number and then concatenated after a final stage of editing and output to both SPSS and STATA.
Furthermore, attempts were made to respect the values and the naming conventions as provided in the baseline. This required using non-conventional values for "missing" such as -99. In most cases the same value sets were applied or during the questionnaire review process the WSP was alerted to such discrepancies.
Other Processing
The data files as they are output in CSPro follow the hierarchical structure as established in the data dictionary. These however may not be convenient for the analyst. The WSP requested that the files be integrated into various record level files. The files that are included in the final data base reflect this structure.
However, some analysts may still want the hierarchical level data available in its original record form (as it was during data entry). For that reason, these files are also zipped together and provided in the event that they are desired.
The final data files are provided in Stata format as requested by the WSP.
However, some analysts may still want the hierarchical level data available in its original record form (as it was during data entry). For that reason, these files are also zipped together and provided in the event that they are desired.
The final data files are provided in Stata format as requested by the WSP.
Data Appraisal
Estimates of Sampling Error
Not applicable
Data Appraisal
Although there was no formal or independent appraisal of the data, an appraisal was undertaken when the data files for Peru, India and Vietnam were prepared for a WSP presentation in Mexico. These data were presented in a public forum and scrutinized by various analysts. There was a process of feeding back information which helped correct or format or revise the data.
Access policy
Contacts
| Name | Affiliation | |
|---|---|---|
| Claire Chase | WSP | cchase@worldbank.org |
Citation requirements
The use of this dataset must be acknowledged using a citation which would include:
- the identification of the Primary Investigator (including country name)
- the full title of the survey and its acronym (when available), and the year(s) of implementation
- the survey reference number
- the source and date of download (for datasets disseminated online)
Example:
Water and Sanitation Program, Network for Engineering and Economics Research and Management. WSP Global Scaling Up Rural Sanitation Access (TSSM) Impact Evaluation, Madhya Pradesh State, Baseline and Endline Surveys 2009-2011. Dataset downloaded from [URL] on [date].
- the identification of the Primary Investigator (including country name)
- the full title of the survey and its acronym (when available), and the year(s) of implementation
- the survey reference number
- the source and date of download (for datasets disseminated online)
Example:
Water and Sanitation Program, Network for Engineering and Economics Research and Management. WSP Global Scaling Up Rural Sanitation Access (TSSM) Impact Evaluation, Madhya Pradesh State, Baseline and Endline Surveys 2009-2011. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Metadata production
DDI Document ID
DDI_IND_2009_2011_WSPIE_v01_M_v01_A_PUF_WB
Producers
| Name | Abbreviation | Affiliation | Role |
|---|---|---|---|
| Kimetrica International | Kimetrica | Compiled the DDI | |
| Water and Sanitation Project | WSP | World Bank | Reviewed content of the DDI |
| Development Data Group | DECDG | World Bank | Reviewed content of the DDI |
Date of Metadata Production
2014-07-21
DDI Document version
Version 01: Adopted from "DDI-WSP-IND-IE2009-2011" DDI that was done by metadata producers mentioned in "Metadata Production" section.
Version 02 (July 2014): Some of the metadata fields were edited.
Version 02 (July 2014): Some of the metadata fields were edited.