WSP Global Scaling up Handwashing Behavior Impact Evaluation, Baseline and Endline Surveys 2009-2011
Vietnam, 2009 - 2011
Water and Sanitation Program
Created on
July 19, 2016
Last modified
July 19, 2016
Page views
77364
Download
6736
Documentation in PDF
Metadata
DDI/XML
JSON
Identification
Survey ID Number
VNM_2009-2011_WSP-IE_v01_M_v01_A_PUF
Title
WSP Global Scaling up Handwashing Behavior Impact Evaluation, Baseline and Endline Surveys 2009-2011
Country
| Name | Country code |
|---|---|
| Vietnam | VNM |
Study type
Other Household Health Survey [hh/hea]
Series Information
This study was carried out from 2009 to 2011 and includes three major surveys conducted during this period.
Baseline Survey (2009)
Longitudinal Survey (2009-2010)
A total of three pre-intervention longitudinal surveys and one mid-term monitoring survey will be conducted during the study.
Endline Survey (2010-2011)
The post-intervention follow-up survey will be conducted from November 2010 to January 2011 and will collect data on all the indicators collected during the baseline survey, plus dwelling characteristics, water sources, drinking water, sanitation, exposure to health interventions, and mortality.
Baseline Survey (2009)
Longitudinal Survey (2009-2010)
A total of three pre-intervention longitudinal surveys and one mid-term monitoring survey will be conducted during the study.
Endline Survey (2010-2011)
The post-intervention follow-up survey will be conducted from November 2010 to January 2011 and will collect data on all the indicators collected during the baseline survey, plus dwelling characteristics, water sources, drinking water, sanitation, exposure to health interventions, and mortality.
Abstract
In December 2006, in response to the preventable threats posed by poor sanitation and hygiene, the Water and Sanitation Program (WSP) launched Global Scaling Up Handwashing and Global Scaling Up Rural Sanitation1 to improve the health and welfare outcomes for millions of poor people. Local and national governments implement these large-scale projects with technical support from WSP. Handwashing with soap at critical times-such as after contact with feces and before handling food-has been shown to substantially reduce the incidence of diarrhea. It reduces health risks even when families do not have access to basic sanitation and water supply. Despite this benefit, rates of handwashing with soap at critical times are very low throughout the developing world. Global Scaling Up Handwashing aims to test whether handwashing with soap behavior can be generated and sustained among the poor and vulnerable using innovative promotional approaches. The goal of Global Scaling Up Handwashing is to reduce the risk of diarrhea and therefore increase household productivity by stimulating and sustaining the behavior of handwashing with soap at critical times in the lives of 5.4 million people in Peru, Senegal, Tanzania, and Vietnam, where the project has been implemented to date.
In an effort to induce improved handwashing behavior, the intervention borrows from both commercial and social marketing fields. This entails the design of communications campaigns and messages likely to bring about desired behavior changes and delivering them strategically so that the target audiences are “surrounded” by handwashing promotion via multiple channels. One of the handwashing project's global objectives is to learn about and document the long-term health and welfare impacts of the project intervention. To measure magnitude of these impacts, the project is implementing a randomized-controlled impact evaluation (IE) in each of the four countries to establish causal linkages between the intervention and key outcomes. The IE uses household surveys to gather data on characteristics of the population exposed to the intervention and to track changes in key outcomes that can be causally attributed to the intervention.
The objective of the IE is to assess the effects of the handwashing project on individual-level handwashing behavior and practices of caregivers. By introducing exogenous variation in handwashing promotion (through randomized exposure to the project), the IE will also address important issues related to the effect of intended behavioral change on child development outcomes. In particular, it will provide information on the extent to which improved handwashing behavior contributes to child health and welfare.
The primary hypothesis of the study is that improved handwashing behavior leads to reductions in disease incidence, and results in direct and indirect health, developmental, and economic benefits by breaking the fecal-oral transmission route. The IE aims to address the following research questions and associated hypotheses:
1. What is the effect of handwashing promotion on handwashing behavior?
2. What is the effect of improved handwashing behavior on health and welfare?
3. Which promotion strategies are more cost-effective in achieving desired outcomes?
(The above excerpt is taken from: Scaling Up Handwashing Behavior: Findings from the Impact Evaluation Baseline Survey in Vietnam Claire Chase and Quy-Toan Do November 2010)
The report is attached.
In an effort to induce improved handwashing behavior, the intervention borrows from both commercial and social marketing fields. This entails the design of communications campaigns and messages likely to bring about desired behavior changes and delivering them strategically so that the target audiences are “surrounded” by handwashing promotion via multiple channels. One of the handwashing project's global objectives is to learn about and document the long-term health and welfare impacts of the project intervention. To measure magnitude of these impacts, the project is implementing a randomized-controlled impact evaluation (IE) in each of the four countries to establish causal linkages between the intervention and key outcomes. The IE uses household surveys to gather data on characteristics of the population exposed to the intervention and to track changes in key outcomes that can be causally attributed to the intervention.
The objective of the IE is to assess the effects of the handwashing project on individual-level handwashing behavior and practices of caregivers. By introducing exogenous variation in handwashing promotion (through randomized exposure to the project), the IE will also address important issues related to the effect of intended behavioral change on child development outcomes. In particular, it will provide information on the extent to which improved handwashing behavior contributes to child health and welfare.
The primary hypothesis of the study is that improved handwashing behavior leads to reductions in disease incidence, and results in direct and indirect health, developmental, and economic benefits by breaking the fecal-oral transmission route. The IE aims to address the following research questions and associated hypotheses:
1. What is the effect of handwashing promotion on handwashing behavior?
2. What is the effect of improved handwashing behavior on health and welfare?
3. Which promotion strategies are more cost-effective in achieving desired outcomes?
(The above excerpt is taken from: Scaling Up Handwashing Behavior: Findings from the Impact Evaluation Baseline Survey in Vietnam Claire Chase and Quy-Toan Do November 2010)
The report is attached.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
- Household
- Person
- Caregiver
- Child (under 5 and under 2)
- Person
- Caregiver
- Child (under 5 and under 2)
Version
Version Description
Version 1.0
The study includes information on the baseline, longitudunal and endline surveys.
The study includes information on the baseline, longitudunal and endline surveys.
Version Date
2011-06-01
Scope
Notes
The survey covered the following topics:
HOUSEHOLD
- Geographic Identification/Location and Administrative/Supervision Information
- Household Roster
- Education
- Labor (for members 15 years and above)
o Labor Force Participation
o Primary Work
o Secondary Work
o Sources of Income
- Household Income
- Assets
o Household Durable Goods
o Land and Agricultural Equipment
o Animals
- Dwelling Characteristics
- Drinking Water Sources
- Drinking Water Storage and Treatment
- Sanitation Facilities
- Program Exposure
o Exposure through personal visits
o Exposure through community events
o Preference for media
- Knowledge and Access to Toilet technology
- Mortality
OBSERVATION OF HOUSEHOLD
- Observations of Dwelling Characteristics
- Observations of Food Storage
- Observations of Handwashing Facilities
- Observations of Toilet Facility
- Observations of Animals and Feces
PRIMARY CARE GIVER
- Perceptions of Illness (each primary caregiver of children under 5)
- Child Health Calendar (each primary caregiver of children under 5)
- Breastfeeding (each primary caregiver of children under 5)
- Infant/Young Child Feeding (each primary caregiver of children under 5)
- Self - Reported Handwashing Behavior
- Latrine/Sanitation Determinants (JD/JM)
- Caregiver Time Use
- Support for Learning / Stimulating Environment
ANTHROPOMETRY (only for children under 5 years)
- Geographic Identification and Administrative/Supervision Information
- Observations of Children (JC, LF/TK)
- Anthropometry and Anemia
WATER AND STOOL SAMPLES
- Geographic Identification and Administrative/Supervision Information
- Fecal Sampling
- Household Drinking Water Sample
- Water Collection Point ans Source Sample
COMMUNITY
- Geographic Identification and Administrative/Supervision Information
- List of Villages
- Access to Facilities and Service
- Water Supply in GP
- Schemes
- Sanitation Program Related
- Public Toile
The survey results provide information on the characteristics of household members, access to handwashing facilities, handwashing behavior, prevalence of child diseases such as diarrhea and respiratory infection, and child growth and development. In addition, community questionnaires were conducted with key informants at the village level in all sample locations to gather information on community access to transportation; commerce; health and education facilities, and other relevant infrastructure; contemporaneous health and development interventions; and environmental and health shocks.
HOUSEHOLD
- Geographic Identification/Location and Administrative/Supervision Information
- Household Roster
- Education
- Labor (for members 15 years and above)
o Labor Force Participation
o Primary Work
o Secondary Work
o Sources of Income
- Household Income
- Assets
o Household Durable Goods
o Land and Agricultural Equipment
o Animals
- Dwelling Characteristics
- Drinking Water Sources
- Drinking Water Storage and Treatment
- Sanitation Facilities
- Program Exposure
o Exposure through personal visits
o Exposure through community events
o Preference for media
- Knowledge and Access to Toilet technology
- Mortality
OBSERVATION OF HOUSEHOLD
- Observations of Dwelling Characteristics
- Observations of Food Storage
- Observations of Handwashing Facilities
- Observations of Toilet Facility
- Observations of Animals and Feces
PRIMARY CARE GIVER
- Perceptions of Illness (each primary caregiver of children under 5)
- Child Health Calendar (each primary caregiver of children under 5)
- Breastfeeding (each primary caregiver of children under 5)
- Infant/Young Child Feeding (each primary caregiver of children under 5)
- Self - Reported Handwashing Behavior
- Latrine/Sanitation Determinants (JD/JM)
- Caregiver Time Use
- Support for Learning / Stimulating Environment
ANTHROPOMETRY (only for children under 5 years)
- Geographic Identification and Administrative/Supervision Information
- Observations of Children (JC, LF/TK)
- Anthropometry and Anemia
WATER AND STOOL SAMPLES
- Geographic Identification and Administrative/Supervision Information
- Fecal Sampling
- Household Drinking Water Sample
- Water Collection Point ans Source Sample
COMMUNITY
- Geographic Identification and Administrative/Supervision Information
- List of Villages
- Access to Facilities and Service
- Water Supply in GP
- Schemes
- Sanitation Program Related
- Public Toile
The survey results provide information on the characteristics of household members, access to handwashing facilities, handwashing behavior, prevalence of child diseases such as diarrhea and respiratory infection, and child growth and development. In addition, community questionnaires were conducted with key informants at the village level in all sample locations to gather information on community access to transportation; commerce; health and education facilities, and other relevant infrastructure; contemporaneous health and development interventions; and environmental and health shocks.
Topics
| Topic | Vocabulary |
|---|---|
| Impact Evaluation | World Bank |
| Health | World Bank |
Coverage
Geographic Coverage
The survey was held in three provinces selected for their representative geographic location. These provinces are:
- Hun Yen (close to Hanoi)
- Tien Gan (South)
- Than Hoa (North)
From these provinces a total, 401 communes across 18 districts in the three project provinces were listed by the VWU as eligible to participate in the project. From this list a total of 210 communes across 15 districts in the three provinces were selected for the study.
- Hun Yen (close to Hanoi)
- Tien Gan (South)
- Than Hoa (North)
From these provinces a total, 401 communes across 18 districts in the three project provinces were listed by the VWU as eligible to participate in the project. From this list a total of 210 communes across 15 districts in the three provinces were selected for the study.
Geographic Unit
The survey was undertaken in the commune (clusters). But as this is an impact evaluation, this is not a nationally representative statistic.
Universe
The Vietnam Scaling Up Handwashing IE baseline survey collected information from a representative sample of the population targeted by the intervention. The survey was conducted between September and November 2009 in a total of 3,150 households containing 3,751 children under the age of five.
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| Water and Sanitation Program | World Bank |
Producers
| Name | Role |
|---|---|
| National Institute of Hygiene and Epidemiology | Implemented the baseline survey |
| Mekong Economics | Implemented the endline survey |
| Kimetrica International | Data reduction endline |
Funding Agency/Sponsor
| Name | Role |
|---|---|
| Bill & Melinda Gates Foundation | Primary funding source for the impact evaluation |
Sampling
Sampling Procedure
The primary objective of the handwashing project is to improve the health and welfare of young children. Thus, a sufficient sample size was calculated to capture a minimum effect size of 20 percent on the key outcome indicator of diarrhea prevalence among children under two years old at the time of the baseline. By focusing on households with children under two, the evaluation aims to capture changes in outcomes for the age range during which children are most sensitive to changes in hygiene in the environment. Power calculations indicated that approximately 1,050 households per treatment arm would need to be surveyed in order to capture a 20 percent reduction in diarrhea prevalence, and in order to account for the possibility of household attrition during the project study phase. Therefore, since the evaluation consists of two treatment groups and one control group, the total sample incorporates 3,150 households, each of which has at least one child under two years of age at the time of the survey.
Rather than using simple random sampling, which is much more costly, the study randomly sampled households in clusters at the commune administrative level. Households were randomly selected from a sampling frame of 210 communes randomly selected from 15 districts in three provinces.
Data were collected using structured questionnaires in all 3,150 households and in each of the 210 commune (one per commune).
Rather than using simple random sampling, which is much more costly, the study randomly sampled households in clusters at the commune administrative level. Households were randomly selected from a sampling frame of 210 communes randomly selected from 15 districts in three provinces.
Data were collected using structured questionnaires in all 3,150 households and in each of the 210 commune (one per commune).
Response Rate
Endline Survey:
94.7 % of the households responded.
Approximately 87% of the persons interviewed in the baseline were re-interviewed in the endline.
94.7 % of the households responded.
Approximately 87% of the persons interviewed in the baseline were re-interviewed in the endline.
Weighting
Not applicable
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2009-09 | 2009-11 | Baseline |
| 2011 | 2011 | Endline |
Data Collection Mode
Face-to-face [f2f]
Data Collectors
| Name | Abbreviation |
|---|---|
| The National Institute of Hygiene and Epidemiology (Baseline Survey) | NIHE |
| Mekong Economics | Mekong |
Questionnaires
Questionnaires
Baseline:
The baseline survey was conducted from September to December 2009 and included the following instruments:
• Household questionnaire: Th e household questionnaire was conducted in all 3,150 households collect data on household composition, education, labor, income, assets, spot-check observation of handwashing facilities, handwashing behavior, and handwashing determinants.
• Health questionnaire: Th e health questionnaire was conducted in all 3,150 households, to collect data on children’s diarrhea prevalence, acute lower respiratory infection (ALRI) and other health symptoms, child development, child growth, and anemia.
• Community questionnaire: Th e community questionnaire was conducted in 210 communes, to collect data on socio-demographics of the community, accessibility and connectivity, education and health facilities, water and sanitation related facilities and programs, and government assistance or programs related to health, education, cooperatives, agriculture, water, and other development schemes.
The baseline survey was conducted from September to December 2009 and included the following instruments:
• Household questionnaire: Th e household questionnaire was conducted in all 3,150 households collect data on household composition, education, labor, income, assets, spot-check observation of handwashing facilities, handwashing behavior, and handwashing determinants.
• Health questionnaire: Th e health questionnaire was conducted in all 3,150 households, to collect data on children’s diarrhea prevalence, acute lower respiratory infection (ALRI) and other health symptoms, child development, child growth, and anemia.
• Community questionnaire: Th e community questionnaire was conducted in 210 communes, to collect data on socio-demographics of the community, accessibility and connectivity, education and health facilities, water and sanitation related facilities and programs, and government assistance or programs related to health, education, cooperatives, agriculture, water, and other development schemes.
Data Processing
Data Editing
Baseline: The baseline survey was processed using the assistance of Sistemas Integrales in Chile. A manual for the data entry system is attached under the title of: Data Entry Manual:Baseline.
Endline: Kimetrica International was contracted to design the data reduction system to be used during the endline. The data entry system was designed in CSPro (Version 4.1) using the DHS file management system as a standard for file management. Details of the system can be found in the attached manual entitled: Data Entry Manual for the Endline Survey.
The data entry system was based on a full double data entry (independent verification) of the various questionnaires. CSPro supports both dependent and independent verification (double keying) to ensure the accuracy of the data entry operation. Using independent verification, operators can key data into separate data files and use CSPro utilities to compare them and produce a report that indicates discrepancies in data entry.
The DHS system uses a fully integrated tracking system to follow the stages in the data entry process. This includes the checking in of questionnaires; the programming of logic in what is known as a system controlled environment. System controlled applications generally place more restrictions on the data entry operator. This is typically used for complex survey applications. The behavior of these applications at data entry time has the following characteristics:
- Some special data entry keys are not active during data entry.
- CSEntry will keep track of the path.
- 'Not applicable' or blanks values will not be allowed. Missing values have to be coded.
- More appropriate to the heads up methodology of data capture.
- Logic in the application is strictly enforced; operator cannot bypass or override.
Files were processed using the unique cluster number and then concatenated after a final stage of editing and output to both SPSS and STATA.
Furthermore, attempts were made to respect the values and the naming conventions as provided in the baseline. This required using non-conventional values for “missing” such as -99. In most cases the same value sets were applied or during the questionnaire review process the WSP was alerted to such discrepancies.
Endline: Kimetrica International was contracted to design the data reduction system to be used during the endline. The data entry system was designed in CSPro (Version 4.1) using the DHS file management system as a standard for file management. Details of the system can be found in the attached manual entitled: Data Entry Manual for the Endline Survey.
The data entry system was based on a full double data entry (independent verification) of the various questionnaires. CSPro supports both dependent and independent verification (double keying) to ensure the accuracy of the data entry operation. Using independent verification, operators can key data into separate data files and use CSPro utilities to compare them and produce a report that indicates discrepancies in data entry.
The DHS system uses a fully integrated tracking system to follow the stages in the data entry process. This includes the checking in of questionnaires; the programming of logic in what is known as a system controlled environment. System controlled applications generally place more restrictions on the data entry operator. This is typically used for complex survey applications. The behavior of these applications at data entry time has the following characteristics:
- Some special data entry keys are not active during data entry.
- CSEntry will keep track of the path.
- 'Not applicable' or blanks values will not be allowed. Missing values have to be coded.
- More appropriate to the heads up methodology of data capture.
- Logic in the application is strictly enforced; operator cannot bypass or override.
Files were processed using the unique cluster number and then concatenated after a final stage of editing and output to both SPSS and STATA.
Furthermore, attempts were made to respect the values and the naming conventions as provided in the baseline. This required using non-conventional values for “missing” such as -99. In most cases the same value sets were applied or during the questionnaire review process the WSP was alerted to such discrepancies.
Other Processing
The data files as they are output in CSPro follow the hierarchical structure as established in the data dictionary. These however may not be convenient for the analyst. The WSP requested that the files be integrated into various record level files. The files that are included in the final data base reflect this structure.
However, some analysts may still want the hierarchical level data available in its original record form (as it was during data entry). For that reason, these files are also zipped together and provided in the event that they are desired.
The final data files are provided in STATA format as requested by the WSP.
However, some analysts may still want the hierarchical level data available in its original record form (as it was during data entry). For that reason, these files are also zipped together and provided in the event that they are desired.
The final data files are provided in STATA format as requested by the WSP.
Data Appraisal
Estimates of Sampling Error
Not applicable
Data Appraisal
Although there was no formal or independent appraisal of the data, an appraisal was undertaken when the data files for: Peru, India and Vietnam were prepared for a WSP presentation in Mexico. These data were presented in a public forum and scrutinized by various analysts. There was a process of feeding back information which helped correct or format or revise the data.
Access policy
Access authority
| Name | Affiliation | |
|---|---|---|
| Clair Chase | Water and Sanitation Program (WSP) | cchase@worldbank.org |
Contacts
| Name | Affiliation | |
|---|---|---|
| Claire Chase | Water and Sanitation Program (WSP) | cchase@worldbank.org |
Access conditions
- Licensed datasets, accessible under conditions
Citation requirements
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
World Bank Water and Sanitation Program. Vietnam Multi-Country Impact Evaluation (IE) of WSP's Global Handwashing and Rural Sanitation Programs 2009-2011. Ref. VNM_2009_2011_WSP-IE_v01_M. Dataset downloaded from [website/source] on [date]
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
World Bank Water and Sanitation Program. Vietnam Multi-Country Impact Evaluation (IE) of WSP's Global Handwashing and Rural Sanitation Programs 2009-2011. Ref. VNM_2009_2011_WSP-IE_v01_M. Dataset downloaded from [website/source] on [date]
Disclaimer and copyrights
Disclaimer
WSP is a multi-donor partnership created in 1978 and administered by the World Bank to support poor people in obtaining affordable, safe, and sustainable access to water and sanitation services. WSP's donors include Australia, Austria, Canada, Denmark, Finland, France, the Bill & Melinda Gates Foundation, Ireland, Luxembourg, Netherlands, Norway, Sweden, Switzerland, United Kingdom, United States, and the World Bank. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the Water and Sanitation Program, the World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent.
Metadata production
DDI Document ID
DDI_VNM_2009-2011_WSP-IE_v01_M_v01_A_PUF
Producers
| Name | Abbreviation | Affiliation | Role |
|---|---|---|---|
| Kimetrica International | Kimetrica | Compiled the DDI | |
| Water and Sanitation Project | WSP | World Bank | Reviewed content of the DDI |
Date of Metadata Production
2011-08-07
DDI Document version
Version 01: Adopted from "DDI_VNM_2009_2011_WSP-IE" DDI that was done by metadata producers mentioned in "Metadata Production" section.
Version 02: Bertha Briceno and Alex Orsola-Vida removed as access authorities and contacts since they left the World Bank and contact details are no longer valid.
Version 02: Bertha Briceno and Alex Orsola-Vida removed as access authorities and contacts since they left the World Bank and contact details are no longer valid.