WSP Global Scaling up Handwashing Behavior Impact Evaluation, Baseline and Endline Surveys 2009-2011
Viet Nam, 2009 - 2011
Get MicrodataIdentification
VNM_2009-2011_WSP-IE_v01_M_v01_A_PUF
WSP Global Scaling up Handwashing Behavior Impact Evaluation, Baseline and Endline Surveys 2009-2011
| Name | Country code |
|---|---|
| Viet Nam | VNM |
Other Household Health Survey [hh/hea]
This study was carried out from 2009 to 2011 and includes three major surveys conducted during this period.
Baseline Survey (2009)
Longitudinal Survey (2009-2010)
A total of three pre-intervention longitudinal surveys and one mid-term monitoring survey will be conducted during the study.
Endline Survey (2010-2011)
The post-intervention follow-up survey will be conducted from November 2010 to January 2011 and will collect data on all the indicators collected during the baseline survey, plus dwelling characteristics, water sources, drinking water, sanitation, exposure to health interventions, and mortality.
| Type | Identifier |
|---|---|
| DOI | https://doi.org/10.48529/2by2-0238 |
In an effort to induce improved handwashing behavior, the intervention borrows from both commercial and social marketing fields. This entails the design of communications campaigns and messages likely to bring about desired behavior changes and delivering them strategically so that the target audiences are “surrounded” by handwashing promotion via multiple channels. One of the handwashing project's global objectives is to learn about and document the long-term health and welfare impacts of the project intervention. To measure magnitude of these impacts, the project is implementing a randomized-controlled impact evaluation (IE) in each of the four countries to establish causal linkages between the intervention and key outcomes. The IE uses household surveys to gather data on characteristics of the population exposed to the intervention and to track changes in key outcomes that can be causally attributed to the intervention.
The objective of the IE is to assess the effects of the handwashing project on individual-level handwashing behavior and practices of caregivers. By introducing exogenous variation in handwashing promotion (through randomized exposure to the project), the IE will also address important issues related to the effect of intended behavioral change on child development outcomes. In particular, it will provide information on the extent to which improved handwashing behavior contributes to child health and welfare.
The primary hypothesis of the study is that improved handwashing behavior leads to reductions in disease incidence, and results in direct and indirect health, developmental, and economic benefits by breaking the fecal-oral transmission route. The IE aims to address the following research questions and associated hypotheses:
1. What is the effect of handwashing promotion on handwashing behavior?
2. What is the effect of improved handwashing behavior on health and welfare?
3. Which promotion strategies are more cost-effective in achieving desired outcomes?
(The above excerpt is taken from: Scaling Up Handwashing Behavior: Findings from the Impact Evaluation Baseline Survey in Vietnam Claire Chase and Quy-Toan Do November 2010)
The report is attached.
Sample survey data [ssd]
- Household
- Person
- Caregiver
- Child (under 5 and under 2)
Version
Version 1.0
The study includes information on the baseline, longitudunal and endline surveys.
2011-06-01
Scope
The survey covered the following topics:
HOUSEHOLD
-
Geographic Identification/Location and Administrative/Supervision Information
-
Household Roster
-
Education
-
Labor (for members 15 years and above)
o Labor Force Participation
o Primary Work
o Secondary Work
o Sources of Income -
Household Income
-
Assets
o Household Durable Goods
o Land and Agricultural Equipment
o Animals -
Dwelling Characteristics
-
Drinking Water Sources
-
Drinking Water Storage and Treatment
-
Sanitation Facilities
-
Program Exposure
o Exposure through personal visits
o Exposure through community events
o Preference for media -
Knowledge and Access to Toilet technology
-
Mortality
OBSERVATION OF HOUSEHOLD
- Observations of Dwelling Characteristics
- Observations of Food Storage
- Observations of Handwashing Facilities
- Observations of Toilet Facility
- Observations of Animals and Feces
PRIMARY CARE GIVER
- Perceptions of Illness (each primary caregiver of children under 5)
- Child Health Calendar (each primary caregiver of children under 5)
- Breastfeeding (each primary caregiver of children under 5)
- Infant/Young Child Feeding (each primary caregiver of children under 5)
- Self - Reported Handwashing Behavior
- Latrine/Sanitation Determinants (JD/JM)
- Caregiver Time Use
- Support for Learning / Stimulating Environment
ANTHROPOMETRY (only for children under 5 years)
- Geographic Identification and Administrative/Supervision Information
- Observations of Children (JC, LF/TK)
- Anthropometry and Anemia
WATER AND STOOL SAMPLES
- Geographic Identification and Administrative/Supervision Information
- Fecal Sampling
- Household Drinking Water Sample
- Water Collection Point ans Source Sample
COMMUNITY
- Geographic Identification and Administrative/Supervision Information
- List of Villages
- Access to Facilities and Service
- Water Supply in GP
- Schemes
- Sanitation Program Related
- Public Toile
The survey results provide information on the characteristics of household members, access to handwashing facilities, handwashing behavior, prevalence of child diseases such as diarrhea and respiratory infection, and child growth and development. In addition, community questionnaires were conducted with key informants at the village level in all sample locations to gather information on community access to transportation; commerce; health and education facilities, and other relevant infrastructure; contemporaneous health and development interventions; and environmental and health shocks.
| Topic | Vocabulary |
|---|---|
| Impact Evaluation | World Bank |
| Health | World Bank |
Coverage
The survey was held in three provinces selected for their representative geographic location. These provinces are:
- Hun Yen (close to Hanoi)
- Tien Gan (South)
- Than Hoa (North)
From these provinces a total, 401 communes across 18 districts in the three project provinces were listed by the VWU as eligible to participate in the project. From this list a total of 210 communes across 15 districts in the three provinces were selected for the study.
The survey was undertaken in the commune (clusters). But as this is an impact evaluation, this is not a nationally representative statistic.
The Vietnam Scaling Up Handwashing IE baseline survey collected information from a representative sample of the population targeted by the intervention. The survey was conducted between September and November 2009 in a total of 3,150 households containing 3,751 children under the age of five.
Producers and sponsors
| Name | Affiliation |
|---|---|
| Water and Sanitation Program | World Bank |
| Name | Role |
|---|---|
| National Institute of Hygiene and Epidemiology | Implemented the baseline survey |
| Mekong Economics | Implemented the endline survey |
| Kimetrica International | Data reduction endline |
| Name | Role |
|---|---|
| Bill & Melinda Gates Foundation | Primary funding source for the impact evaluation |
Sampling
The primary objective of the handwashing project is to improve the health and welfare of young children. Thus, a sufficient sample size was calculated to capture a minimum effect size of 20 percent on the key outcome indicator of diarrhea prevalence among children under two years old at the time of the baseline. By focusing on households with children under two, the evaluation aims to capture changes in outcomes for the age range during which children are most sensitive to changes in hygiene in the environment. Power calculations indicated that approximately 1,050 households per treatment arm would need to be surveyed in order to capture a 20 percent reduction in diarrhea prevalence, and in order to account for the possibility of household attrition during the project study phase. Therefore, since the evaluation consists of two treatment groups and one control group, the total sample incorporates 3,150 households, each of which has at least one child under two years of age at the time of the survey.
Rather than using simple random sampling, which is much more costly, the study randomly sampled households in clusters at the commune administrative level. Households were randomly selected from a sampling frame of 210 communes randomly selected from 15 districts in three provinces.
Data were collected using structured questionnaires in all 3,150 households and in each of the 210 commune (one per commune).
Endline Survey:
94.7 % of the households responded.
Approximately 87% of the persons interviewed in the baseline were re-interviewed in the endline.
Not applicable
Survey instrument
Baseline:
The baseline survey was conducted from September to December 2009 and included the following instruments:
• Household questionnaire: Th e household questionnaire was conducted in all 3,150 households collect data on household composition, education, labor, income, assets, spot-check observation of handwashing facilities, handwashing behavior, and handwashing determinants.
• Health questionnaire: Th e health questionnaire was conducted in all 3,150 households, to collect data on children’s diarrhea prevalence, acute lower respiratory infection (ALRI) and other health symptoms, child development, child growth, and anemia.
• Community questionnaire: Th e community questionnaire was conducted in 210 communes, to collect data on socio-demographics of the community, accessibility and connectivity, education and health facilities, water and sanitation related facilities and programs, and government assistance or programs related to health, education, cooperatives, agriculture, water, and other development schemes.
Data collection
| Start | End | Cycle |
|---|---|---|
| 2009-09 | 2009-11 | Baseline |
| 2011 | 2011 | Endline |
| Name |
|---|
| The National Institute of Hygiene and Epidemiology (Baseline Survey) |
| Mekong Economics |
Data processing
Baseline: The baseline survey was processed using the assistance of Sistemas Integrales in Chile. A manual for the data entry system is attached under the title of: Data Entry Manual:Baseline.
Endline: Kimetrica International was contracted to design the data reduction system to be used during the endline. The data entry system was designed in CSPro (Version 4.1) using the DHS file management system as a standard for file management. Details of the system can be found in the attached manual entitled: Data Entry Manual for the Endline Survey.
The data entry system was based on a full double data entry (independent verification) of the various questionnaires. CSPro supports both dependent and independent verification (double keying) to ensure the accuracy of the data entry operation. Using independent verification, operators can key data into separate data files and use CSPro utilities to compare them and produce a report that indicates discrepancies in data entry.
The DHS system uses a fully integrated tracking system to follow the stages in the data entry process. This includes the checking in of questionnaires; the programming of logic in what is known as a system controlled environment. System controlled applications generally place more restrictions on the data entry operator. This is typically used for complex survey applications. The behavior of these applications at data entry time has the following characteristics:
- Some special data entry keys are not active during data entry.
- CSEntry will keep track of the path.
- 'Not applicable' or blanks values will not be allowed. Missing values have to be coded.
- More appropriate to the heads up methodology of data capture.
- Logic in the application is strictly enforced; operator cannot bypass or override.
Files were processed using the unique cluster number and then concatenated after a final stage of editing and output to both SPSS and STATA.
Furthermore, attempts were made to respect the values and the naming conventions as provided in the baseline. This required using non-conventional values for “missing” such as -99. In most cases the same value sets were applied or during the questionnaire review process the WSP was alerted to such discrepancies.
Data appraisal
Not applicable
Although there was no formal or independent appraisal of the data, an appraisal was undertaken when the data files for: Peru, India and Vietnam were prepared for a WSP presentation in Mexico. These data were presented in a public forum and scrutinized by various analysts. There was a process of feeding back information which helped correct or format or revise the data.
Data Access
| Name | Affiliation | |
|---|---|---|
| Clair Chase | Water and Sanitation Program (WSP) | cchase@worldbank.org |
- Licensed datasets, accessible under conditions
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
World Bank Water and Sanitation Program. Vietnam Multi-Country Impact Evaluation (IE) of WSP's Global Handwashing and Rural Sanitation Programs 2009-2011. Ref. VNM_2009_2011_WSP-IE_v01_M. Dataset downloaded from [website/source] on [date]
Disclaimer and copyrights
WSP is a multi-donor partnership created in 1978 and administered by the World Bank to support poor people in obtaining affordable, safe, and sustainable access to water and sanitation services. WSP's donors include Australia, Austria, Canada, Denmark, Finland, France, the Bill & Melinda Gates Foundation, Ireland, Luxembourg, Netherlands, Norway, Sweden, Switzerland, United Kingdom, United States, and the World Bank. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the Water and Sanitation Program, the World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent.
Contacts
| Name | Affiliation | |
|---|---|---|
| Claire Chase | Water and Sanitation Program (WSP) | cchase@worldbank.org |
Metadata production
DDI_VNM_2009-2011_WSP-IE_v01_M_v01_A_PUF
| Name | Affiliation | Role |
|---|---|---|
| Kimetrica International | Compiled the DDI | |
| Water and Sanitation Project | World Bank | Reviewed content of the DDI |
2011-08-07
Metadata version
Version 01: Adopted from "DDI_VNM_2009_2011_WSP-IE" DDI that was done by metadata producers mentioned in "Metadata Production" section.
Version 02: Bertha Briceno and Alex Orsola-Vida removed as access authorities and contacts since they left the World Bank and contact details are no longer valid.