Protecting Early Childhood Development in Malawi Impact Evaluation Survey 2011-2012, Baseline
Malawi, 2011 - 2012
Michelle Neuman, Berk Ozler, Lia Fernald
Created on
March 07, 2019
Last modified
March 07, 2019
Page views
26983
Download
1044
Documentation in PDF
Metadata
DDI/XML
JSON
Identification
Survey ID Number
MWI_2011_PECD_v01_M
Title
Protecting Early Childhood Development in Malawi Impact Evaluation Survey 2011-2012, Baseline
Subtitle
Baseline
Country
| Name | Country code |
|---|---|
| Malawi | MWI |
Study type
Impact evaluation
Abstract
The Government of Malawi recognizes that investment in early childhood development (ECD) is a cost-effective strategy to meet its development objectives in areas of health, nutrition, education, and social protection. In Malawi, ECD is delivered through an extensive network of community initiated and owned centers for the most vulnerable children under the age of six, known as Community-based Childcare Centers (CCBCs). The recent global food, fuel, and financial crises hit Malawi hard. Constrained government budgets and activities for ECD have jeopardized the service delivery of the existing ECD centers which cover about a third of all 3-6 year old children. From 2010 to 2012, the Protecting Early Childhood Development Project (PECD) aimed to mitigate the negative effects of the recent global crises on young children and to start building foundations against future crises. A rigorous impact evaluation of the PECD project in Malawi has been designed to test interactions between existing approaches to improve quality in the preschool sector to maximize effects for primary school readiness. The impact evaluation will test the effectiveness of different approaches to improve quality of ECD Centers, parenting knowledge and practices, and child development and school readiness. The evaluation follows a cluster-randomized control trial design in which 199 CBCCs in four of Malawi’s 28 districts were randomized after baseline into one of three treatment arms or to a control arm.
This Impact Evaluation (IE) has three primary research objectives, which are both academically important and pertinent for policy makers in low-income countries: (1) To evaluate the effect of intensive training and mentoring of teachers andcaregivers at CBCCs in rural sub-Saharan Africa on young children’s physical, emotional, and cognitive development; (2) To determine how can cash incentives be used to retain teachers and caregivers and make them more effective; (3) To assess whether parenting education can be an effective substitute or complement to the efforts to improve preschool quality with respect to child development outcomes.
The baseline survey was conducted between September 30, 2011 and February 17, 2012. Follow-up data was collected between May 13, 2013 and October, 2013. The endline survey is proposed for May - June 2014. Data collection at baseline involved the administration of the mother/guardian and CBCC questionnaires, enumerator observations at the CBCC, and measurement of child development and anthropometric status.
This Impact Evaluation (IE) has three primary research objectives, which are both academically important and pertinent for policy makers in low-income countries: (1) To evaluate the effect of intensive training and mentoring of teachers andcaregivers at CBCCs in rural sub-Saharan Africa on young children’s physical, emotional, and cognitive development; (2) To determine how can cash incentives be used to retain teachers and caregivers and make them more effective; (3) To assess whether parenting education can be an effective substitute or complement to the efforts to improve preschool quality with respect to child development outcomes.
The baseline survey was conducted between September 30, 2011 and February 17, 2012. Follow-up data was collected between May 13, 2013 and October, 2013. The endline survey is proposed for May - June 2014. Data collection at baseline involved the administration of the mother/guardian and CBCC questionnaires, enumerator observations at the CBCC, and measurement of child development and anthropometric status.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
- Community-based childcare centers (CBCC) and their committee chair/caregivers
- 3-4 year old children attending the CBCC
- Mothers/guardians of the 3-4 year old children attending the CBCC
- 3-4 year old children attending the CBCC
- Mothers/guardians of the 3-4 year old children attending the CBCC
Version
Version Description
v01
Baseline datasets
Baseline datasets
Version Date
2012
Scope
Notes
The scope of the baseline data collection includes:
1) Community-based Childcare Centers (CBCCs)
- CBCC observations
- General information on CBCC
- Registration, attendance at CBCC
- Characteristics of children attending CBCC
- Child listing
- Staff information (work load, selection process, training)
- Caregiver roster
- Water, sanitation, toilet facilities
- Health and food
- Curriculum and daily activities
2) Child assessments
- Anthropometric measurements
- Leiter score sheet
- PPVT-4 record form
- Fine motor/visuoperception
- Language/hearing
- Child observations
3) Mother or guardian
- Household and dwelling characteristics
- Durable goods
- Economic shocks
- Health practices
- CBCC information (reasons for choosing CBCC, cost, perception of CBCC)
- Antenatal, birth and early practices
- Child immunizations and health
- Nutrition and development
- Household stimulation/support for learning
- Child's behavior
- Mother or guardian's health
- AIDS
1) Community-based Childcare Centers (CBCCs)
- CBCC observations
- General information on CBCC
- Registration, attendance at CBCC
- Characteristics of children attending CBCC
- Child listing
- Staff information (work load, selection process, training)
- Caregiver roster
- Water, sanitation, toilet facilities
- Health and food
- Curriculum and daily activities
2) Child assessments
- Anthropometric measurements
- Leiter score sheet
- PPVT-4 record form
- Fine motor/visuoperception
- Language/hearing
- Child observations
3) Mother or guardian
- Household and dwelling characteristics
- Durable goods
- Economic shocks
- Health practices
- CBCC information (reasons for choosing CBCC, cost, perception of CBCC)
- Antenatal, birth and early practices
- Child immunizations and health
- Nutrition and development
- Household stimulation/support for learning
- Child's behavior
- Mother or guardian's health
- AIDS
Coverage
Geographic Coverage
Data was collected in Balaka, Thyolo, Nkhatabay, and Dedza districts.
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| Michelle Neuman | World Bank |
| Berk Ozler | World Bank |
| Lia Fernald | Univeristy of California Berkeley |
Producers
| Name | Affiliation |
|---|---|
| Patricia Kariger | University of California Berkeley |
| Christine MacDonald | University of California Berkeley |
| Foster Kholowa | Univeristy of Malawi, Chancellor College |
| Christin McConnell | World Bank |
| Josefine Durazo | World Bank |
Funding Agency/Sponsor
| Name | Abbreviation | Role |
|---|---|---|
| Rapid Social Response Fund, World Bank | ||
| Strategic Impact Evaluation Fund, World Bank | SIEF | Financing of midline and endline surveys |
Sampling
Sampling Procedure
This study is a cluster-randomized controlled trial with one control arm and three treatment arms. Four study districts (Balaka, Thyolo, Dedza, Nhkata Bay) that provide adequate representation of the regions in Malawi were chosen by the MGCSW for inclusion in the study. Sample size calculations for a multi-site, cluster-randomized trial estimated that 240 CBCCs and 12 children from each of the CBCCs would be necessary to detect small to moderate impacts (0.2 to 0.25 standard deviations) on child development measures (the PPVT, specifically) with 95% confidence and 80% power. A full listing of all CBCCs eligible to receive the intervention from the MGCSW produced only 199 CBCCs in the four districts, however; therefore, all 199 CBCCs were included in the study.
Randomization was conducted in each district separately to ensure that equal numbers of CBCCs were allocated to each of the study arms within each district. To ensure a balance of important baseline characteristics, which are strongly prognostic of cognitive development outcomes of interest, a "block randomization" procedure was used. Information about the variables used for blocking (child anthropometrics and scores on developmental tests) was collected during the baseline survey.
The sample includes 2,120 children, ages 3-4 years, attending the CBCCs from the village. These children were randomly selected (blocked by age and sex) from the group of children attending the CBCCs on the day the baseline data collection teams visited the school. Therefore, selection bias should not be an issue.
The PECD project focuses on four interventions:
1. Play and learning materials: kit of basic play and learning materials and supplies
2. Caregiver training and mentoring: enhanced 5 week residential training program for caregivers including fieldwork and mentoring
3. Caregiver incentives: small monthly cash incentive to encourage retention and performance
4. Parenting education: 12 group sessions for parents with 3- and 4-year olds focused on practical activities
Control and treatment groups are to receive the following interventions:
1. Control Group: Play and Learning Materials Only
2. Treatment Group 1: Caregiver Training + Play and Learning Materials
3. Treatment Group 2: Caregiver Training + Incentives + Play and Learning Materials
4. Treatment Group 3: Caregiver Training + Parenting Education + Play and Learning Materials
Randomization was conducted in each district separately to ensure that equal numbers of CBCCs were allocated to each of the study arms within each district. To ensure a balance of important baseline characteristics, which are strongly prognostic of cognitive development outcomes of interest, a "block randomization" procedure was used. Information about the variables used for blocking (child anthropometrics and scores on developmental tests) was collected during the baseline survey.
The sample includes 2,120 children, ages 3-4 years, attending the CBCCs from the village. These children were randomly selected (blocked by age and sex) from the group of children attending the CBCCs on the day the baseline data collection teams visited the school. Therefore, selection bias should not be an issue.
The PECD project focuses on four interventions:
1. Play and learning materials: kit of basic play and learning materials and supplies
2. Caregiver training and mentoring: enhanced 5 week residential training program for caregivers including fieldwork and mentoring
3. Caregiver incentives: small monthly cash incentive to encourage retention and performance
4. Parenting education: 12 group sessions for parents with 3- and 4-year olds focused on practical activities
Control and treatment groups are to receive the following interventions:
1. Control Group: Play and Learning Materials Only
2. Treatment Group 1: Caregiver Training + Play and Learning Materials
3. Treatment Group 2: Caregiver Training + Incentives + Play and Learning Materials
4. Treatment Group 3: Caregiver Training + Parenting Education + Play and Learning Materials
Response Rate
Data was collected from all 199 CBCCs. Included are developmental test scores and anthropometric measures from all 2,120 children, as well as responses from 2,030 mothers/guardians who completed the mother/guardian questionnaire and whose children were included in the analysis. The child data excludes 15 cases in which the child was disqualified (due to age) or refused to participate in the study. The four refusals from the mother/guardian survey are included.
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2011-09-30 | 2012-02-17 | Baseline |
Data Collection Mode
Face-to-face [f2f]
Supervision
Data collection was overseen by an Impact Evaluation Field Coordinator from the World Bank who conducted spot-checks in the field as well as data entry.
Data Collection Notes
Baseline data collection took place over a period of two days at each CBCC. On the first day, the study team introduced the study and administered the CBCC questionnaire to the CBCC director, conducted CBCC observations, completed the CBCC caregiver roster/interview, completed the child listing exercise to randomly select child participants, and contacted the mothers/guardians of selected children. On day two of data collection at the CBCC, enumerators screened each mother/guardian to ensure they met the basic qualifications (at least 16 years of age, and spend at least 20 hours per week with the child respondent). If the mother/guardian did not meet the criteria, the enumerator tried to identify the adult who spends the most time with the child and asked if they could come to the CBCC. Enumerators explained the research study to the mothers/guardians and requested their participation and permission for their child’s participation. Then, the enumerators conducted the mother/guardian interviews using the mother/guardian questionnaire, administered the child developmental assessment tests, and completed the child anthropometric measurements.
Data collection was put on hold between December 10 and January 9 as CBCCs were closed due to the national school holidays. Reaching remote centers in the months of January and February was more challenging due to poor road conditions during rainy season.
Data collection was put on hold between December 10 and January 9 as CBCCs were closed due to the national school holidays. Reaching remote centers in the months of January and February was more challenging due to poor road conditions during rainy season.
Data Collectors
| Name | Abbreviation |
|---|---|
| Wadonda Consult | WACO |
Questionnaires
Questionnaires
Data collection at baseline involved the administration of the mother/guardian questionnaire, measurement of child development and anthropometric status, administration of the CBCC questionnaire, and enumerator observations at the CBCC.
Data can be linked across datasets using the 3 digit CBCC ID. Each child respondent participating in the study has a unique 6 digit ID consisting of the CBCC ID (3 digits) + Child Listing Roster ID (2 digits) + 1/2/3 (indicating whether the child was the first, second, or third child with the same mother/guardian to be entered). Each mother/guardian interviewed has a unique 5 digit ID which is the first 5 digits of the (6 digit) Child Respondent ID. For example, a child attending CBCC 399 and listed 12th on the child listing roster with no other siblings listed will have the ID of 399121. His/her mother/guardian would have the ID of 39912.
Data can be linked across datasets using the 3 digit CBCC ID. Each child respondent participating in the study has a unique 6 digit ID consisting of the CBCC ID (3 digits) + Child Listing Roster ID (2 digits) + 1/2/3 (indicating whether the child was the first, second, or third child with the same mother/guardian to be entered). Each mother/guardian interviewed has a unique 5 digit ID which is the first 5 digits of the (6 digit) Child Respondent ID. For example, a child attending CBCC 399 and listed 12th on the child listing roster with no other siblings listed will have the ID of 399121. His/her mother/guardian would have the ID of 39912.
Access policy
Contacts
| Name | Affiliation | |
|---|---|---|
| Christin McConnell | World Bank | cmcconnell@worldbank.org |
Citation requirements
The use of the datasets must be acknowledged using a citation which would include:
- the identification of the Primary Investigator (including country name)
- the full title of the survey and its acronym (when available), and the year(s) of implementation
- the survey reference number
- the source and date of download (for datasets disseminated online).
Example:
Michelle Neuman, World Bank, Berk Ozler, World Bank, Lia Fernald, Univeristy of California Berkeley. Protecting Early Childhood Development in Malawi Impact Evaluation Survey 2011-2012, Baseline. Ref. MWI_2011_PECD_v01_M. Dataset downloaded from [URL] on [date].
- the identification of the Primary Investigator (including country name)
- the full title of the survey and its acronym (when available), and the year(s) of implementation
- the survey reference number
- the source and date of download (for datasets disseminated online).
Example:
Michelle Neuman, World Bank, Berk Ozler, World Bank, Lia Fernald, Univeristy of California Berkeley. Protecting Early Childhood Development in Malawi Impact Evaluation Survey 2011-2012, Baseline. Ref. MWI_2011_PECD_v01_M. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Metadata production
DDI Document ID
DDI_MWI_2011_PECD_v01_M_WB
Producers
| Name | Abbreviation | Affiliation |
|---|---|---|
| Development Data Group | DECDG | World Bank |
| Human Development Network, Education | HDNED | World Bank |
Date of Metadata Production
2013-10-07
DDI Document version
v01 (October 2013)