Health Results-Based Financing Impact Evaluation 2014
In collaboration with the Gambia National Nutrition Agency and the Ministry of Health and Social Welfare, a research team from the World Bank, University of Southern California and Harvard University has developed an evaluation and roll-out design which allows rigorous assessment of the impact of the results-based financing interventions on health related outcomes.
The key objective of the impact evaluation is to assess the effectiveness and cost-effectiveness of the package of supply and demand side interventions developed for, and implemented at health facilities and communities as part of the Gambia Maternal and Child Nutrition and Health Results Project. This project is implemented in three regions with some of the poorest performing indicators - Upper River, Central River and North Bank West Regions. Over the five-year period of implementation, the project is expected to reach approximately 183,000 children under five and 180,000 women aged 15-49 years, yielding a total of 363,000 direct beneficiaries of the project. The interventions will provide support through RBF arrangements with women, Village Development Committees (VDC) and Village Support Groups (VSG), and primary health facilities.
The primary research questions are grouped according to three broad categories: effect on nutrition and health outcomes, effect on service utilization and adoption of behaviors, and effect on intermediate outcomes along pathways of impact. The evaluation uses a mixed-methods explanatory design with an embedded process evaluation based on a conceptual framework that details out the pathways of impact for both interventions.
The overall approach for the impact evaluation is a randomized phased-in 2 x 2 design. The plan for the supply-side is that facilities in the three target regions are enrolled in the project in two phases, each lasting 18 months which should provide a sufficiently long time window to allow behavioral changes. In addition to the supply-side interventions, some communities in the target regions will be enrolled in a community-based demand-side component, for which each phase will last 12 months.
To measure the community-level impact of the project, three main surveys are to be conducted. A baseline survey was administered at the beginning of the project in October 2014 - February 2015. A midline survey is planned to be conducted approximately 18 months after the project launch, and an endline survey - after approximately 36 months of the project start.
The quantitative and qualitative data from the baseline survey is documented here. This assessment prepared a baseline against which the impact of the project can subsequently be measured. The quantitative baseline data was collected through household, health facility and village questionnaires. Qualitative baseline data was collected using focus group discussions and in-depth interviews.
Kind of data
Sample survey data [ssd]
1) v01, edited, anonymous quantitative data files
Anonymous data files were created by removing the following information:
- Health facility names
- Global Positioning System (GPS) coordinates
- Community names
- Names of individuals
2) Anonymous qualitative transcripts (available in Related Materials)
Qualitative transcripts have been anonymized by removing the following information:
- Health facility names
- Community names
- Names of individuals
Upper River, Central River and North Bank West Regions
Unit of analysis
- health facilities,
Producers and sponsors
University of Southern California
Health Results Innovation Trust Fund
A household survey targeted a random sample of women 15 and older in communities in 2259 households, and a facility survey directly targeted all 24 health facilities in the area.
For the household survey, two-stage cluster sampling was used to identify a random sample of approximately 100 households with at least one woman of age 15 or older and at least one child under the age of five from the catchment areas of each facility. To identify these women, researchers first randomly selected five enumeration areas from the catchment areas of each of the 24 facilities using probability proportional to population size (based on the latest census estimates); in all selected enumeration areas, a household listing was conducted. From all eligible households listed, 20 households were selected for the survey.
The resulting sample is not representative at the national or regional level for three main reasons: first, geographically, the project covered only 3 regions in the country, which are on average less developed than the regions not included. Second, within regions, surveys were only conducted in communities with existing health platforms. These communities are on average slightly larger and likely also more developed than communities without such platforms. Last, within communities, the survey targeted only women with recent births, which are not representative of the larger adult female population.
Overall, surveys were administered to the officer in charge of each of the 24 health facilities and a total of 94 health workers working in maternal and child health services. Exit interviews were administered to 150 women attending ANC services and 160 caregivers of children aged under 5 attending out-patient services.
The community-based survey was administered to 109 VDC (Village Development Committee) members and 108 VSG (Village Support Group) members.
Dates of collection
Mode of data collection
A mix of quantitative and qualitative methods were employed for the baseline survey. The quantitative part of the evaluation relied on three main sources of data, while the qualitative part of the study used both focus group discussions and key informant interviews with a wide range of stakeholders to elicit their perspectives on different issues relevant to maternal and child nutrition and health.
1) Household surveys: 2,257 households, within which questionnaires were administered to two people
2) Facility-based surveys: 24 health facilities in the study area, within which questionnaires were administered to the head of the health facility, health workers and women attending Maternal and Child Health (MCH) services.
3) Community-based surveys (Village Development Committees and Village Support Groups): 109 communities (approximately five for each facility), within which questionnaires were administered to members of the committees.
1) Focus group discussions: 27 focus group discussions of approximately 5-8 participants each.
2) Key informant interviews: 20 interviews.
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Rifat Hasan, World Bank, Laura Ferguson, University of Southern California, Guenther Fink, Harvard University. The Gambia Health Results-Based Financing Impact Evaluation 2014, Baseline Survey. Ref. GMB_2014_HRBFIE-BL_v01_M. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.