Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016
Baseline & Follow-up Surveys
Nigeria, 2014 - 2016
Get MicrodataIdentification
NGA_2014_QICGI_v01_M
Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016
Baseline & Follow-up Surveys
| Name | Country code |
|---|---|
| Nigeria | NGA |
Impact Evaluation Study
While maternal, neonatal, and child health (MNCH) outcomes are improving in Nigeria, the rate of improvement is not sufficient to meet the MDGs related to child and maternal health. Nigeria’s under-5 mortality rate, estimated to be 124 deaths per 1000 live births in 2012 is one of the highest in the World. In fact, UNICEF (2012) ranked Nigeria as the country with the 12th highest under 5 mortality rate in the world. The Nigerian Federal Ministry of Health (FMOH) is addressing these challenges by introducing important reforms and is committed to learning which of these are working and worth scaling up. Evidence on the causal impact of past and ongoing quality improvement programs is, however, lacking, and so the scope for using previous experience to reliably guide future policy and program design is limited. Assessing and improving the quality of healthcare delivery in developing countries has been recognized as a priority by the WHO and other health agencies (WHO 2006; Institute of Medicine, 2001).
In this context, the Nigerian Federal Ministry of Health proposes to experimentally evaluate variants of a healthcare management consulting intervention to enhance the quality of health care, especially maternal, newborn, and child health care. The consulting program studied in this IE aims at improving service quality and patient safety at primary healthcare centers (PHCs) by relaying information to providers and through mentoring and tutelage. Service quality and patient safeties are systemic healthcare challenges throughout Nigeria and the broader region. The goal is to impact provider knowledge and behavior, improving effort, and ultimately health outcomes, patient safety and patient satisfaction. This program is implemented jointly by the Ministry and the National Primary Healthcare Development Agency (NPHCDA).
As data sources to measure and quantify the impact, the IE will use a combination of PHC administrative data, facility-level survey data, the tools developed by the healthcare consulting firm, the SDI and SURE-P surveys, as well as additional instruments to assess the quality of care.
-
The Service Delivery Indicators (SDI) is an initiative by the World Bank, in partnership with the African Economic Research Consortium and the African Development Bank, that collects data on service delivery in schools and health facilities across Africa.
-
The SURE-P MCH Program is an ambitious initiative to tackle key supply and demand-side constraints to the effective delivery of maternal and child health services in order to improve Nigeria’s MCH outcomes. SURE-P MCH will incorporate a set of four IEs looking at various pre-identified supply and demand-side challenges. The SURE-P baseline data collection was carried out in September and October of 2013. All 80 clinics of the QE project were featured in this data collection. From this data, information on facility characteristics and staffing details are being reflected in this report.
-
As part of the quality improvement program, the healthcare management consulting firm Pharm Access Safe Care conducted a baseline quality of care assessment in the 48 clinics that comprise treatment groups A and B. The baseline assessment included 829 indicators (of which not all are applicable to the QE context). For the 24 clinics of Treatment Group A (“full treatment”), the firm also created “Quality Improvement Plans” (QIPs).
In order to track progress over time and in order to increase the statistical power of the study, the research team decided to conduct a monthly high-frequency data collection (HFDC) as a follow up instrument
The government project team contracted a healthcare management consulting firm to provide support to 80 primary healthcare facilities in six Nigerian states to meet international healthcare standards. The IE was designed to measure the effectiveness of two different levels of consulting services on healthcare quality outcomes:
- Treatment A consisted of the "full package" of consulting services, including an initial extensive quality assessment, action plans, and continuous feedback and support.
- Treatment B was "information only". The consulting firm conducted the baseline quality assessment and provided initial feedback in the form of a report on these indicators, which was presented to center staff. Treatment B did not provide hands-on tutelage throughout the quality improvement process.
- Primary Health Care Facilities
- Patients
- Primary Health Care Facility Health Workers.
Version
- v0.1: Edited, anonymous dataset for public distribution.
Scope
The scope of the study includes:
- Facility: General facility information, infrastructure, availability of equipment, materials, drugs, and supplies
- Staff roster: List of all health workers by cadre type
- Clinical knowledge assessment: Clinical knowledge using 5 medical vignettes + 2 vignettes for maternal & newborn complications
- Public expenditure: Collects receipts and spending (monetary and in-kind) by health facilities
- Exit module: User satisfaction, socio-demographic characteristics & payments.
Coverage
Six Nigerian states: Anambra, Bauchi, Cross River, Ekiti, Kebbi and Niger.
Producers and sponsors
| Name | Affiliation |
|---|---|
| David Evans | World Bank |
| Mario Macis | John Hopkins University |
| Felipe Dunsch | World Bank |
| Name | Affiliation | Role |
|---|---|---|
| Ezinne Eze-Ajoku | Harvard University | Advisor, Quality Measurement and Evaluation |
| Qiao Wang | World Bank | Research Assistant |
| Name |
|---|
| Bill and Melinda Gates Foundation |
Sampling
The sampling frame for this impact evaluation consists of all 80 PHCs in the 6 states that are being covered by the project.
RANDOMIZATION
Randomization of PHCs into Treatment A, Treatment B, and control followed these steps:
- We assigned a random number to each of the 80 PHCs in our population.
- These numbers were ranked in ascending order.
- We ranked these numbers within each cluster (of 4 PHCs around a referral hospital).
- The PHC with the highest random number in each was assigned to Treatment A, the second highest number was assigned to Treatment B, and the third highest number was assigned to the control group. This created groups of 20 for each treatment arm.
- Lastly, the 20 PHCs with the fourth highest numbers were ranked again. Then, the 4 highest numbers were allocated to Treatment A, numbers 5-8 went to Treatment B, and the rest was assigned to the control group.
This resulted in the following group sizes:
- Treatment A: 24
- Treatment B: 24
- Control group: 32
Out of 80 primary healthcare facilities, the response rates for:
- round 1: 100%
- round 2: 100%
- round 3: 100%
- round 4: 100%
- round 5: 89%
- round 6: 100%
- round 7: 100%
Survey instrument
As data sources, the IE will use a combination of PHC administrative data, facility level survey data, the tools developed by the healthcare consulting firm, the SDI and SURE-P surveys, as well as additional instruments to assess the quality of care.
Data collection
| Start | End | Cycle |
|---|---|---|
| 2014-07-07 | 2014-07-31 | Round 1 |
| 2014-08-15 | 2014-09-04 | Round 2 |
| 2014-09-19 | 2014-10-16 | Round 3 |
| 2014-10-23 | 2014-11-13 | Round 4 |
| 2014-11-27 | 2014-12-18 | Round 5 |
| 2015-01-14 | 2015-02-11 | Round 6 |
| 2016-03-16 | 2016-05-20 | Round 7 |
- Face-to-face [f2f]
Data Access
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Example:
David Evans (World Bank), Mario Macis (John Hopkins University), Felipe Dunsch (World Bank). Nigeria - Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016, Baseline & Follow-up Surveys (QICGI 2014-2016). Ref: NGA_2014_QICGI_v01_M. Downloaded from [uri] on [date].
Disclaimer and copyrights
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Metadata production
DDI_NGA_2014_QICGI_v01_M_WB
| Name | Affiliation | Role |
|---|---|---|
| Development Data Group | World Bank | Documentation of the study |
2023-07-07
Metadata version
Version 01 (2023-07-07)