Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016
Baseline & Follow-up Surveys
Nigeria, 2014 - 2016
Get Microdata
Reference ID
NGA_2014_QICGI_v01_M
Producer(s)
David Evans, Mario Macis, Felipe Dunsch
Collection(s)
Metadata
Created on
Jul 07, 2023
Last modified
Jul 07, 2023
Page views
6202
Downloads
176
Identification
Survey ID Number
NGA_2014_QICGI_v01_M
Title
Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016
Subtitle
Baseline & Follow-up Surveys
Country/Economy
| Name | Country code |
|---|---|
| Nigeria | NGA |
Study type
Impact Evaluation Study
Series Information
While maternal, neonatal, and child health (MNCH) outcomes are improving in Nigeria, the rate of improvement is not sufficient to meet the MDGs related to child and maternal health. Nigeria’s under-5 mortality rate, estimated to be 124 deaths per 1000 live births in 2012 is one of the highest in the World. In fact, UNICEF (2012) ranked Nigeria as the country with the 12th highest under 5 mortality rate in the world. The Nigerian Federal Ministry of Health (FMOH) is addressing these challenges by introducing important reforms and is committed to learning which of these are working and worth scaling up. Evidence on the causal impact of past and ongoing quality improvement programs is, however, lacking, and so the scope for using previous experience to reliably guide future policy and program design is limited. Assessing and improving the quality of healthcare delivery in developing countries has been recognized as a priority by the WHO and other health agencies (WHO 2006; Institute of Medicine, 2001).
In this context, the Nigerian Federal Ministry of Health proposes to experimentally evaluate variants of a healthcare management consulting intervention to enhance the quality of health care, especially maternal, newborn, and child health care. The consulting program studied in this IE aims at improving service quality and patient safety at primary healthcare centers (PHCs) by relaying information to providers and through mentoring and tutelage. Service quality and patient safeties are systemic healthcare challenges throughout Nigeria and the broader region. The goal is to impact provider knowledge and behavior, improving effort, and ultimately health outcomes, patient safety and patient satisfaction. This program is implemented jointly by the Ministry and the National Primary Healthcare Development Agency (NPHCDA).
As data sources to measure and quantify the impact, the IE will use a combination of PHC administrative data, facility-level survey data, the tools developed by the healthcare consulting firm, the SDI and SURE-P surveys, as well as additional instruments to assess the quality of care.
- The Service Delivery Indicators (SDI) is an initiative by the World Bank, in partnership with the African Economic Research Consortium and the African Development Bank, that collects data on service delivery in schools and health facilities across Africa.
- The SURE-P MCH Program is an ambitious initiative to tackle key supply and demand-side constraints to the effective delivery of maternal and child health services in order to improve Nigeria’s MCH outcomes. SURE-P MCH will incorporate a set of four IEs looking at various pre-identified supply and demand-side challenges. The SURE-P baseline data collection was carried out in September and October of 2013. All 80 clinics of the QE project were featured in this data collection. From this data, information on facility characteristics and staffing details are being reflected in this report.
- As part of the quality improvement program, the healthcare management consulting firm Pharm Access Safe Care conducted a baseline quality of care assessment in the 48 clinics that comprise treatment groups A and B. The baseline assessment included 829 indicators (of which not all are applicable to the QE context). For the 24 clinics of Treatment Group A (“full treatment”), the firm also created “Quality Improvement Plans” (QIPs).
In order to track progress over time and in order to increase the statistical power of the study, the research team decided to conduct a monthly high-frequency data collection (HFDC) as a follow up instrument
In this context, the Nigerian Federal Ministry of Health proposes to experimentally evaluate variants of a healthcare management consulting intervention to enhance the quality of health care, especially maternal, newborn, and child health care. The consulting program studied in this IE aims at improving service quality and patient safety at primary healthcare centers (PHCs) by relaying information to providers and through mentoring and tutelage. Service quality and patient safeties are systemic healthcare challenges throughout Nigeria and the broader region. The goal is to impact provider knowledge and behavior, improving effort, and ultimately health outcomes, patient safety and patient satisfaction. This program is implemented jointly by the Ministry and the National Primary Healthcare Development Agency (NPHCDA).
As data sources to measure and quantify the impact, the IE will use a combination of PHC administrative data, facility-level survey data, the tools developed by the healthcare consulting firm, the SDI and SURE-P surveys, as well as additional instruments to assess the quality of care.
- The Service Delivery Indicators (SDI) is an initiative by the World Bank, in partnership with the African Economic Research Consortium and the African Development Bank, that collects data on service delivery in schools and health facilities across Africa.
- The SURE-P MCH Program is an ambitious initiative to tackle key supply and demand-side constraints to the effective delivery of maternal and child health services in order to improve Nigeria’s MCH outcomes. SURE-P MCH will incorporate a set of four IEs looking at various pre-identified supply and demand-side challenges. The SURE-P baseline data collection was carried out in September and October of 2013. All 80 clinics of the QE project were featured in this data collection. From this data, information on facility characteristics and staffing details are being reflected in this report.
- As part of the quality improvement program, the healthcare management consulting firm Pharm Access Safe Care conducted a baseline quality of care assessment in the 48 clinics that comprise treatment groups A and B. The baseline assessment included 829 indicators (of which not all are applicable to the QE context). For the 24 clinics of Treatment Group A (“full treatment”), the firm also created “Quality Improvement Plans” (QIPs).
In order to track progress over time and in order to increase the statistical power of the study, the research team decided to conduct a monthly high-frequency data collection (HFDC) as a follow up instrument
Abstract
The Nigerian Government has prioritized improving the quality of healthcare delivery throughout its care facilities. There are multiple facets to implementing successful quality improvement processes, including providing a transparent system with quantifiable outcome measures and ensuring workforce engagement for healthcare providers.
The government project team contracted a healthcare management consulting firm to provide support to 80 primary healthcare facilities in six Nigerian states to meet international healthcare standards. The IE was designed to measure the effectiveness of two different levels of consulting services on healthcare quality outcomes:
- Treatment A consisted of the "full package" of consulting services, including an initial extensive quality assessment, action plans, and continuous feedback and support.
- Treatment B was "information only". The consulting firm conducted the baseline quality assessment and provided initial feedback in the form of a report on these indicators, which was presented to center staff. Treatment B did not provide hands-on tutelage throughout the quality improvement process.
The government project team contracted a healthcare management consulting firm to provide support to 80 primary healthcare facilities in six Nigerian states to meet international healthcare standards. The IE was designed to measure the effectiveness of two different levels of consulting services on healthcare quality outcomes:
- Treatment A consisted of the "full package" of consulting services, including an initial extensive quality assessment, action plans, and continuous feedback and support.
- Treatment B was "information only". The consulting firm conducted the baseline quality assessment and provided initial feedback in the form of a report on these indicators, which was presented to center staff. Treatment B did not provide hands-on tutelage throughout the quality improvement process.
Unit of Analysis
- Primary Health Care Facilities
- Patients
- Primary Health Care Facility Health Workers.
- Patients
- Primary Health Care Facility Health Workers.
Version
Version Description
- v0.1: Edited, anonymous dataset for public distribution.
Scope
Notes
The scope of the study includes:
- Facility: General facility information, infrastructure, availability of equipment, materials, drugs, and supplies
- Staff roster: List of all health workers by cadre type
- Clinical knowledge assessment: Clinical knowledge using 5 medical vignettes + 2 vignettes for maternal & newborn complications
- Public expenditure: Collects receipts and spending (monetary and in-kind) by health facilities
- Exit module: User satisfaction, socio-demographic characteristics & payments.
- Facility: General facility information, infrastructure, availability of equipment, materials, drugs, and supplies
- Staff roster: List of all health workers by cadre type
- Clinical knowledge assessment: Clinical knowledge using 5 medical vignettes + 2 vignettes for maternal & newborn complications
- Public expenditure: Collects receipts and spending (monetary and in-kind) by health facilities
- Exit module: User satisfaction, socio-demographic characteristics & payments.
Coverage
Geographic Coverage
Six Nigerian states: Anambra, Bauchi, Cross River, Ekiti, Kebbi and Niger.
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| David Evans | World Bank |
| Mario Macis | John Hopkins University |
| Felipe Dunsch | World Bank |
Producers
| Name | Affiliation | Role |
|---|---|---|
| Ezinne Eze-Ajoku | Harvard University | Advisor, Quality Measurement and Evaluation |
| Qiao Wang | World Bank | Research Assistant |
Funding Agency/Sponsor
| Name | Abbreviation |
|---|---|
| Bill and Melinda Gates Foundation | Gates Foundation |
Sampling
Sampling Procedure
The sampling frame for this impact evaluation consists of all 80 PHCs in the 6 states that are being covered by the project.
RANDOMIZATION
Randomization of PHCs into Treatment A, Treatment B, and control followed these steps:
1. We assigned a random number to each of the 80 PHCs in our population.
2. These numbers were ranked in ascending order.
3. We ranked these numbers within each cluster (of 4 PHCs around a referral hospital).
4. The PHC with the highest random number in each was assigned to Treatment A, the second highest number was assigned to Treatment B, and the third highest number was assigned to the control group. This created groups of 20 for each treatment arm.
5. Lastly, the 20 PHCs with the fourth highest numbers were ranked again. Then, the 4 highest numbers were allocated to Treatment A, numbers 5-8 went to Treatment B, and the rest was assigned to the control group.
This resulted in the following group sizes:
- Treatment A: 24
- Treatment B: 24
- Control group: 32
RANDOMIZATION
Randomization of PHCs into Treatment A, Treatment B, and control followed these steps:
1. We assigned a random number to each of the 80 PHCs in our population.
2. These numbers were ranked in ascending order.
3. We ranked these numbers within each cluster (of 4 PHCs around a referral hospital).
4. The PHC with the highest random number in each was assigned to Treatment A, the second highest number was assigned to Treatment B, and the third highest number was assigned to the control group. This created groups of 20 for each treatment arm.
5. Lastly, the 20 PHCs with the fourth highest numbers were ranked again. Then, the 4 highest numbers were allocated to Treatment A, numbers 5-8 went to Treatment B, and the rest was assigned to the control group.
This resulted in the following group sizes:
- Treatment A: 24
- Treatment B: 24
- Control group: 32
Response Rate
Out of 80 primary healthcare facilities, the response rates for:
- round 1: 100%
- round 2: 100%
- round 3: 100%
- round 4: 100%
- round 5: 89%
- round 6: 100%
- round 7: 100%
- round 1: 100%
- round 2: 100%
- round 3: 100%
- round 4: 100%
- round 5: 89%
- round 6: 100%
- round 7: 100%
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2014-07-07 | 2014-07-31 | Round 1 |
| 2014-08-15 | 2014-09-04 | Round 2 |
| 2014-09-19 | 2014-10-16 | Round 3 |
| 2014-10-23 | 2014-11-13 | Round 4 |
| 2014-11-27 | 2014-12-18 | Round 5 |
| 2015-01-14 | 2015-02-11 | Round 6 |
| 2016-03-16 | 2016-05-20 | Round 7 |
Data Collection Mode
Face-to-face [f2f]
Questionnaires
Questionnaires
As data sources, the IE will use a combination of PHC administrative data, facility level survey data, the tools developed by the healthcare consulting firm, the SDI and SURE-P surveys, as well as additional instruments to assess the quality of care.
Access policy
Confidentiality
Citation requirements
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Example:
David Evans (World Bank), Mario Macis (John Hopkins University), Felipe Dunsch (World Bank). Nigeria - Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016, Baseline & Follow-up Surveys (QICGI 2014-2016). Ref: NGA_2014_QICGI_v01_M. Downloaded from [uri] on [date].
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Example:
David Evans (World Bank), Mario Macis (John Hopkins University), Felipe Dunsch (World Bank). Nigeria - Quality Improvement and Clinical Governance Initiative - Piloting Quality Improvement Packages in Primary Care Centers Impact Evaluation 2014-2016, Baseline & Follow-up Surveys (QICGI 2014-2016). Ref: NGA_2014_QICGI_v01_M. Downloaded from [uri] on [date].
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Metadata production
DDI Document ID
DDI_NGA_2014_QICGI_v01_M_WB
Producers
| Name | Abbreviation | Affiliation | Role |
|---|---|---|---|
| Development Data Group | DECDG | World Bank | Documentation of the study |
Date of Metadata Production
2023-07-07
DDI Document version
Version 01 (2023-07-07)