Impact Evaluation of the Upgrading of Informal Settlements Programme 2010
South Africa, 2010
Sebastian Martinez, Arianna Legovini, Nandini Krishnan, Aidan Coville
Identification
IDNO
ZAF_2010_UISP_v01_M
Title
Impact Evaluation of the Upgrading of Informal Settlements Programme 2010
Countries
| Name | Code |
|---|---|
| South Africa | ZAF |
Study notes
In 2004, South African National Department of Human Settlements (NDOHS) launched Upgrading of Informal Settlements Programme with the goal to facilitate structured improvements of informal settlements and make beneficiaries' living conditions better.
With the technical assistance from the World Bank, NDOHS conducted a series of impact evaluations to assess the effects of the Upgrading of Informal Settlements Programme (UISP) interventions in Free State, Limpopo and Gauteng Provinces. The research was designed to reliably identify causal links between the rollout of UISP and the outcomes of interest driven by policy prescriptions (as well as broader concerns) for the program.
The study areas chosen allow for four comparisons. In Limpopo, the design allows for estimating the impact of relocating households from an informal settlement with no services (Eastern Disteneng), to a formalized greenfield site with comprehensive services and supporting community facilities (Extension 44/76). Household level survey data was collected from a sample of 432 households from Extension 44/76 (treatment group) and 726 households in Disteneng (control group).
In Free State, the relative impacts of being provided with a fully serviced stand (Bloemside) to being provided with a partially serviced subsidized house on the site of the original informal dwelling (Grasslands) are compared. By exploiting the phased approach to the study, estimates can also be made on the long-term impacts of being provided with a subsidized home, by comparing Grasslands II residents who have been living in their upgraded homes for three or four years to the neighboring Grasslands III residents who have had their subsidized homes for one to two years. Researchers surveyed 1,014 households: 370 households from Grasslands II, 289 from Grasslands III and 355 from Bloemside.
In Gauteng, the impact of fully upgrading an area compared to a partial upgrade (less than 50% households receiving housing and electricity) can be estimated. The study exploits the phased roll out of Extensions upgrades to compare the extensively upgraded area of Extension 1 (398 household surveyed) to the partially upgraded areas of Extensions 2 and 3 where 905 households were surveyed.
Datasets from Free State and Limpopo provinces are documented here.
With the technical assistance from the World Bank, NDOHS conducted a series of impact evaluations to assess the effects of the Upgrading of Informal Settlements Programme (UISP) interventions in Free State, Limpopo and Gauteng Provinces. The research was designed to reliably identify causal links between the rollout of UISP and the outcomes of interest driven by policy prescriptions (as well as broader concerns) for the program.
The study areas chosen allow for four comparisons. In Limpopo, the design allows for estimating the impact of relocating households from an informal settlement with no services (Eastern Disteneng), to a formalized greenfield site with comprehensive services and supporting community facilities (Extension 44/76). Household level survey data was collected from a sample of 432 households from Extension 44/76 (treatment group) and 726 households in Disteneng (control group).
In Free State, the relative impacts of being provided with a fully serviced stand (Bloemside) to being provided with a partially serviced subsidized house on the site of the original informal dwelling (Grasslands) are compared. By exploiting the phased approach to the study, estimates can also be made on the long-term impacts of being provided with a subsidized home, by comparing Grasslands II residents who have been living in their upgraded homes for three or four years to the neighboring Grasslands III residents who have had their subsidized homes for one to two years. Researchers surveyed 1,014 households: 370 households from Grasslands II, 289 from Grasslands III and 355 from Bloemside.
In Gauteng, the impact of fully upgrading an area compared to a partial upgrade (less than 50% households receiving housing and electricity) can be estimated. The study exploits the phased roll out of Extensions upgrades to compare the extensively upgraded area of Extension 1 (398 household surveyed) to the partially upgraded areas of Extensions 2 and 3 where 905 households were surveyed.
Datasets from Free State and Limpopo provinces are documented here.
Kind of data
Sample survey data [ssd]
Version
Version
v01
Edited, anonymous datasets for public distribution.
Edited, anonymous datasets for public distribution.
Coverage
Geographic coverage
Limpopo, Free State and Gauteng provinces.
Unit of analysis
- Households,
- Individuals.
- Individuals.
Producers and sponsors
Authoring entity
| Name | Affiliation |
|---|---|
| Sebastian Martinez | Inter-American Development Bank |
| Arianna Legovini | World Bank |
| Nandini Krishnan | World Bank |
| Aidan Coville | World Bank |
Producer(s)
| Name |
|---|
| Mulalo Muthige |
Funding agencies
| Name | Abbreviation |
|---|---|
| Spanish Impact Evaluation Fund, World Bank | SIEF |
Sampling
Sampling procedure
Since the intention of this pilot impact evaluation was not to conduct a nationally representative study, the sampling strategy aimed at maximizing the internal validity of the study by ensuring that the control and treatment groups were comparable, where external validity was a secondary consideration. As such, the representivity of the results when scaling up to the provincial or national level needs to be done with care.
Detailed information about sampling methodology is available in "Measuring Success in Human Settlements Development" report (p.31-36) in external resources.
Detailed information about sampling methodology is available in "Measuring Success in Human Settlements Development" report (p.31-36) in external resources.
Data Collection
Dates of collection
| Start | End |
|---|---|
| 2010-03 | 2010-06 |
Mode of data collection
Face-to-face [f2f]
Data collection supervision
To ensure accuracy of the data collected, a rigorous quality check and supervision regime was implemented which included the following activities:
- Field visits were conducted by NDOHS and World Bank officials on a weekly basis to ensure field procedures were being followed and data were being collected in a professional and consistent manner;
- Call backs were conducted on a random set of households to independently verify that the information that was collected was correct and accurate;
- Manual quality checks of questionnaires were conducted by field supervisors, project managers, NDOHS and World Bank staff to assess the quality of questionnaires and conduct call backs/follow ups where necessary;
- A rigorous supervision structure was implemented. Field supervisors were in charge of 4-5 field workers, with a provincial coordinator overseeing the field supervisors;
- A sample of 10% captured questionnaires was double-checked for accuracy of the data capturing process.
While a number of challenges were experienced in the field which resulted in non-responses and quality concerns, all of these stringent measures were put in place to ensure the reliability and validity of collected data which supports and improves the confidence of the results that come from these data.
- Field visits were conducted by NDOHS and World Bank officials on a weekly basis to ensure field procedures were being followed and data were being collected in a professional and consistent manner;
- Call backs were conducted on a random set of households to independently verify that the information that was collected was correct and accurate;
- Manual quality checks of questionnaires were conducted by field supervisors, project managers, NDOHS and World Bank staff to assess the quality of questionnaires and conduct call backs/follow ups where necessary;
- A rigorous supervision structure was implemented. Field supervisors were in charge of 4-5 field workers, with a provincial coordinator overseeing the field supervisors;
- A sample of 10% captured questionnaires was double-checked for accuracy of the data capturing process.
While a number of challenges were experienced in the field which resulted in non-responses and quality concerns, all of these stringent measures were put in place to ensure the reliability and validity of collected data which supports and improves the confidence of the results that come from these data.
Questionnaires
Household Questionnaire consisted of 14 modules and required approximately two hours to complete. Trained enumerators administered the questionnaire.
Data collector(s)
| Name |
|---|
| Vari Consulting |
Data access
Access conditions
Public use files
Citation requirements
Use of the dataset must be acknowledged using a citation which would include:
- the identification of the primary investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download.
Example:
Sebastian Martinez, Inter-American Development Bank; Arianna Legovini, World Bank; Nandini Krishnan, World Bank; Aidan Coville, World Bank. South Africa - Impact Evaluation of the Upgrading of Informal Settlements Programme (UISP)2010. Ref. ZAF_2010_UISP_v01_M. Dataset downloaded from [URL] on [date].
- the identification of the primary investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download.
Example:
Sebastian Martinez, Inter-American Development Bank; Arianna Legovini, World Bank; Nandini Krishnan, World Bank; Aidan Coville, World Bank. South Africa - Impact Evaluation of the Upgrading of Informal Settlements Programme (UISP)2010. Ref. ZAF_2010_UISP_v01_M. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Contacts
Contact(s)
| Name | Affiliation | |
|---|---|---|
| Aidan Coville | World Bank | acoville@worldbank.org |
Metadata production
IDNo
DDI_ZAF_2010_UISP_v01_M
Producers
| Name | Abbreviation | Affiliation | Role |
|---|---|---|---|
| Development Data Group | DECDG | The World Bank | Documentation of the DDI |
Production date
2012-05-16
Version
v01
First version of metadata documentation (May 2012)
First version of metadata documentation (May 2012)