Samtskhe-Javakheti Roads 2007-2012
Georgia, 2007 - 2012
National Opinion Research Center (NORC)
Created on
June 11, 2015
Last modified
June 11, 2015
Page views
3651
Download
246
Documentation in PDF
Metadata
DDI/XML
JSON
Identification
Survey ID Number
GEO_2007_MCC-SJR_v01_M
Title
Samtskhe-Javakheti Roads 2007-2012
Country
| Name | Country code |
|---|---|
| Georgia | GEO |
Study type
Independent Impact Evaluation
Abstract
The evaluation uses three methodologies to rigorously evaluate the causal impact of the program on outcomes. The first is a difference-in-difference methodology, whereby the project roads are matched to a set of similar comparison roads where no intervention has taken place. These comparison roads are chosen from a number of potential candidates using a propensity score matching technique. The difference-in-difference analysis thus compares traffic counts as well as socioeconomic outcomes for residents of communities located near the project roads to those of residents of communities located near the comparison roads. Secondly, the evaluation incorporates a continuous treatment approach. Project impact is modeled in a dose-response framework, so that communities nearer the project roads are assumed to experience greater impacts than those more distant. Finally, the evaluation estimates a matched difference-indifference model, using propensity score matching to improve the comparability between the treatment and comparison groups. Combining these three approaches allows for results from each to be compared in order to ensure a robust set of findings that is not dependent on the assumptions of one particular modeling approach.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
Individuals, households
Version
Version Description
Anonymized dataset for public distribution
Coverage
Geographic Coverage
The Samtskhe-Javakheti region
Universe
To collect the data, enumerators travelled to each settlement and worked with local authorities to identify a small group of individuals who were identified as knowledgeable about conditions in the settlement.
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| National Opinion Research Center (NORC) | University of Chicago |
Funding Agency/Sponsor
| Name | Abbreviation |
|---|---|
| Millennium Challenge Corporation | MCC |
Sampling
Sampling Procedure
The sample for the first round used the 2002 Census to identify a sampling frame of 732 settlements around either the project or comparison roads, of which 690 were surveyed. The sample size was increased for the second and third rounds, which conducted surveys in all settlements that met at least one of the following criteria: settlements along the SJ Road; settlements along comparison roads where traffic counts are conducted; settlements included in the Integrated Household Survey (IHHS) that the evaluation uses to evaluate household-level outcomes, and any other village that was included in the baseline. The second and third rounds each included 960 settlements.
Our approach to selecting the comparison roads uses the technique of Propensity Score Matching (PSM) to identify eight comparison road segments to be included in the analysis. The comparison roads were selected from an inventory of 117 road segments for which data on a variety of characteristics was available from RDMED, the Georgian government roads agency. Our application of PSM in this case is to estimate a logistic regression model of the probability that a road is part of the treatment group as a function of observable characteristics. We then calculate the predicted probability (or propensity score) that a road segment is part of the treatment group for each of the eight treatment roads and 117 potential comparison roads using these estimated regression coefficients. Finally, each of the eight treatment roads is matched to a single comparison road for which the propensity score is the closest in value from among the 117 potential comparison roads.
Our approach to selecting the comparison roads uses the technique of Propensity Score Matching (PSM) to identify eight comparison road segments to be included in the analysis. The comparison roads were selected from an inventory of 117 road segments for which data on a variety of characteristics was available from RDMED, the Georgian government roads agency. Our application of PSM in this case is to estimate a logistic regression model of the probability that a road is part of the treatment group as a function of observable characteristics. We then calculate the predicted probability (or propensity score) that a road segment is part of the treatment group for each of the eight treatment roads and 117 potential comparison roads using these estimated regression coefficients. Finally, each of the eight treatment roads is matched to a single comparison road for which the propensity score is the closest in value from among the 117 potential comparison roads.
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2007 | 2007 | Baseline |
| 2010 | 2010 | Round 2 |
| 2012 | 2012 | Round 3 |
Supervision
Miranda Berishvili, Giorgi Giorgadze, Sophia Chiburdanize, and Dea Tsartsidze
Data Collection Notes
The final round of IHHS data that was available for the evaluation was collected less than one year after the completion of construction.
Data Collectors
| Name | Abbreviation | Affiliation |
|---|---|---|
| National Opinion Research Center | NORC | University of Chicago |
Access policy
Contacts
| Name | Affiliation | |
|---|---|---|
| Monitoring & Evaluation Division | Millennium Challenge Corporation | impact-eval@mcc.gov |
Citation requirements
National Opinion Research Center. Samtskhe-Javakheti Roads Activity Impact Evaluation Final Report. 2013.
Location of Data Collection
Millennium Challenge Corporation
Archive where study is originally stored
Millennium Challenge Corporation
http://data.mcc.gov/evaluations/index.php/catalog/98
Cost: None
http://data.mcc.gov/evaluations/index.php/catalog/98
Cost: None
Metadata production
DDI Document ID
DDI_GEO_2007_MCC-SJR_v01_M
Producers
| Name | Abbreviation | Role |
|---|---|---|
| Millennium Challenge Corporation | MCC | Metadata Producer |
Date of Metadata Production
2014-06-18
DDI Document version
Version 1.0 (June 2014)
Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-GEO-GORBI-NORC-2013-v01) that was done by Millennium Challenge Corporation.
Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-GEO-GORBI-NORC-2013-v01) that was done by Millennium Challenge Corporation.