Samtskhe-Javakheti Roads 2007-2012
Georgia, 2007 - 2012
National Opinion Research Center (NORC)
Identification
IDNO
GEO_2007_MCC-SJR_v01_M
Title
Samtskhe-Javakheti Roads 2007-2012
Countries
| Name | Code |
|---|---|
| Georgia | GEO |
Study notes
The evaluation uses three methodologies to rigorously evaluate the causal impact of the program on outcomes. The first is a difference-in-difference methodology, whereby the project roads are matched to a set of similar comparison roads where no intervention has taken place. These comparison roads are chosen from a number of potential candidates using a propensity score matching technique. The difference-in-difference analysis thus compares traffic counts as well as socioeconomic outcomes for residents of communities located near the project roads to those of residents of communities located near the comparison roads. Secondly, the evaluation incorporates a continuous treatment approach. Project impact is modeled in a dose-response framework, so that communities nearer the project roads are assumed to experience greater impacts than those more distant. Finally, the evaluation estimates a matched difference-indifference model, using propensity score matching to improve the comparability between the treatment and comparison groups. Combining these three approaches allows for results from each to be compared in order to ensure a robust set of findings that is not dependent on the assumptions of one particular modeling approach.
Kind of data
Sample survey data [ssd]
Version
Version
Anonymized dataset for public distribution
Coverage
Geographic coverage
The Samtskhe-Javakheti region
Unit of analysis
Individuals, households
Universe
To collect the data, enumerators travelled to each settlement and worked with local authorities to identify a small group of individuals who were identified as knowledgeable about conditions in the settlement.
Producers and sponsors
Authoring entity
| Name | Affiliation |
|---|---|
| National Opinion Research Center (NORC) | University of Chicago |
Funding agencies
| Name | Abbreviation |
|---|---|
| Millennium Challenge Corporation | MCC |
Sampling
Sampling procedure
The sample for the first round used the 2002 Census to identify a sampling frame of 732 settlements around either the project or comparison roads, of which 690 were surveyed. The sample size was increased for the second and third rounds, which conducted surveys in all settlements that met at least one of the following criteria: settlements along the SJ Road; settlements along comparison roads where traffic counts are conducted; settlements included in the Integrated Household Survey (IHHS) that the evaluation uses to evaluate household-level outcomes, and any other village that was included in the baseline. The second and third rounds each included 960 settlements.
Our approach to selecting the comparison roads uses the technique of Propensity Score Matching (PSM) to identify eight comparison road segments to be included in the analysis. The comparison roads were selected from an inventory of 117 road segments for which data on a variety of characteristics was available from RDMED, the Georgian government roads agency. Our application of PSM in this case is to estimate a logistic regression model of the probability that a road is part of the treatment group as a function of observable characteristics. We then calculate the predicted probability (or propensity score) that a road segment is part of the treatment group for each of the eight treatment roads and 117 potential comparison roads using these estimated regression coefficients. Finally, each of the eight treatment roads is matched to a single comparison road for which the propensity score is the closest in value from among the 117 potential comparison roads.
Our approach to selecting the comparison roads uses the technique of Propensity Score Matching (PSM) to identify eight comparison road segments to be included in the analysis. The comparison roads were selected from an inventory of 117 road segments for which data on a variety of characteristics was available from RDMED, the Georgian government roads agency. Our application of PSM in this case is to estimate a logistic regression model of the probability that a road is part of the treatment group as a function of observable characteristics. We then calculate the predicted probability (or propensity score) that a road segment is part of the treatment group for each of the eight treatment roads and 117 potential comparison roads using these estimated regression coefficients. Finally, each of the eight treatment roads is matched to a single comparison road for which the propensity score is the closest in value from among the 117 potential comparison roads.
Data Collection
Dates of collection
| Start | End | Cycle |
|---|---|---|
| 2007 | 2007 | Baseline |
| 2010 | 2010 | Round 2 |
| 2012 | 2012 | Round 3 |
Data collection supervision
Miranda Berishvili, Giorgi Giorgadze, Sophia Chiburdanize, and Dea Tsartsidze
Data collector(s)
| Name | Abbreviation | Affiliation |
|---|---|---|
| National Opinion Research Center | NORC | University of Chicago |
Data access
Citation requirements
National Opinion Research Center. Samtskhe-Javakheti Roads Activity Impact Evaluation Final Report. 2013.
Data collection locations
Millennium Challenge Corporation
Original archive where collection stored
Millennium Challenge Corporation
http://data.mcc.gov/evaluations/index.php/catalog/98
Cost: None
http://data.mcc.gov/evaluations/index.php/catalog/98
Cost: None
Contacts
Contact(s)
| Name | Affiliation | |
|---|---|---|
| Monitoring & Evaluation Division | Millennium Challenge Corporation | impact-eval@mcc.gov |
Metadata production
IDNo
DDI_GEO_2007_MCC-SJR_v01_M
Producers
| Name | Abbreviation | Role |
|---|---|---|
| Millennium Challenge Corporation | MCC | Metadata Producer |
Production date
2014-06-18
Version
Version 1.0 (June 2014)
Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-GEO-GORBI-NORC-2013-v01) that was done by Millennium Challenge Corporation.
Version 2.0 (April 2015). Edited version based on Version 01 (DDI-MCC-GEO-GORBI-NORC-2013-v01) that was done by Millennium Challenge Corporation.