Home / Central Data Catalog / MCC / RWA_2011_MCC-TI_V01_M
MCC

Threshold Impact 2011-2012

Rwanda, 2011 - 2012
Get Microdata
Reference ID
RWA_2011_MCC-TI_v01_M
Producer(s)
Mathematica Policy Research
Collection(s)
Millennium Challenge Corporation (MCC)
Metadata
Documentation in PDF DDI/XML JSON
Created on
Jun 08, 2015
Last modified
Sep 21, 2021
Page views
28723
Downloads
1783
  • Identification
  • Version
  • Coverage
  • Producers and sponsors
  • Sampling
  • Survey instrument
  • Data collection
  • Data processing
  • Data appraisal
  • Access policy
  • Data Access
  • Contacts
  • Metadata production

    • Identification

    Survey ID number

    RWA_2011_MCC-TI_v01_M
    Title

    Threshold Impact 2011-2012
    Country/Economy
    Name Country code
    Rwanda RWA
    Study type

    Independent Impact Evaluation
    Abstract
    Our mixed-methods study—combining experimental, quasi-experimental, descriptive, and qualitative methods—assesses four of the five RTP components. Specifically, the components covered by this study are (1) Strengthening the Inspectorate Services of the RNP, (2) Strengthening the Rule of Law for Policy Reform, (3) Media Strengthening, and (4) Strengthening Civic Participation. Collectively, these four components account for over 85 percent of the RTP’s total program implementation budget. To determine the scope of the evaluation, we first sought to identify implemented activities within a component that could potentially produce a measurable effect within the study’s timeframe. For example, in coordination with MCC, we decided not to study effects of the Media Strengthening component’s assistance to media associations, because only a small part of the original activity plan for these associations was implemented. Next, we examined each activity to determine whether it would be possible to obtain data that would generate meaningful evidence on the program’s effects. We sought to collect information about either a comparison group similar to those who received the program or the prior status of program beneficiaries before activities began. Several RTP activities did not meet this requirement. For example, the RNP Strengthening and Media Strengthening components provided training and technical assistance to a large number of journalists and RNP officers before our evaluation was initiated, precluding the collection of baseline data or the identification of a comparison group. Likewise, activities that were nationwide in scope, such as the legislative policy reform initiatives supported by the Strengthening Rule of Law component or efforts to support passage of a national media reform law as part of the Media Strengthening component, were not included in the evaluation due to the absence of baseline data or an identifiable comparison group. It is possible that the RTP may have had indirect, longer-term impacts on national policies and institutions that fall beyond the scope of our evaluation designs.
    Kind of Data

    Sample survey data [ssd]
    Unit of Analysis

    Individuals

    Version

    Version Description

    Anonymized dataset for public distribution

    Coverage

    Geographic Coverage

    National
    Universe

    Program implementers, CSO leaders, local government officials, and RNP officers

    Producers and sponsors

    Primary investigators
    Name
    Mathematica Policy Research
    Funding Agency/Sponsor
    Name
    Millennium Challenge Corporation

    Sampling

    Sampling Procedure

    The baseline and follow-up surveys each had a target sample size of 10,000 respondents. Each survey included a different sample of respondents (i.e. data is cross-sectional, not longitudinal). To ensure that the sample was representative and widely distributed across the country, sample targets were calculated at the sector level. Using the most recent national census, we calculated the proportion of the national population within each sector. We determined the number of individuals to survey in each sector by applying that proportion to our targeted sample size of 10,000. The survey sample included all 416 sectors in Rwanda. Within each sector, households were selected using a random walk method, and one adult respondent (age 16 or older) was selected at random within each household.
    Response Rate

    Baseline: 96.3%
    Follow-up: 97.4%

    Survey instrument

    Questionnaires

    Citizen Survey Questionnaire Design: the citizen survey questionnaire focused on activities implemented under three components of the RTP: RNP Strengthening, Media Strengthening, and Strengthening Civic Participation.

    Data collection

    Dates of Data Collection
    Start End Cycle
    2011-01-15 2011-02-08 Baseline
    2012 2012 Follow-up
    Data Collectors
    Name
    Roddom Consult Ltd.
    Data Collection Notes

    The baseline and follow-up surveys each had a target sample size of 10,000 respondents. Each survey included a different sample of respondents (i.e. data is cross-sectional, not longitudinal). The baseline survey had a target sample size of 10,000 respondents. To ensure that the sample was representative and widely distributed across the country, sample targets were calculated at the sector level. Using the most recent national census, we calculated the proportion of the national population within each sector and . We determined the number of individuals to survey in each sector by applying that proportion to our targeted sample size of 10,000. The survey sample included all 416 sectors in Rwanda. Within each sector, households were selected using a random walk method, and one adult respondent (age 16 or older) was selected at random within each household.

    Data processing

    Data Editing

    We used a data cleaning process designed to resolve inconsistencies in survey responses, survey question skip-patterns, and out-of-range data. These cleaning measures were implemented via SAS statistical software (version 9). To create a final data file for analysis and public use, we consulted with MCC regarding guidelines to ensure that all respondent personally identifiable information (PII) would be protected, primarily by destroying records of respondent names and by grouping outlier survey responses with potentially identifying information (such as very high age or income levels) into a uniform upper limit, or “top code.”

    Data appraisal

    Estimates of Sampling Error

    The standard errors of the impact estimates were corrected for the possibility of correlations among individuals' outcomes within sectors.

    Access policy

    Location of Data Collection

    Millennium Challenge Corporation
    Archive where study is originally stored

    Millennium Challenge Corporation
    http://data.mcc.gov/evaluations/index.php/catalog/117
    Cost: None

    Data Access

    Citation requirements

    Rwanda Threshold Program Evaluation Citizen Survey, Mathematica Policy Research (2011 and 2012).

    Contacts

    Contacts
    Name Affiliation Email
    Monitoring & Evaluation Division Millennium Challenge Corporation impact-eval@mcc.gov

    Metadata production

    DDI Document ID

    DDI_RWA_2011_MCC-TI_v01_M
    Producers
    Name Role
    Millennium Challenge Corporation Metadata Producer
    Date of Metadata Production

    2014-09-17

    Metadata version

    DDI Document version

    Version 1.0 (October 2014)
    Version 2.0 (May 2015). Edited version based on Version 01 (DDC-MCC-RWA-THRESHOLD-MPR-2014-v1.1) that was done by Millennium Challenge Corporation.
    Back to Catalog

    This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser. To learn more about cookies, click here.