STEP Skills Measurement Household Survey 2013 (Wave 2)
Macedonia, FYR, 2013
Get Microdata
Reference ID
MKD_2013_STEP-HH_v01_M
Producer(s)
World Bank
Collection(s)
Metadata
Created on
Apr 06, 2016
Last modified
Apr 06, 2016
Page views
38056
Downloads
5103
Identification
Survey ID Number
MKD_2013_STEP-HH_v01_M
Title
STEP Skills Measurement Household Survey 2013 (Wave 2)
Country/Economy
| Name | Country code |
|---|---|
| Macedonia, FYR | MKD |
Study type
Other Household Survey
Series Information
The STEP project consists of Household Surveys collection and Employer Surveys collection.
These surveys are part of the STEP Household Surveys collection.
So far, two waves have been implemented in 12 countries. The third wave is under preparation.
The first wave started in September 2011 and was completed in December 2013. Wave 1 countries are: Bolivia, Colombia, Sri Lanka, Lao PDR, Vietnam, the Yunnan Province in China, Ghana, and Ukraine.
The second wave started in August 2012 and was completed in June 2014. Wave 2 countries are: Armenia, Georgia, Macedonia, and Kenya.
These surveys are part of the STEP Household Surveys collection.
So far, two waves have been implemented in 12 countries. The third wave is under preparation.
The first wave started in September 2011 and was completed in December 2013. Wave 1 countries are: Bolivia, Colombia, Sri Lanka, Lao PDR, Vietnam, the Yunnan Province in China, Ghana, and Ukraine.
The second wave started in August 2012 and was completed in June 2014. Wave 2 countries are: Armenia, Georgia, Macedonia, and Kenya.
Abstract
The STEP (Skills Toward Employment and Productivity) Measurement program is the first ever initiative to generate internationally comparable data on skills available in developing countries. The program implements standardized surveys to gather information on the supply and distribution of skills and the demand for skills in labor market of low-income countries.
The uniquely-designed Household Survey includes modules that measure the cognitive skills (reading, writing and numeracy), socio-emotional skills (personality, behavior and preferences) and job-specific skills (subset of transversal skills with direct job relevance) of a representative sample of adults aged 15 to 64 living in urban areas, whether they work or not. The cognitive skills module also incorporates a direct assessment of reading literacy based on the Survey of Adults Skills instruments. Modules also gather information about family, health and language.
The uniquely-designed Household Survey includes modules that measure the cognitive skills (reading, writing and numeracy), socio-emotional skills (personality, behavior and preferences) and job-specific skills (subset of transversal skills with direct job relevance) of a representative sample of adults aged 15 to 64 living in urban areas, whether they work or not. The cognitive skills module also incorporates a direct assessment of reading literacy based on the Survey of Adults Skills instruments. Modules also gather information about family, health and language.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
The units of analysis are the individual respondents and households. A household roster is undertaken at the start of the survey and the individual respondent is randomly selected among all household members 18 (in Macedonia case) to 64 years old (included). The random selection process was designed by the STEP team and compliance with the procedure is carefully monitored during fieldwork.
Version
Version Description
Version 01, edited anonymous datasets for public distribution.
Version Date
2016-01
Scope
Notes
The scope of the study includes:
- household demographic characteristics
- dwelling characteristics
- education and training
- health
- employment
- job skill requirements
- personality, behavior and preferences
- language and family background
- reading literacy test assessment
- household demographic characteristics
- dwelling characteristics
- education and training
- health
- employment
- job skill requirements
- personality, behavior and preferences
- language and family background
- reading literacy test assessment
Coverage
Geographic Coverage
Urban areas
Universe
The target population for the Macedonia STEP survey comprises all non-institutionalized persons 15 to 64 years old living in private dwellings in urban areas of the country at the time of data collection. This includes all residents except foreign diplomats and non-nationals working for international organizations.
Persons 15-17 years old were not explicitly included in the sample frame due to the fact that they do not have the right to vote in the Republic of Macedonia. The sampling frame was electoral polling stations listing. This group of 15 to 17 year old persons is most probably living in a dwelling with a person who is 18 to 64 years old and therefore the 15 to 17 year old persons are likely present in the target dwellings.
Persons 15-17 years old were not explicitly included in the sample frame due to the fact that they do not have the right to vote in the Republic of Macedonia. The sampling frame was electoral polling stations listing. This group of 15 to 17 year old persons is most probably living in a dwelling with a person who is 18 to 64 years old and therefore the 15 to 17 year old persons are likely present in the target dwellings.
Producers and sponsors
Primary investigators
| Name |
|---|
| World Bank |
Producers
| Name | Affiliation | Role |
|---|---|---|
| Alexandria Valerio | World Bank | STEP Co-Task Team Leader, Education Global Practice |
| Maria Laura Sanchez Puerta | World Bank | STEP Co-Task Team Leader, Social Protection and Labor Global Practice |
| Tania Rajadel | World Bank Consultant, Project Coordinator | Technical assistance in project management, data collection, data processing and data analysis |
| Gaelle Pierre | World Bank Consultant, Senior Labor Economist | Technical assistance in project management, questionnaire design, and data analysis |
| Valerie Evans | World Bank Consultant, Survey Consultant | Technical assistance in questionnaire design, sampling methodology, and data collection |
| Sebastian Monroy Taborda | World Bank Consultant, Research Analyst | Technical assistance in data processing and data analysis |
Funding Agency/Sponsor
| Name | Abbreviation | Role |
|---|---|---|
| Multi-Donor Trust Fund Labor Markets, Job Creation and Economic Growth | Funding | |
| Bank Netherlands Partnership Program | BNPP | Funding |
Other Identifications/Acknowledgments
| Name | Role |
|---|---|
| Educational Testing Services | Designed the Reading Literacy Assessment Module and conducted the preliminary analysis of the reading literacy data, including generating plausible values for the Extended Assessment |
Sampling
Sampling Procedure
Stratified 3-stage sample design was implemented in Macedonia, FYR. The stratification objective was to obtain an approximately proportional sample from two ethnic groups, Macedonian and Albanian. To meet this objective, the sample was stratified by seven ethnic groups based on the proportion of Macedonian voters in each primary sampling unit (PSU).
The primary sample unit (PSU) was an electoral polling station. The sample frame was a list of 1,280 electoral polling stations, which was updated at the time of the 2011 Elections in Macedonia.
The first stage units were selected by a World Bank survey methodologist. The sampling objective was to select 289 PSUs, comprised of 268 initial PSUs and 21 reserve PSUs. Although 289 PSUs were selected, only 268 PSUs were activated; none of the 21 reserve PSUs was activated during data collection. The PSUs were selected using a systematic probability proportional to size (PPS) sampling method, where the measure of size was the number of registered voters aged 18 to 64 in a PSU. Each PSU was uniquely defined by the sample frame variable 'PSUsmpID'.
The second stage sample unit (SSU) is a household. The sampling objective was to obtain interviews at 15 households within each selected PSU. A Macedonian survey firm conducted field listing within each selected PSU. The survey team expected the non-response rate to be in the range of 30% to 50%. In order to allow for a low response rate, a sample of 45 households was selected in each PSU using a systematic random method.
The third stage sample unit was an individual 15-64 (inclusive) years old. The sampling objective was to select one individual with equal probability from each selected household.
Total of 4,000 households in the initial sample were divided into Albanian strata (1,200) and Macedonian strata (2,800).
The primary sample unit (PSU) was an electoral polling station. The sample frame was a list of 1,280 electoral polling stations, which was updated at the time of the 2011 Elections in Macedonia.
The first stage units were selected by a World Bank survey methodologist. The sampling objective was to select 289 PSUs, comprised of 268 initial PSUs and 21 reserve PSUs. Although 289 PSUs were selected, only 268 PSUs were activated; none of the 21 reserve PSUs was activated during data collection. The PSUs were selected using a systematic probability proportional to size (PPS) sampling method, where the measure of size was the number of registered voters aged 18 to 64 in a PSU. Each PSU was uniquely defined by the sample frame variable 'PSUsmpID'.
The second stage sample unit (SSU) is a household. The sampling objective was to obtain interviews at 15 households within each selected PSU. A Macedonian survey firm conducted field listing within each selected PSU. The survey team expected the non-response rate to be in the range of 30% to 50%. In order to allow for a low response rate, a sample of 45 households was selected in each PSU using a systematic random method.
The third stage sample unit was an individual 15-64 (inclusive) years old. The sampling objective was to select one individual with equal probability from each selected household.
Total of 4,000 households in the initial sample were divided into Albanian strata (1,200) and Macedonian strata (2,800).
Response Rate
An overall response rate of 66.9% was achieved in the Macedonia STEP Household Survey. Table 18 in "STEP Weighting Procedures Summary, Macedonia, FYR" provides the response rate by stratum.
Weighting
While the 3-stage stratified sample design greatly enhanced the operational feasibility of data collection, it resulted in differential probabilities of selection for the selected persons. Consequently, each selected person in the survey does not necessarily represent the same number of persons in the target population. To account for differential probabilities of selection due to the nature of the design and to ensure accurate survey estimates, STEP requires a sampling weight for each person that participated in the survey.
The objectives of the STEP weighting are to construct a set of survey weights to compensate for unequal probabilities of selection, and to compensate for household-level non-response and person-level non-response.
Detailed information about weighting procedures is available in "STEP Weighting Procedures Summary, Macedonia, FYR", provided in external resources.
The objectives of the STEP weighting are to construct a set of survey weights to compensate for unequal probabilities of selection, and to compensate for household-level non-response and person-level non-response.
Detailed information about weighting procedures is available in "STEP Weighting Procedures Summary, Macedonia, FYR", provided in external resources.
Data Collection
Dates of Data Collection
| Start | End | Cycle |
|---|---|---|
| 2013-04 | 2013-09 | Fieldwork |
Data Collection Mode
Face-to-face [f2f]
Supervision
Each interviewer team reports to a team supervisor. Interviewers must hand over to their supervisor properly filled questionnaires and reading exercise booklets (for Reading Literacy Assessment), and report all information about the fieldwork conducted.
Team supervisors are responsible for coordinating fieldwork, monitoring interviewers' work, documenting non-response, assigning reading exercise booklets and communicating regularly with a field manager.
Field supervision details are outlined in "National Survey Design Planning Report, Macedonia, FYR" and "Interviewer's Manual and Team Supervisor's Manual", available in external resources.
Team supervisors are responsible for coordinating fieldwork, monitoring interviewers' work, documenting non-response, assigning reading exercise booklets and communicating regularly with a field manager.
Field supervision details are outlined in "National Survey Design Planning Report, Macedonia, FYR" and "Interviewer's Manual and Team Supervisor's Manual", available in external resources.
Data Collection Notes
Each component of the STEP Survey was carried out by a personal visit using a Paper-and-Pencil Interview (PAPI) method. Interviews lasted between 120 and 150 minutes, depending on respondents' reading proficiency.
As the STEP program requires all surveys to be implemented in a standardized way, particular attention was provided to implementation processes:
1) Each participating country (survey firm) presented National Survey Design Planning Report (NSDPR) detailing how it intended to implement the STEP survey while complying with the STEP Technical Standards. The NSDPRs were submitted to the WB STEP team for approval.
2) The World Bank (WB) STEP team and Educational Testing Services (ETS) conducted two workshops for all survey firms. The first was a 2-day workshop provided via video conference and aimed at presenting the STEP Technical Standards. The second workshop was organized over two full weeks at the World Bank Headquarters. During this course project managers from each survey firm received training on the survey instruments, implementation of the survey and data management procedures.
3) Based on the STEP Technical Standards, the survey firms adapted and translated the STEP survey instruments, the interviewer manual, and all training materials.
4) Once the instruments had been adapted and translated, survey firms carried out a pre-test, usually including 20-30 interviews. Findings from the pre-test were discussed with the WB STEP team and ETS to finalize the adaptation and translation of the STEP survey instruments.
5) Each survey firm provided a 2-week training course to its enumerators, using training materials developed by the WB STEP team (after translation and adaptation). The WB STEP team's survey consultant helped organize the training and was present in the country for the first few days of the training. In addition, the WB STEP team in Washington DC provided just-in-time technical assistance, answering questions sent by the survey firm during the training. The training included in-field mock interviews in addition to in-class courses. At the end of the training, survey firms only retained enumerators having demonstrated a good understanding of the instruments.
6) As per STEP Technical Standards, data collection started within a few days of the end of the enumerators' training course. The composition of each country's fieldwork teams, reporting procedures and quality control processes are described in the NSDPR. Weekly reports were sent to the WB STEP team, which provided just-in-time technical assistance during fieldwork to answer questions or concerns. Regular calls or VCs were also held between survey firms and the WB STEP team to discuss progress. Matters discussed usually involved questions on how to deal with specific situations, strategies to reduce non-response, the activation of reserve households, and general pace of progress.
As the STEP program requires all surveys to be implemented in a standardized way, particular attention was provided to implementation processes:
1) Each participating country (survey firm) presented National Survey Design Planning Report (NSDPR) detailing how it intended to implement the STEP survey while complying with the STEP Technical Standards. The NSDPRs were submitted to the WB STEP team for approval.
2) The World Bank (WB) STEP team and Educational Testing Services (ETS) conducted two workshops for all survey firms. The first was a 2-day workshop provided via video conference and aimed at presenting the STEP Technical Standards. The second workshop was organized over two full weeks at the World Bank Headquarters. During this course project managers from each survey firm received training on the survey instruments, implementation of the survey and data management procedures.
3) Based on the STEP Technical Standards, the survey firms adapted and translated the STEP survey instruments, the interviewer manual, and all training materials.
4) Once the instruments had been adapted and translated, survey firms carried out a pre-test, usually including 20-30 interviews. Findings from the pre-test were discussed with the WB STEP team and ETS to finalize the adaptation and translation of the STEP survey instruments.
5) Each survey firm provided a 2-week training course to its enumerators, using training materials developed by the WB STEP team (after translation and adaptation). The WB STEP team's survey consultant helped organize the training and was present in the country for the first few days of the training. In addition, the WB STEP team in Washington DC provided just-in-time technical assistance, answering questions sent by the survey firm during the training. The training included in-field mock interviews in addition to in-class courses. At the end of the training, survey firms only retained enumerators having demonstrated a good understanding of the instruments.
6) As per STEP Technical Standards, data collection started within a few days of the end of the enumerators' training course. The composition of each country's fieldwork teams, reporting procedures and quality control processes are described in the NSDPR. Weekly reports were sent to the WB STEP team, which provided just-in-time technical assistance during fieldwork to answer questions or concerns. Regular calls or VCs were also held between survey firms and the WB STEP team to discuss progress. Matters discussed usually involved questions on how to deal with specific situations, strategies to reduce non-response, the activation of reserve households, and general pace of progress.
Data Collectors
| Name |
|---|
| PUBLIK, a survey firm |
Questionnaires
Questionnaires
The STEP survey instruments include:
- The background questionnaire developed by the World Bank (WB) STEP team
- Reading Literacy Assessment developed by Educational Testing Services (ETS).
All countries adapted and translated both instruments following the STEP technical standards: two independent translators adapted and translated the STEP background questionnaire and Reading Literacy Assessment, while reconciliation was carried out by a third translator.
The survey instruments were piloted as part of the survey pre-test.
The background questionnaire covers such topics as respondents' demographic characteristics, dwelling characteristics, education and training, health, employment, job skill requirements, personality, behavior and preferences, language and family background.
In Macedonia, the survey firm implemented a partial Literacy Assessment design. The partial assessment required each selected person to attempt to complete a General Booklet comprising Reading Components and a set of Core Literacy items.
The background questionnaire, the structure of the Reading Literacy Assessment and Reading Literacy Data Codebook are provided in the document "Macedonia, FYR STEP Skills Measurement Survey Instruments", available in external resources.
- The background questionnaire developed by the World Bank (WB) STEP team
- Reading Literacy Assessment developed by Educational Testing Services (ETS).
All countries adapted and translated both instruments following the STEP technical standards: two independent translators adapted and translated the STEP background questionnaire and Reading Literacy Assessment, while reconciliation was carried out by a third translator.
The survey instruments were piloted as part of the survey pre-test.
The background questionnaire covers such topics as respondents' demographic characteristics, dwelling characteristics, education and training, health, employment, job skill requirements, personality, behavior and preferences, language and family background.
In Macedonia, the survey firm implemented a partial Literacy Assessment design. The partial assessment required each selected person to attempt to complete a General Booklet comprising Reading Components and a set of Core Literacy items.
The background questionnaire, the structure of the Reading Literacy Assessment and Reading Literacy Data Codebook are provided in the document "Macedonia, FYR STEP Skills Measurement Survey Instruments", available in external resources.
Data Processing
Data Editing
STEP data management process:
1) Raw data is sent by the survey firm
2) The World Bank (WB) STEP team runs data checks on the background questionnaire data. Educational Testing Services (ETS) runs data checks on the Reading Literacy Assessment data. Comments and questions are sent back to the survey firm.
3) The survey firm reviews comments and questions. When a data entry error is identified, the survey firm corrects the data.
4) The WB STEP team and ETS check if the data files are clean. This might require additional iterations with the survey firm.
5) Once the data has been checked and cleaned, the WB STEP team computes the weights. Weights are computed by the STEP team to ensure consistency across sampling methodologies.
6) ETS scales the Reading Literacy Assessment data.
7) The WB STEP team merges the background questionnaire data with the Reading Literacy Assessment data and computes derived variables.
Detailed information on data processing in STEP surveys is provided in "STEP Guidelines for Data Processing" document, available in external resources. The template do-file used by the STEP team to check raw background questionnaire data is provided as an external resource, too.
1) Raw data is sent by the survey firm
2) The World Bank (WB) STEP team runs data checks on the background questionnaire data. Educational Testing Services (ETS) runs data checks on the Reading Literacy Assessment data. Comments and questions are sent back to the survey firm.
3) The survey firm reviews comments and questions. When a data entry error is identified, the survey firm corrects the data.
4) The WB STEP team and ETS check if the data files are clean. This might require additional iterations with the survey firm.
5) Once the data has been checked and cleaned, the WB STEP team computes the weights. Weights are computed by the STEP team to ensure consistency across sampling methodologies.
6) ETS scales the Reading Literacy Assessment data.
7) The WB STEP team merges the background questionnaire data with the Reading Literacy Assessment data and computes derived variables.
Detailed information on data processing in STEP surveys is provided in "STEP Guidelines for Data Processing" document, available in external resources. The template do-file used by the STEP team to check raw background questionnaire data is provided as an external resource, too.
Other Processing
Data entry processes are described in the National Survey Design Planning Report (NSDPR), available as an external resource. In most countries, data entry took place at the survey firm's headquarters.
For the background questionnaire data, survey firms could use the World Bank (WB) STEP Data Entry Program (DEP) or design their own. In the latter case, the WB STEP team checks their DEP to ensure it complies with STEP technical standards. The STEP DEP was developed in Excel and mirrored the background questionnaire. Macedonia, Yunnan Province of China, Ghana and Vietnam used the WB STEP Data Entry Program. Armenia, Georgia, Bolivia, Colombia, Lao PDR and Sri Lanka developed their own DEP in CSPro. Standards for data entry are detailed in Guidelines for STEP Data Entry Programs and summarized in the NSDPR. Double data entry process was required. All range checks and skips were controlled by the program. Consistency checks were also included in the data entry program.
All survey firms were required to score the Reading Literacy Assessment booklets and to enter the data using the Data Entry Program developed by Educational Testing Services (ETS). Double data entry process was required. Consistency checks were also included in the data entry program.
For the background questionnaire data, survey firms could use the World Bank (WB) STEP Data Entry Program (DEP) or design their own. In the latter case, the WB STEP team checks their DEP to ensure it complies with STEP technical standards. The STEP DEP was developed in Excel and mirrored the background questionnaire. Macedonia, Yunnan Province of China, Ghana and Vietnam used the WB STEP Data Entry Program. Armenia, Georgia, Bolivia, Colombia, Lao PDR and Sri Lanka developed their own DEP in CSPro. Standards for data entry are detailed in Guidelines for STEP Data Entry Programs and summarized in the NSDPR. Double data entry process was required. All range checks and skips were controlled by the program. Consistency checks were also included in the data entry program.
All survey firms were required to score the Reading Literacy Assessment booklets and to enter the data using the Data Entry Program developed by Educational Testing Services (ETS). Double data entry process was required. Consistency checks were also included in the data entry program.
Access policy
Citation requirements
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Example:
World Bank. Macedonia, FYR STEP Skills Measurement Household Survey 2013 (Wave 2). Ref. MKD_2013_STEP-HH_v01_M. Dataset downloaded from [URL] on [date].
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Example:
World Bank. Macedonia, FYR STEP Skills Measurement Household Survey 2013 (Wave 2). Ref. MKD_2013_STEP-HH_v01_M. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Metadata production
DDI Document ID
DDI_MKD_2013_STEP-HH_v01_M_WB
Producers
| Name | Abbreviation | Affiliation | Role |
|---|---|---|---|
| Development Data Group | DECDG | The World Bank | Documentation of the study |
Date of Metadata Production
2016-03-21
DDI Document version
Version 01 (March 2016)