WLD_2023_SYNTH-CEN-EN_v01_M
Synthetic Data for an Imaginary Country, Full Population, 2023
A synthetic hierarchical dataset for simulation and training purposes
Name | Country code |
---|---|
World | WLD |
Synthetic data
This dataset is part of a collection of fully synthetic data generated, for training and simulation purposes, for an imaginary middle-income country. The dataset is available in English and French. A subset of 8,000 households is also available in English and French as a "synthetic survey dataset".
Type | Identifier |
---|---|
DOI | https://doi.org/10.48529/78M1-AE09 |
cen
household, Individual
V. 2023-05-01 10M PP EN
2023-05-01
World Bank, Development Data Group
Dataset generated using RealTabFormer (with 10,003,891 individuals and 2,501,755 households), with post-processing. English version.
The dataset is a synthetic dataset generated using a model that used data from IPUMS International, from the Demographic and Health Survey program, and from the World Bank Global Consumption Database (microdata) as training data. The detailed list of datasets used to create the training datasets is available in the Technical Documentation (document provided as an external resource).
The dataset is a synthetic dataset for an imaginary country. It was created to represent the full national population of this country, by province and district (equivalent to admin1 and admin2 levels) and by urban/rural areas of residence.
province (admin1), district (admin2)
The dataset is a fully-synthetic dataset representative of the resident population of ordinary households for an imaginary middle-income country.
Name | Affiliation |
---|---|
Development Data Group, Data Analytics Unit | World Bank |
Name | Abbreviation | Grant number | Role |
---|---|---|---|
UNHCR-World Bank Joint Data Center on Forced Displacement | JDC | KP-P174174-TF0B5124 | Sponsored research work for the development of synthetic data for the purpose of assessing statistical disclosure risk measures. |
The dataset is the equivalent of a census dataset. No weighting applies.
The dataset is a synthetic dataset. Although the variables it contains are variables typically collected from sample surveys or population censuses, no questionnaire is available for this dataset. A "fake" questionnaire was however created for the sample dataset extracted from this dataset, to be used as training material.
The dataset was generated using REaLTabFormer, a four-level hierarchical generative model. The first-level model is the household composition generator, which generates variables that define each household's composition (household size and basic demographic profile of members, including age and relationship to the head of household). The second-level model is the household-level variables generator, which generates the variables whose values are common to all household members (such as dwelling characteristics) based on the household composition. The third-level model is the household-head generator, which generates observations for the head of the households based on the output of the previous two models. The fourth-level model is the household member generator, which generates data on the household members, excluding the head, for households of size two and above. The household member generator model uses the data generated by the household composition, household-level variables, and household head generator models. This hierarchical model provides relational dependencies within a household that would not be guaranteed if all records were generated independently.
To implement the different models, we adopted a transformer architecture. The household composition generator is a decoder model that generates data from normally distributed noise. The other three models use a sequence-to-sequence model inspired by the application of deep learning to language translation.
More detailed information is available in the Technical Documentation provided as an external PDF document.
Start | End |
---|---|
2023 | 2023 |
cross section
Start date | End date |
---|---|
2023 | 2023 |
Type | Description |
---|---|
synthetic data generation | The synthetic data generation process is described in detail in a technical document "Generating a relational synthetic dataset for an imaginary country - Technical documentation" provided as external resource. |
The synthetic data generation process included a set of "validators" (consistency checks, based on which synthetic observation were assessed and rejected/replaced when needed). Also, some post-processing was applied to the data to result in the distributed data files.
The synthetic dataset is intended to provide a realistic representation of a middle-income countries. A set of summary indicators/tables was produced to ensure the realistic aspect of the data.
World Bank Microdata Library
2 (one at the household level, one at the individual level). The two data files can be merged using variable "hid" as merging key.
Data available as open data (CC BY 4.0 license)
Name |
---|
World Bank, Microdata Library |
The dataset was generated as a fully-synthetic dataset. The model used to create the synthetic observations includes multiple procedures to avoid overfitting and data-copying. Also, the data used for training the model went through processes of sampling and recoding that make it impossible to link a synthetic observation to an actual observation. The dataset is thus safe for dissemination. It can be used with no restriction and is shared as open data.
The data are to be used for training or simulation purposes only. It is not intended to be representative of any particular country, and should not be used for inference purpose.
Name | Affiliation |
---|---|
OD | World Bank |
2023-05-01
1.0 EN
2023-05-01
English version
This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser. To learn more about cookies, click here.