This page provides a summary of the publicly available results from the Data Integration Survey (NOTE CURRENTLY STILL RESTRICTED FOR TESTING)
Survey respondents chose to:
- share the information provided publicly
- share the information only among colleagues in official statistics, or
- provide the information for use only in aggregate or anonymous form.
Responses where the choice was "1" are shown on this page.
|
Created |
Organisation |
Country (if applicable) |
Number of Employees |
Use of the information provided |
Contact Person |
Email address |
If your organisation has a definition of data integration, please provide it here and/or provide a link |
Do you have, or are you developing, organisation wide, national or international strategies for data integration? |
If so, please describe and/or provide links |
Some official statistics organisations have a leading role in the development of national/whole of government/international data integration practices. Can you identify the main advantages of official statistics organisations taking this role? |
Can you identify challenges of official statistical organisations taking this role? |
Do you have specific units/functions in your organisation responsible for data integration strategies and/or operations? |
If other, please describe and/or provide links |
Why were the units/functions created? |
Public acceptance and trust issues |
Lack of supporting legislation or legislation that blocks data integration |
Access to new data sources |
Maintaining access to data sources (e.g. when data provider changes availability or format) |
Quality issues |
ICT issues |
Lack of methodologies |
Lack of meta information describing definitions, statistical units,etc used in data sources |
Differing definitions |
Budget/resources |
Skills |
Please describe any other barriers not mentioned above and/or provide links |
Is your organisation allowed by law (e.g. stated in the Statistical Act or similar) to use administrative data for statistical purposes? |
Does a legal basis to access data exist? |
Is data free to access for statistical purposes? |
Is your organisation prohibited from access or linking of data due to privacy issues (e.g. stated in a Personal Data Protection Act or similar)? |
Please describe any legislative limitations or barriers not mentioned above |
Please list any legislative supports not mentioned above |
Is there a unified personal identity system in the country? |
Is there a unified business identity system in the country? |
Is there a unified farmers identity system in the country? |
Is there a unified address system in the country? |
What pre-integration practices does your organisation use or plan to use with data providers or other partners? |
Agriculture, forestry, fisheries (2.4.1) |
Banking, insurance, financial statistics (2.4.6) |
Business statistics (2.3) |
Culture (1.9) |
Economic accounts (2.2) |
Education (1.3) |
Energy (2.4.2) |
Entrepreneurship (3.3.7) |
Environment (3.1) |
Gender and special population groups (3.3.2) |
Globalisation (3.3.4) |
Government finance, fiscal and public-sector statistics (2.5) |
Health (1.4) |
Human settlements and housing (1.7) |
Income and consumption (1.5) |
Indicators related to the Millennium or Sustainable Development Goals (3.3.5) |
Information society (3.3.3) |
International trade and balance of payments (2.6) |
Justice and crime (1.8) |
Labour (1.2) |
Labour cost (2.8) |
Living conditions, poverty and cross cutting issues (3.3.1) |
Macroeconomic statistics (2.1) |
Mining, manufacturing, construction (2.4.3) |
Political and other community activities (1.10) |
Population and migration (1.1) |
Prices (2.7) |
Regional and small area statistics (3.2) |
Science, technology and innovation (2.9) |
Social protection (1.6) |
Sustainable development (3.3.6) |
Time use (1.11) |
Tourism (2.4.5) |
Transport (2.4.4) |
Yearbooks and similar compendia (3.4) |
Other |
If other, please describe |
Please indicate the most important or prominent ways you use integration of additional information or alternate data sources in your organisation |
If other, please describe and/or provide links |
Please indicate the types of data being integrated with other data for the production of statistics in your organisation |
If other, please describe and/or provide links |
Which tools (applications, software, etc.) do you use for linking and/or matching data? |
Please provide additional details and/or links about the tools you use |
What methods do you use? |
Please provide additional details and/or links about the methods you use |
How do you measure the quality of statistical information produced as a result of data integration activities? |
Do you use a quality framework for data integration activities? |
If you use a quality framework, please describe and/or provide links |
Does your organisation have the required skilled resources, or access to resources, to undertake data integration activities? |
Has your organisation developed or sourced specific training or other forms of skills development for data integration activities in the last 3 to 5 years? |
Would you be interested in obtaining or providing data integration training with other official statistics organisations? |
Please indicate the areas where you think training is most required |
Please provide any relevant information and/or links |
Does your organisation use geospatial data in the production of statistics? |
If yes, what type of geospatial data is used? |
Does the geospatial data meet statistical needs in terms of |
Please indicate any registers you use which have geospatial attributes / data items |
Is it possible to pair statistical data with external spatial data by identifiers (e.g. personal identifiers, addresses, real estate codes, building ids, names, etc)? |
If yes, who conducts the pairing? |
What are the main barriers to geocoding of geospatial or administrative data |
If other, please describe |
What is the lowest possible geographical level to which you can geocode statistical data? |
What are the main threats to your organisation's current geocoding practices? |
If other, please describe and/or provide links |
Thank you for completing the survey. Please provide any other information, links, comments or suggestions here |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2017-11-16 16:37 | Statistical Office of the Republic of Slovenia (SURS) | Slovenia | 100 - 499 | The information provided can be shared publicly as part of the guide | Kaja Malesic | kaja.malesic@gov.si | Data integration as a process is described in the Quality Guidelines. The revised and updated edition of the methodological manual is released in the Slovene language at the time, and the English version will be released not later than by the end of November, 2017. http://www.stat.si/statweb/en/Methods/ClassificationsQuestionnairesMethods | Organisation wide strategy in place | SURS takes part in development projects in the field of administrative records and has developed a statistical environment based on administrative records and registers. The established method of work at SURS is that it is constantly checked whether the required data can be obtained from the existing sources (statistical, administrative and other). The strategic and methodological documents (Medium-term Programme of Statistical Surveys, Quality Guidelines) are oriented towards register-based statistics that provide non-excessive burden on repondents. | NSIs have the experience in integrating data and the knowledge of methods, classifications, concepts etc.; rationalization and cost-effectivness; collaboration with data providers lowers the risks in obtaining adequate data concerning methodologies, concepts, coverage etc. | Willingness of institutions to cooperate; adequate capacities of human resources to take the leading role | Data Integration operations unit | Unit for data integration carries out operational work by integrating data from heterogenous sources in a way that enables further statistical processing. | Concerning item 3 Barriers we had different understanding of the question - to rate the issues as barriers in relation to the ongoing production of statistics in our organization (understanding 1) or rate the significancy of the issues as barriers in general and not in relation to the existing ongoing production of statistics in our organization (understanding 2). In the response we rated the issues as barriers in relation to the ongoing production of statistics in our organization (understanding 1). | Yes, in all cases | Yes, in all cases | Yes, in all cases | No | Yes | Yes | Yes | Yes | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For replacing sample surveys For replacing traditional censuses (e.g. register based population censuses, agricultural census) For maintaining registers For data validation For data editing and/or imputation To provide geospatial products For customised data services To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data Data from public administration (2100) Traffic sensors/webcam (3113) | SAS SQL Oracle | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) | As integral part of quality reporting | Yes |
We use 3 standard quality indicators related to data integration: - rate of unsuccessful linking of the variable - rate of compliance of sources - rate of compliance of results |
Yes | No | Yes - obtaining training | Tools / Information Technology Methods Quality frameworks | Yes | Points Polygons Lines | Resolution Scale Quality Accuracy Update processes | Person Address Building Dwelling Business Cadastral parcels Statistical units | Yes | Your organisation | Single points (coordinates) such as address locations, buildings or locations of real estates (cadastral parcels) | No threats No big problems but there is room for improvement | |||||||||||||||||||||||||||||||||||
| 2017-11-29 04:14 | Statistical office of Serbia | Serbia | 100 - 499 | The information provided can be shared publicly as part of the guide | Mira Nikic | mira.nikic@stat.gov.rs | Organisation wide strategy in place | We develop and use IST concept of data integration. It is based on one platform for all data and active metadata system. IST is now international collaboration and is implemented, besides Serbia in statistical offices of Montenegro, Bosnia and Herzegovina and Albania. Also, IST is implemented in Serbian Chamber of commerce. | best knowledge about data management best understanding of benefits of data integration best practice in area | big burden on statistical office lack of staff legislative issues | Data Integration operations unit | Formerly, database unit was in charge for data integration, but 2 years ago, we decided to make specifically data integration unit as central unit in our office. Data integration is very important to us, because we based whole production system on putting all data on one platform (relational databases) and that enable for us active metadata system. In this system (IST) we keep on one place all information on data and maintaining that data from data entry to data dissemination. | Yes, in all cases | Yes, in all cases | Yes, in all cases | No | Yes | Yes | Yes, partly (e.g. not comprehensive) | Yes, partly (e.g. not comprehensive) | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | No information | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) For replacing sample surveys For maintaining registers To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data Data from public administration (2100) | R SAS SQL Other in-house developed tools | Deterministic record linkage (links based on individual identifiers that match among the available data sets) | We develop and use IST concept of data integration. It is based on one platform for all data and active metadata system. IST is now international collaboration and is implemented, besides Serbia in statistical offices of Montenegro, Bosnia and Herzegovina and Albania. Also, IST is implemented in Serbian Chamber of commerce. | Do not measure the quality of the integrated dataset | No quality framework is used but there is case by case consideration of quality issues | Partly | Partly | Yes - providing training | Strategies for success Pre-integration practices Methods | Yes | Polygons | Don't know | Address Building Dwelling | Yes | The data provider | Lack of data resources Statistical information is not collected in a way that makes geocoding possible or meaningful | Combination of both (different data in different parts of the country) | Scarce resources | |||||||||||||||||||||||||||
| 2017-11-29 04:14 | Rosstat | Russia | 1500 or above | The information provided can be shared publicly as part of the guide | No | Other | Yes, in all cases | Yes, in most cases | Yes, in most cases | Yes, in some cases | No | Yes | Yes | Yes | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For maintaining registers For data validation To create statistical products in partnership with other organisations | Survey data Census data Automatic identification systems Data from public administration (2100) |
|
|
|
|
Partly | Partly | Yes - obtaining training | Strategies for success Developing effective partnerships Governance Legislation issues Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes |
|
Resolution Scale Quality Accuracy Update processes | Person Address Statistical units | Yes | Your organisation |
|
Small geographical areas such as enumeration districts, blocks or small administrate units | No threats No big problems but there is room for improvement | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 2017-11-29 04:14 | Republic Srpska Institute of Statistic | Bosnia and Herzegovina | 100 - 499 | The information provided can be shared publicly as part of the guide | Mladen Radic | mladen.radic@rzs.rs.ba | Organisation wide strategy in place | In our case, we are part of international team, who developed and still developing IST concept of data integration. IST is in full production in Serbia, Bosnia and Herzegovina, Montenegro and Albania. | possibility of international collaboration wide network of experts natural advantage in domain of the data | to big burden for statistical offices lack of staff lack of resources if coordinating role is not strong enough it is not possible to take this role | Other | Database unit deals with all data integration processes | Yes, in most cases | Yes, in most cases | Yes, in most cases | No | Yes | Yes | No | Yes, partly (e.g. not comprehensive) | Cooperation agreements for transferring the data Collaboration in the preparation of administrative or statistical classifications used for data | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Research/experiment/feasibility study | Research/experiment/feasibility study | No information | Research/experiment/feasibility study | No information | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Research/experiment/feasibility study | No information | Research/experiment/feasibility study | Research/experiment/feasibility study | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | No information | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) For maintaining registers For data validation For data editing and/or imputation | Survey data Census data Data from public administration (2100) | SPSS SQL | Deterministic record linkage (links based on individual identifiers that match among the available data sets) | In our case, we are part of international team, who developed and still developing IST concept of data integration. IST is in full production in Serbia, Bosnia and Herzegovina, Montenegro and Albania. | As integral part of quality reporting | Yes | Partly | Partly | Yes - obtaining training | Strategies for success Developing effective partnerships Governance Legislation issues Pre-integration practices Tools / Information Technology Methods Quality frameworks | No |
|
|
|
|
|
||||||||||||||||||||||||||||||
| 2017-11-29 04:14 | Statistics Canada | Canada | 1500 or above | The information provided can be shared publicly as part of the guide | Linda Howatson-Leo, Director Information Management Division, Statistics Canada, Government of Canada | Linda.Howatson-Leo@canada.ca | No specific definition of data integration. | Organisation wide strategy in place National/whole of government strategy in place Multi-country/international strategy in place | As Canada's central statistical office, Statistics Canada is legislated (http://laws.justice.gc.ca/eng/acts/S-19/FullText.html)to provide statistics for the whole of Canada and each of the provinces and territories. It is mandated generally, to promote and develop integrated social and economic statistics pertaining to the whole of Canada and to each of the provinces thereof and to coordinate plans for the integration of those statistics. As a member of the United Nations Statistical Commis | 1)strategic necessity of creating and preserving an ability to innovate statistical programs to respond to emerging needs 2)very real opportunity that international partnerships among statistical offices provide to collaboratively build shared frameworks, systems and standards that can magnify the efficiency gains available to us. | Stronger partnerships with other government organizations, other levels of government, businesses and non-government organizations will be needed to gain access to new data sources and to adapt them to the needs of official statistics. | Data Integration operations unit Management/support of whole of government data integration activity Management/support of international data integration activity | All Agency services are consolidated (frame development and maintenance, collection, classification and coding, informatics, methodology, research, communications, etc.) so that any one service is provided in only one organizational entity. There are a few units dedicated to data integration operations such as the Social Data Linkage Environment, the Integrated Business Statistics Program (links provided at end of survey) and the Census Research Program. | We did this 1) to achieve economies of scale, 2) to professionalize the management of these functions so that the function managers could be charged and challenged to find new and better ways of carrying out their work, and 3) to ensure these resources were focused on our modernization priorities. | Yes, in all cases | Yes, in most cases | Yes, in most cases | No | The Statistics Act provides wide data access and collection authority for the Agency coupled with strict confidentiality protections that provide some barriers to data sharing and external access. Privacy (personal information) and intellectual property (proprietary data) laws add responsibility to protect data from unlimited use and disclosure as well. | No | Yes | Yes, partly (e.g. not comprehensive) | No | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Keying these topics into the agency's website search engine returns multiple entries for products, surveys, studies and collaborations. Few areas are single data sourced. Most agency statistical production involves integration of collection and processing processes, use of admin data and linking for statistical series and quality control, and integrated analysis on topics like globalization. Feasibility studies or demonstration projects are used across subject areas in development of Canadian statistics as are customized products and ongoing statistical series. http://www/statcan.gc.ca | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For replacing sample surveys For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) To provide geospatial products For customised data services To create statistical products in partnership with other organisations To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Statistics Canada has used traditional admin data sources and record linkages throughout its 100-year history. Current investigations include increasing the use of Internet data, data from social media, and big commercial data sources such as scanner data or transaction data. Research for an admin census backbone includes acquiring and testing large insurance or registration databases from all jurisdictions in Canada (e.g., health card, motor vehicle registrations, driver s licence) among do | Survey data Census data Automatic identification systems Banking/stock records (2220) Commercial transactions (2210) Credit cards (2240) Data from public administration (2100) Internet searches (1600) Medical records (2110) Personal documents (1300) Satellite images (3123) Scientific sensors (3114) Smart Energy Meters (311?)/Smart gas meters | Please note that many of these types of data are still in research and experimental mode | G-Link | G-Link is the corporate system for probabilistic record linkage. MixMatch is a prototype system for deterministic record linkage. | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) | As Canada's central statistical office, Statistics Canada is legislated (http://laws.justice.gc.ca/eng/acts/S-19/FullText.html)to provide statistics for the whole of Canada and each of the provinces and territories. It is mandated generally, to promote and develop integrated social and economic statistics pertaining to the whole of Canada and to each of the provinces thereof and to coordinate plans for the integration of those statistics. As a member of the United Nations Statistical Commis | As integral part of quality reporting | Yes | Partly | Yes | Yes - obtaining training | Strategies for success Developing effective partnerships Legislation issues Methods Quality frameworks | Yes | Polygons Lines | Resolution Scale Quality Accuracy | Address Dwelling Business | Yes | Your organisation | Other | In Canada, there is no barrier to geocode any administrative data. If civic or mailing addresses are available, StatCan can geocode the data. | Single points (coordinates) such as address locations, buildings or locations of real estates (cadastral parcels) | No threats No big problems but there is room for improvement Restricted access to administrative data from other organisations | Email address for Statistics Canada contact is (Linda.Howatson-Leo@canada.ca) Four Integration Project examples on the Statistics Canada website follow: Social Data Linkage Environment (http://www.statcan.gc.ca/eng/sdle/index ) Integrated Business Statistics Program (http://www.statcan.gc.ca/pub/68-515-x/68-515-x2015001-eng.htm) Integrated Criminal Court Survey (http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=3312) A new way to track the job market!(http://www.statcan. | ||||||||||||||||||
| 2017-11-29 04:14 | National Statistical Service of the Republic of Armenia | Republic of Armenia | 100 - 499 | The information provided can be shared publicly as part of the guide | Anahit Safyan | safyan@armstat.am | The NSSRA is promoting the establishment of digital integrated system of administrative registers with a single identification code. | Organisation wide strategy in place National/whole of government strategy in place | The three-year statistical program is the NSSRA`s strategy that includes the main directions of the state statistical activity in economic, demographic, social and environmental fields of the country. The three-year program/strategy is adopted by the National Assembly as a Law (http://www.armstat.am). | Management/support of whole of government data integration activity Management/support of international data integration activity | There are units dealing with the data integration processes like Business Register, Classifications and Sample surveys,Quality Management and IT Department. The strategy for digitalization of the NSSRA is drafting. | Yes, in all cases | Yes, in all cases | Yes, in all cases | No | Yes | Yes | No | No | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For replacing sample surveys For replacing traditional censuses (e.g. register based population censuses, agricultural census) For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) For customised data services To create statistical products in partnership with other organisations To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data | R SPSS SQL Other open source tools | STATA,PC Axis, Demetra | Deterministic record linkage (links based on individual identifiers that match among the available data sets) | The three-year statistical program is the NSSRA`s strategy that includes the main directions of the state statistical activity in economic, demographic, social and environmental fields of the country. The three-year program/strategy is adopted by the National Assembly as a Law (http://www.armstat.am). | As integral part of quality reporting | Yes | Partly | Partly | Yes - obtaining training | Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes | Points | Scale Quality Accuracy | Address Building Dwelling Statistical units | No | Your organisation | Lack of knowledge Geospatial data is available but is too expensive Lack of data resources No uniform reference system between different administrative data sources | Small geographical areas such as enumeration districts, blocks or small administrate units | Scarce resources | |||||||||||||||||||||||||||
| 2018-01-23 02:00 | Departamento Administrativo Nacional de Estadística DANE | Colombia | 1500 or above | The information provided can be shared publicly as part of the guide | Carlos Augusto Molina Meneses | camolinam@dane.gov.co | Multi-country/international strategy under development | On September 25, 2015, the UN General Assembly adopted the 2030 Agenda for Sustainable Development and its 17 Sustainable Development Goals -SDG-. At that meeting, Member States committed to accomplishing the aspirations set for the SDGs, by "taking into account the different realities, capacities and levels of development of each country and respecting their national policies and priorities". They also recognized "the need to adopt new approaches to data production, acquisition and integrati | There are many advantages that, the National Statistics Offices which integrate different sources of information have; for example, the opportunity, since they do not depend on the performance of operations at certain times of the year, but use the times when administrative records are available, which, in many cases, is more frequent than statistical operations. They also develop higher capacities for the processing, integration and analysis of information, which improves human capital and pro | Quality and truthfulness. As is well known, the NSOs must ensure that the information used as a source and that which is published must have high quality standards, as this also ensures the reliability of the results that are delivered to the countries. It must also face resistance to change, given that it is likely that when applying and appropriating international experiences, the procedures used will change and the personnel who perform these tasks will not be so willing to change. | Data Integration operations unit Management/support of international data integration activity | In order to support the institution needs, but, due DANE participate in a lot of intenational initiatives, the Division of Geostatistic assume the led rol and it has had succed in a great number of projects. It includes, develop the methodology to measure the ODS 11.3.1 Ratio of land consumption rate to population growth rate | Yes, in some cases | No | No | Yes, in all cases | Yes | Yes | Yes, partly (e.g. not comprehensive) | No | Cooperation agreements for transferring the data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data | Research/experiment/feasibility study | No information | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | No information | No information | One off/customised production of statistics | No information | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) To provide geospatial products For customised data services To create statistical products in partnership with other organisations To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data Automatic identification systems Blogs and comments (1200) Data from public administration (2100) Internet searches (1600) Mobile phone location (3121) Mobile phone: call/text times and positions (312.) Satellite images (3123) Social Networks: Facebook, Twitter, Tumblr etc. (1100) | R SAS SPSS SQL Oracle | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) Other | As integral part of quality reporting | No quality framework is used but there is case by case consideration of quality issues | Yes | Yes | Yes - obtaining training | Strategies for success Developing effective partnerships Governance Legislation issues Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes | Points Polygons Lines | Resolution Scale Accuracy | Address Building Cadastral parcels Statistical units | Yes | Your organisation | No legal support for spatial statistics Lack of knowledge Geospatial data is available but is too expensive Legal or bureaucratic restrictions on availability of geospatial data (e.g. public institutions don’t cooperate well) Legal or bureaucratic restrictions on availability of administrative data (e.g. public institutions don’t cooperate well) Administrative data stored in a way that makes geocoding impossible (lack of identifiers to connect to geographical locations) Statistical information is not collected in a way that makes geocoding possible or meaningful No uniform reference system between different administrative data sources | Single points (coordinates) such as address locations, buildings or locations of real estates (cadastral parcels) | Scarce resources Inconsistencies in geospatial information needed for geocoding Poor cooperation and coordination between organisations responsible for different geospatial information and administrative data | ||||||||||||||||||||||||||||||
| 2018-01-23 02:00 | Stats NZ | New Zealand | 500 - 1499 | The information provided can be shared publicly as part of the guide | Allyson Seyb | allyson.seyb@stats.govt.nz | Data integration is defined broadly as combining data from different sources about the same or a similar individual or unit. This definition includes linkages between survey and administrative data, as well as between data from two or more administrative sources. Another application of data integration theory is in identifying records on a single file that belong to the same individual or unit. Other terms used to describe the data integration process include ‘record linkage’ and ‘data matching | Organisation wide strategy in place National/whole of government strategy under development | http://www.stats.govt.nz/about_us/legisln-policies-protocols.aspx | - Optimizing the use and re-use of data - Coordinated and coherent strategy - Standard reference populations - Social license already exists with official statistics agencies - Best practice - Encourages standardisation | - Needs partnership and buy-in - Getting engagement from other organisations/agencies across government - Need a mandate - Transparency - Ensuring quality, peer review | Data Integration operations unit Other | Operations unit - ID team Strategy unit - AD team for one specific data linking project (IDI) Data integration network - responsible for holding knowledge about data integration methodologies | - Integrated Data Unit created to manage the operation of the linked data system (IDI), they are a production team, they also manage access to the linked data. | Yes, in all cases | Yes, in all cases | Yes, in most cases | No | No | Yes | Yes | Yes | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | No information | No information | No information | No information | No information | Ongoing production of statistics with data integration included in the business process | No information | No information | No information | No information | No information | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | No information | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | No information | No information | No information | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | No information | No information | No information | Ongoing production of statistics with data integration included in the business process | No information | No information | No information | To supplement surveys (e.g. for a part of population, for a set of variables) For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) To provide geospatial products For customised data services To create statistical products in partnership with other organisations | Survey data Census data Commercial transactions (2210) Credit cards (2240) Data from public administration (2100) Medical records (2110) | R SAS SQL Other commercial tools | IBM Quality Stage | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) | http://www.stats.govt.nz/about_us/legisln-policies-protocols.aspx | On an ad-hoc basis | Yes | https://www.degruyter.com/view/j/jos.2017.33.issue-2/jos-2017-0023/jos-2017-0023.xml | Yes | Yes | Yes - providing training | Strategies for success Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes | Points Polygons | Resolution Scale | Address Building Dwelling Business Statistical units | Yes | Your organisation | Geospatial data is available but is too expensive Statistical information is not collected in a way that makes geocoding possible or meaningful No uniform reference system between different administrative data sources | Single points (coordinates) such as address locations, buildings or locations of real estates (cadastral parcels) | Other | Quality of input data | http://www.stats.govt.nz/browse_for_stats/snapshots-of-nz/integrated-data-infrastructure.aspx | ||||||||||||||||||||
| 2018-01-23 02:00 | National Institute of Statistics and Geography (INEGI for its acronym in spanish) | México | 1500 or above | The information provided can be shared publicly as part of the guide | Luis Gerardo Esparza Ríos, Deputy Director General of Geospatial Information Integration | gerardo.esparza@inegi.org.mx | In Mexico there is a National System of Statistical and Geographic Information that is governed by a Law (LSNIEG) that considers as an important aspect in statistical activities the integration of data of National Interest Information. The LSNIEG promotes the application of technical standards to regulate the generation and integration of information and with this information, a set of Key Indicators is developed that aims to offer the Mexican State and society in general, information that is needed | Organisation wide strategy in place National/whole of government strategy in place Multi-country/international strategy under development | In the National context, in 1978 INEGI was created the National Geostatistical Framework (MGN) with the objective of associating census information and statistical survey with the corresponding geographical area. The codification of each geostatistical area provides unique and specific identity of the geographical space that occupies in the country, a situation that allows the association of the statistical and geographical data that it contains. http://www.inegi.org.mx/geo/contenidos/geoestadis |
Reduce budget needed to produce the same kind of data Improve quality in data generation The generation of information through the standardization of processes and they have the requirements of relevance, conceptual solidity, reliability, timeliness, accessibility, comparability, sufficiency and ease of consultation. The use of information is widespread among all public and private institutions to publicize official public. |
The coordination between different public and private institutions for the use of information, publication of results and in some cases the lack of cooperation provide their administrative records for the improvement of information. Make agreements among involving different actors with no functional relationships among them | Data Integration strategy unit Data Integration operations unit Data integration governance committee Management/support of whole of government data integration activity Management/support of international data integration activity Other | Working groups that integrate people from several units | To provide to the society and the State with quality, pertinent, truthful and timely information, in order to support national development. | Yes, in all cases | Yes, in all cases | Yes, in all cases | Yes, in some cases |
The Federal Law of Transparency and Access to Governmental Public Information guarantees confidential and personal data, and only allows to publish “information needed for statistical, scientific or other general purposes provided by Law, as long as said information is not related to the personal data of the person to whom the information belongs”. Unawareness of the users of the place where the information can be found, as well as the topics worked by the National Institute of Statistics and G |
Requests for information, not confidential, must be addressed in terms of the applicable provisions. | Yes, partly (e.g. not comprehensive) | Yes, partly (e.g. not comprehensive) | No | Yes | Cooperation agreements for transferring the data Collaboration in the preparation of legal documents establishing and/or maintaining use of data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) To create statistical products in partnership with other organisations To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data Commercial transactions (2210) Data from public administration (2100) Logs (3110) Social Networks: Facebook, Twitter, Tumblr etc. (1100) | R SAS SPSS SQL Oracle Other commercial tools Other in-house developed tools Other open source tools |
In the present time the in-house developed tools are not allowed for the outide users use. Informatica Data Quality (https://www.informatica.com/mx/products/data-quality/informatica-data-quality.html) Postresql (https://www.postgresql.org) PostGIS (http://postgis.net/) Mapserver (http://mapserver.org/) |
Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) Other | As integral part of quality reporting | Yes | Yes | Yes | Yes - obtaining training | Strategies for success Developing effective partnerships Governance Legislation issues Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes | Points Polygons Lines | Resolution Scale Quality Accuracy Update processes | Address Building Dwelling Statistical units | Yes | Your organisation | Lack of knowledge Geospatial data is available but is too expensive Legal or bureaucratic restrictions on availability of administrative data (e.g. public institutions don’t cooperate well) Administrative data stored in a way that makes geocoding impossible (lack of identifiers to connect to geographical locations) Statistical information is not collected in a way that makes geocoding possible or meaningful | Combination of both (different data in different parts of the country) | No big problems but there is room for improvement | ||||||||||||||||||||||
| 2018-01-23 02:00 | Israel Central Bureau of Statistics | Israel | 500 - 1499 | The information provided can be shared publicly as part of the guide | Sigalit Mazeh | sigalit@cbs.gov.il | - | Organisation wide strategy under development National/whole of government strategy under development | ICBS is in the process of organizing the National Statistical System of Israel. We expect the NSS to develop integration practices as part of the coordination mechanisms to be put in place. GIS: In order to produce the statistics, we have an organization wide methodology and anchoring process. There is a significant use of GIS tools in the production of statistics and in the publication of statistics at various geographical resolutions. | 1. National data integration practice are essential for the NSI to fulfil ots role of main or only statistical authority allowed to integrate data from different sources, including administrative files from different ministries. 2. Interation data with maps is one of the major input needed for planning regional development programs and following their implementation 3. Micro and macro integration is a corner stone for qualty assurance in national accounts. | 1. Making sure to provide the NSS members with a win-win situation 2. Harmonization of variables, definitions, geografic report areas 3. Full and standard metadata accompanying any data 4. Overcoming "information is power" | Data Integration strategy unit Data Integration operations unit Management/support of whole of government data integration activity | The Israeli government decided on the creation of a unique senior department of Strategic Affairs and Planning in each large government body. The ICBS senior department of Strategic Affairs and Planning will initiate all matters of data integration in order to optimize information based decision making. | Lack of knowledge about the administrative files or data bases existing in the government | Yes, in all cases | Yes, in all cases | Yes, in most cases | Yes, in some cases | Access to all data is subject to a general limitation Section 8 of the Basic Law: Human Dignity and Liberty, requiring that any request or demand for data that impacts on privacy stand by the following criteria: the purpose of the demand/request is reasonable and the impact on privacy does not exceed what is necessary for its purpose. In the transfer of data between public bodies, regulations mandate that each request for the transfer of data be examined by both the party making the request/dema | Yes | Yes, partly (e.g. not comprehensive) | No | Yes, partly (e.g. not comprehensive) | Cooperation agreements for transferring the data Collaboration for determining coverage, concepts and/or definitions in the data Collaboration in the preparation of administrative or statistical classifications used for data Long-term partnerships (formal or informal) which consist of two or more institutions using the same data | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | Research/experiment/feasibility study | No information | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | No information | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | Ongoing production of statistics with data integration included in the business process | One off/customised production of statistics | No information | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | Ongoing production of statistics with data integration included in the business process | As a source for sample frames To supplement surveys (e.g. for a part of population, for a set of variables) To supplement traditional censuses (e.g. register based population census, agricultural census) For replacing traditional censuses (e.g. register based population censuses, agricultural census) For maintaining registers For data validation For data editing and/or imputation For estimation (e.g. small area estimation) To provide geospatial products For customised data services To meet the requirements of measuring the Sustainable Development Goals (SDGs) | Survey data Census data Car/vehicle location (3122) Commercial transactions (2210) Credit cards (2240) Data from public administration (2100) E-commerce (2230) E-Mail (1900) Satellite images (3123) Traffic sensors/webcam (3113) | R SAS SQL | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) | ICBS is in the process of organizing the National Statistical System of Israel. We expect the NSS to develop integration practices as part of the coordination mechanisms to be put in place. GIS: In order to produce the statistics, we have an organization wide methodology and anchoring process. There is a significant use of GIS tools in the production of statistics and in the publication of statistics at various geographical resolutions. | On an ad-hoc basis | Yes | Quality framework: CoP and QAF for ENP-south countries and GSBPM | Partly | No | Yes - obtaining training | Strategies for success Developing effective partnerships Pre-integration practices Tools / Information Technology Methods Quality frameworks | Yes | Points Polygons Lines | Resolution Scale Quality Accuracy Update processes | Person Address Building Dwelling Business Cadastral parcels Statistical units | Yes | Your organisation | No legal support for spatial statistics Administrative data stored in a way that makes geocoding impossible (lack of identifiers to connect to geographical locations) | Combination of both (different data in different parts of the country) | No big problems but there is room for improvement | |||||||||||||||||||||||
| 2018-01-23 02:00 | Hungarian Central Statistical Office (HCSO) | Hungary | 500 - 1499 | The information provided can be shared publicly as part of the guide | Zoltán Vereczkei | zoltan.vereczkei@ksh.hu |
According to the Hungarian adaptation of the GSBPM (called: ESTFM), data integration is defined as: In short: link/match dataset from 2 or more sources. Data integration is considered as an activity within „Process” phase of our statistical business process model. The inputs of the integrated/linked dataset could be datasets that are produced/managed by the institution or any other dataset that comes from outside of the institution and of course any combination of these. If the datasets to in |
We do not have strategies for data integration specifically. | Yes. As for official statistics, it is important ot have access to any kind of data (also: promptly and free of charge, if possible), if the National Statistical Organisations have a leading role in this, this can also facilitate the integration of these dataset into statistical business processes thus further lowering the administrative burden and increase quality of the statistical information by identifying and using more validation solutions in the statistical business processes | Yes. Once this role assigned to a National Statistical Organisation, the questions of "free or charge?" and "who will have access to this information, the institution only or others as well?", "what about access for scientific purposes". Therefore a real strategy will be needed on day 1 to address these issues. Trust (which is not a legal issue) is also a serious challenge, therefore success stories, case studies are needed to convince both the owner of such datasets and the general public there | Other | The HCSO does not have a dedicated, specific function/unit for data integration. Data integration is carried out at various department of the institution with the Methodology Department available for methodological support (if needed). | Not applicable for Hungary. |
The barriers can be different to different kind of data sources. In case of Hungary, for example, the barriers are challenges are not that significant due to the established legal background and experience. In case of access to privately hold data for example, the barriers are much more significant. Some barriers, however, are generic and not really data source specific. Such as: lack of metadata or quality issues. |
Yes, in all cases | Yes, in most cases | Yes, in all cases | Yes, in some cases | No | Yes | Yes, partly (e.g. not comprehensive) | Yes, partly (e.g. not comprehensive) | Cooperation agreements for transferring the data Collaboration in the preparation of administrative or statistical classifications used for data | Research/experiment/feasibility study | Research/experiment/feasibility study | Research/experiment/feasibility study | Research/experiment/feasibility study | To supplement surveys (e.g. for a part of population, for a set of variables) For replacing sample surveys For data validation For data editing and/or imputation | Survey data Census data Car/vehicle location (3122) Credit cards (2240) Internet searches (1600) Logs (3110) | R SAS SQL | Deterministic record linkage (links based on individual identifiers that match among the available data sets) Probabilistic record linkage (linking two pieces of information together using multiple, possibly non-unique, keys) Other | As integral part of quality reporting | No quality framework is used but there is case by case consideration of quality issues | Tools / Information Technology Methods Quality frameworks | Yes | Don't know | Don't know | Address | Don't know | Lack of knowledge Geospatial data is available but is too expensive Lack of data resources Lack of other resources | Weak internal support - the benefits are contested Scarce resources Restricted access to geospatial information needed for geocoding |
Überblick
Community Forums
Inhalte
ThemeBuilder