STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to...
Transcript of STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to...
![Page 1: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/1.jpg)
STATUS OF THE SDMX
IMPLEMENTATION AT INEGI
7th Meeting of the Expert Group on SDMX
27 October 2014, Seoul, Korea
![Page 2: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/2.jpg)
ON PRODUCTION
![Page 3: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/3.jpg)
INEGI’s site has an SDMX section
which is open to the public Contains: • Descriptions and tutorials to understand the
standard • Links to download SDMX tools from CIRCA • URL building interface for querying the REST
web service • Download of dataflows, DSDs, code
lists • Guides to make use of the web services
• Explanations and examples on how to make graphs to visualize the flows
• Developers section
![Page 4: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/4.jpg)
SDMX Infrastructure at INEGI
DSW v1.2.7
Produces DSD
Mapping Assistant v2.9.0
Mapping
Dissemination Databases
Queries
SDMX-RI v2.4.4
REST (SDMX 2.1 final)
SDMX-RI v4.0.6
REST (SDMX 2.1 final)
Uses
Produces Produces
Test Production
SDMX Dataflow
XML JSON CSV XML
Uses
SDMX Dataflow
Mapping Assistant v3.1.3
![Page 5: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/5.jpg)
Additional formats supported
• JSON (since 2012)
• JSONP (since 2012)
• CSV (since 2012)
![Page 6: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/6.jpg)
Collection Tools
• Portable versions of Mapping Store and
Mapping Assistant (2.9)
– Generation of CSV based on DSD
– Oriented to collect information from institutions with
limited computational resources
![Page 7: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/7.jpg)
Available SDMX Flows
• Short Term Economic Indicators (STEI)
• Short Term Economic Statistics (STES)
• Quarterly Gross Domestic Product (GDP)
• Goods Commercial Trade of Mexico: – HS2007, years 2010-2011
– HS2012, years 2012-2013
• Millennium Development Goals Indicators (MDG).
• Infra Annual Labor Indicators – Quarterly
– Monthly
![Page 8: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/8.jpg)
UNDER DEVELOPMENT
![Page 9: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/9.jpg)
Renewing the SDMX Infrastructure
• Adoption of the new Eurostat’s SDMX RI which
implements the CommonAPI
– Testing
– 17x time improvement
![Page 10: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/10.jpg)
New version of the SDMX Section
• Better look and
responsiveness
• Implementation of new
visualization
components based on
D3 and AngularJs
![Page 11: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/11.jpg)
Domestic exchange
• Pilot test to collect information from a Federal
Department
– Identification of technical capabilities to select
prospective partners
– Planning and agreement building
– Adapting RI components
![Page 12: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/12.jpg)
Collaboration with other Countries
• Collaborating with ILO to review the DSDs – 47 DSD with 90 concepts each
• Joint collaboration with ISTAT for Implementing the CommonAPIs – We have reviewed the actual
implementation, now we are going to start filling the gaps
![Page 13: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/13.jpg)
Updating SDMX Flows • Quarterly GDP
– Adoption of SDMX National Accounts-Data Structure Definition (NA-DSD)
• Commercial Trade of Mexico – Adoption of the DSD from UNSD to provide information to
COMTRADE
• MDG indicators – New DSD with additional Indicators from Mexico
• Labor Statistics – Pilot test of new dataflows for ILO
![Page 14: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •](https://reader034.fdocuments.in/reader034/viewer/2022050601/5fa845e8dc26b80740377c08/html5/thumbnails/14.jpg)
Conclusions
• SDMX implementation has become a mix of project and continuous process
• New version of SDMX has brought a necessary (r)evolution of technical and conceptual aspects
• The new RI-SDMX with the Common API is elegant but it needs to be complemented with “Custom Data Formats” for CSV and for JSON, in Structures and in Data
• SDMX need to still relevant in the age of the “Data Revolution”