EurostatEurostat

ESS reference metadata implementation of standards and interoperability of

National/European metadata systems

Bogdan Sorin ZDRENTU, Eurostat (B5)Mogens Grosen NIELSEN, Statistics Denmark

Workshop on Standards-Based Modernization, Geneva 5-7 May 2015

EurostatEurostat

Background

• The work on the ESS reference metadata standardisation and the implementing strategy for the Single Integrated Metadata Structure (SIMS) was discussed during:

ESSC in November 2013, Joint DIME and ITDG meeting of 26-27 March 2014 , and Working Group on Metadata in July 2014.

•The work has been carried forward in 2014 in the Task Force on implementation of metadata standards (HR, DK, DE, EE, FI, FR, HU, IT, ES, SE, CH and TR).

EurostatEurostat

Policy context

1. Update of SIMS and alignment of ESMS and ESQRS;

2. Strategy for implementing the ESMS/ESQRS standards in statistical domains;

3. Technical interoperability between ESS and national metadata systems.

EurostatEurostat

State of play - implementation

EurostatEurostat

State of play - implementation

EurostatEurostat

Revision of ESQRS

EurostatEurostat

EurostatEurostat

Update of SIMS

• The concepts “Introduction”, “Dissemination format” and “Accessibility of documentation” are removed;

• The concepts “Coherence” and “Comparability” are merged to one concept “Coherence and Comparability” whereas the sub-concept “Comparability – domain” is removed.

Note: The impact on the metadata systems has been discussed in the Task Force on

implementation of metadata standards and it is considered feasible to adapt the metadata systems to the new standards by allocating sufficient time for the changeover (i.e. six months was considered realistic for this work).

EurostatEurostat

Strategy for implementing the ESMS/ESQRS standard structures in statistical domains

• Several criteria can help to decide if national reference metadata should use ESMS or ESQRS;

• ESMS or ESQRS must be implemented for all statistical processes, but more discussions are needed for the implementation of the standards;

• The work to establish a reporting structure for the ESS Inventory of Sources and Methods applicable to MIP's domains should be consistent with SIMS, and ESMS or ESMS together with ESQRS must be implemented. The work will continue to further explore and exploit the full potential of the existing standards;

• The work of the Committee on Monetary Financial Balance of Payments (CMFB) technical group on a short generic template for national reports on quality for the statistics underlying the MIP should be implemented through the use of ESMS and/or ESQRS in order to prevent a proliferation of standard report structures.

EurostatEurostat

Coverage of statistical process

EurostatEurostat

Challenges on implementing integrated metadata systems (DK)

• Traditionally the content and procedures on quality reporting have been solved by domain specific agreement

• Integration of metadata system at NSI level with metadata-systems at Eurostat level requires more coordination

• How to ensure that the standards are used and adhered to across domains and inside domains

• Metadata-systems at NSI and Eurostat must synchronize – both regarding work-processes and technical solution

• Need for a common document that describes architecture and interoperability to be followed by Eurostat and NSI’s

EurostatEurostat

Document with agreements on roles, technical solution and interoperability (DK)

• Title: “Stakeholders, technical architecture and interoperability for the exchange of reference metadata”

• Purpose: “to create a common understanding and agreement among stakeholders on exchange of reference metadata and its components in terms of responsibility, functionality, quality and terminology”

EurostatEurostat

Interoperability

EurostatEurostat

Technical interoperability

• Several NSIs have already adapted or are in the progress of adapting their national metadata systems to accommodate the ESS metadata standards;

• This would allow for a more automatic exchange of metadata from the national metadata systems to the European metadata system and vice versa;

• Need to develop and agree on the common requirements regarding interoperability;

• Different scenarios for the implementation have been analysed.

EurostatEurostat

Technical interoperability – future implementation

EurostatEurostat

Next steps (1)

• Approval procedure (ESSC) can start if DIME/ITDG agrees with the contents of the version 2.0 of the ESS reference metadata standards.

• Modifications on the European and national metadata systems should be done during the second half of 2015; the reporting in new version will be scheduled from January 2016.

• Depending on the target date for a full standardisation of the ESS reference metadata a detailed timetable for the implementation of the standards for a full coverage of the statistical processes will be drawn up accordingly.

EurostatEurostat

Next steps (2)

•The Task Force on metadata standards implementation has identified the need for trainings: on the tools for reporting on metadata and quality and on how to report good metadata on quality (i.e. content). Needed to be set-up already in 2015.

•Eurostat will continue to work in 2015 with a few countries for improving the interoperability of the national and European metadata systems.

EurostatEurostat

The Joint meeting of DIME and ITDG is invited:

• To approve the revised versions of the ESS reference metadata reporting standards (ESMS 2.0 and ESQRS 2.0) and the updated version of SIMS and the timetable for the implementation;

• To support the plan for further standardisation of European and national reference metadata relating to European statistics;

• To give feed-back on the work on improving the technical interoperability between the national reference metadata systems and the European metadata system.