Statistics Portugal

«

29-30 September 2008

Techical approval of surveys

Joint UNECE/Eurostat/OECD Work Session on Statistical

Metadata (METIS)Lisbon, 11– 13 March, 2009

Ana Paula Guerra (ana.guerra@ine.pt)Isabel Morgado (isabel.morgado@ine.pt)

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

I.1Feasibility

Study

SpecifyNeeds

Phase: Design

Process:

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

I.2 MethodologicalStudy

Design+

Build

Phase: Design

Process:

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

Phase: Production

Process:

II.1 Planning andPreparation

Build (3.5)+

Collect (4.1, 4.2)

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

Phase: Production

Process:

II.2 Collection

Collect+

Process (5.3)

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

II.3 Process andAnalyse

Process+

Analyse

Phase: Production

Process:

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

Phase: Dissemination

Process:

III.1 Dissemination Dissemination

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

IV.1 Evaluation Evaluate

Phase: Evaluation

Process:

Business Process Model

II. Production

II.1 Planningand

Preparation

II.2Collection

II.3 Processand Analyse

III.Dissemination

III.1Dissemination

IV. Evaluation

IV.1Evaluation

Phases

I. Design

I.1Feasability

Study

I.2Methodologi

cal Study

I.3 TechnicalApproval

Processes Processes Processes Processes

Business Process Model

Phase: Design

Process:

I.3 TechnicalApproval

(of surveys)

Methodological documents

Data collection instruments

Regist

ratio

n

Ana Paula Guerra (ana.guerra@ine.pt)

« «STATISTICS PORTUGAL

Methodological Documentation

Joint UNECE/Eurostat/OECD

Work Session on Statistical Metadata

(METIS)

Lisbon, 11 – 13 March, 2009

IntegratedMetadataSystem

Concepts Subsystem

ClassificationsSubsystem

MethodologicalDocumentsSubsystem

Data CollectionInstrumentsSubsystem

Variables Subsystem

Statistical Metadata System

• The Metadata System (current system)

Access: homepage of the Official Statistics website – Portal (http://www.ine.pt/)

Statistical Metadata System

• Main purposes

Central metadata repository

Common terminology

Improve statistical literacy

Homogeneous technological environment

Standard documentation of surveys

Methodological document (DMet)

Support surveys life cycle

Technical approval

Integrated

Metadata

System

For technical opinion

For certification

For approval

DESIGN TECHNICAL APPROVAL PRODUCTION

Valid

Coordinator

Director

Not valid

Survey Manager

Coordinator

Survey Manager

Director

SURVEY LIFE CYCLE

HISTORY

Under Construction

Technical approval/ /Methodological document workflow

• Stages

DMet

• Characteristics

Core subsystem (implementation: 2004)

Standard documentation of surveys (in force: 2005)

Standard format (contents)

General characterization

Methodological characterization

Concepts

Classifications

Variables

Data collection instruments

Abbreviations and acronyms

Bibliography

Methodological

Documents

Subsystem

Technical approval/ /Methodological documentation

Product (output) that gathers, in Product (output) that gathers, in a coherent way, all the metadata a coherent way, all the metadata

generated during the survey generated during the survey design phase design phase

For technical opinion

For certification

For approval

DESIGN TECHNICAL APPROVAL PRODUCTION

Valid

Coordinator

Director

Not valid

Survey Manager

Coordinator

Survey Manager

Director

SURVEY LIFE CYCLE

HISTORY

Under Construction

Technical approval/ /Data collection instrument (D.C.I.)

• Stages

D.C.I.

• Characteristics

Repository of questionnaires used in NSS (aprox.: 3500)

Access to historic information (background)

Access to detailed information (contents)

General characterization (status/registration number (ID_code)/

name/validity/statistical area/responsible entity/geographic coverage/ periodicity/type of instrument)

Methodological characterization (collection method/respondent

entity/statistical observation unit)

Data collection instrument (image)

Methodological document (subsystem link)

Variables (subsystem link)

Data

Collection

Instruments

Subsystem

Data collection instruments

Instrument used for data Instrument used for data collection and for which an collection and for which an

identification can be specified identification can be specified by means of an attribute by means of an attribute

=> => final act of the technical final act of the technical approval approval

Methodological documentation/ /Data collection instruments

METHODOLOGICAL METHODOLOGICAL DOCUMENT/DOCUMENT/

(DMet)(DMet)

New survey or Changes in the survey due to: changes Business Proccesses

reflects: DMet contents

consequence: DMet new version

New survey = new questionnaire or Changes in the questionnaire due to: changes observation variables

reflects: questionnaire contents

consequence: questionnaire new version

substitutionsubstitution

substitutionsubstitution

system

/DATA /DATA COLLECTION COLLECTION

INSTRUMENTINSTRUMENT (questionnaire)(questionnaire)

WHEN TO CREATE WHEN TO CREATE A NEW VERSION A NEW VERSION OF AOF A

due to: changes in validity period

reflects: questionnaire validity date

consequence: maintains ID_code/changes date prorogationprorogation

Methodological documents subsystem

Userinterface

Methodological documents subsystem

Userinterface

Methodological documents subsystem

Userinterface

Methodological documents subsystem

Managementarea

Search

PDF file loading

Loading without link

Cont@ct us

Methodological Documents - Management

Data collection instruments subsystem

Userinterface

Data collection instruments subsystem

Userinterface

Data collection instruments subsystem

Userinterface

Data collection instruments subsystem

Userinterface

Presentation

Search

Advanced search

New register

Prorogation

Translation (name)

Historic information

Respondent entities

Users (internal)

General documentation

Contac@t us

Data Collection Instruments - Management

Managementarea

Data collection instruments subsystem

«

«

Methodological Documentation

Isabel Morgado (isabel.morgado@ine.pt)

Joint UNECE/Eurostat/OECD Work Session on Statistical

Metadata (METIS)Lisbon, 11– 13 March, 2009

Next Steps

«Methodological Documentation System

«

Methodological Document

Quality Report

Euro-SDMX

….

Towards a universal archetype for reference metadata

«

Methodological Document

«Standard format:

Methodological document

for

survey

General characterization,

Methodological characterization,

Concepts,

Classification,

Variables,

Data collection instruments,

Abbreviation and acronym,

Bibliography.

«Methodological Document Structure

Methodological Document

Survey

Variables

Observation

Derived

Indicators Dimensions

Collection Instruments

Questionnaires

Data Files

Concepts used

Classifications used

Products

«Euro-SDMX

«Standard format:

Euro-SDMX for Data set Contact,

Metadata update,

Statistical presentation,

Unit of measure,

Reference period,

Institutional mandate,

Confidentiality,

Release policy,

Dissemination,

Accessibility,

Quality management,

……..

ESMS(MSD)

Data set

«Standard Quality Report

«Standard format:

Quality report for Statistical process

Introduction,

Relevance,

Accuracy,

Timeliness and Punctuality,

Accessibility and clarity,

Coherence and comparability,

Trade-off between Output Quality Components,

Assessment of User Needs and Perceptions,

Performance, Cost and Respondent Burden,

Confidentiality, Transparency and Security,

Quality Report(MSD)

Statisticalprocess

«Methodological Documentation System

«

Standard formats - MSD’s

Cross Domain Concepts (shared)

Documentation of a particular “Level of attachement”

What in common?

«Methodological Documentation System

«

Common infrastructure based on SDMX model

Diferent reports depending on different MSD’s

Reutilization of the same concept content

in different reports

A possible solution:

«Methodological Documentation System «

Methodological document

Euro-SDMX

Standard Quality Report

Other reports

Interface

Methodological Documentation (MSD’s)

Concepts

Variables

Classifications

Products Data Collection Instruments

…

«Methodological Documentation System

«

1. Analysis of existing implementations

2. ESSnet on SDMX: common solution for Euro-SDMX?

3. Generalization for other report types?

Implementation:

«Methodological Documentation System

«

Thank you for your attention