1

September 2012

SDMX Implementation at the Statistics Korea

ContentsContents

BackgroundI

KODAPS & SDMX ImplementationII

Future PlansIII

2

Background

“Inefficiency resulting from non-standardized data exchanges ”

“Problems such as redundancy in work, service delays or mistakes”

Organizations

STATISTICS KO-REA

Govern-mental Agencies

OECD 40 statistics, 13 organi-zations

Other Int`l organizations (11) 17 statistics, 8 organiza-tions

Data Collection

Data Pro-cessing

Transmit

Download KOSIS into Excel file

Process data in requested for-mat

Inconvenience of repeated work for

each request

Data request

Data

request

3

will be developed

KOSIS KODAPS

WEBService

Transmission

Data input

SDMXDB linkage

(e-mail)

SDMX file

(Pull)

(Push)

Int’l data col-lector

4

KODAPS (Korean Data Provision system) to-be Model

Phase 1

KODAPS Development Plan

Automatize data provision to interna-tional organizations previously done manuallyDevelop system (manage users and register requests, manage data, data requests)Apply SDMX ver 2.0

Phase 2

Enhance the system to make various functions easy to use (KOSIS data link, data entry, manage functions)

Apply newest version of SDMX (ver2.1)

Development Period : 2011 4-12

Development Period : 2012 4-12

Develop SDMX web service

AUTO SDMXVer 2.0

WEBService

SDMXVer 2.1

5

Basic Level

Enhancement level

User screen

an informant

System manager

• Data generation/ management• E-mail

• User management

• Log/Code management

Request Manage-ment

Data Management

Data provision

User & LogManagement

Information Man-agementKOSIS DB

• KOSIS DB linkage

• Data services

KODAPS Work Flow

6

Information requestor

• Data request

• E-mail reception• Download/ Direct extraction

E-mail

KODAPS(1)- Request Management

Request Man-agement

Data Manage-ment

Data ProvisionUser & Log

ManagementInformation

Management

Search condition

List of Re-quests

Basic information of the selected request

The list of data sets linked to the selected request

7

8

KODAPS(2)- Data Management

Statistics Do-main

Data Code Statistics

Request Man-agement

Data Man-agement

Data Provi-sion

User & Log Man-agement

Information Management

- Data management – KOSIS linkage

Search conditions

List of generated data

9

KODAPS(2)- KOSIS Linkage

List of statistical tables in KOSIS

List of items and classifications in a table

Data Generation

Search condition

10

KODAPS(3)- Dataset List for Transmission

Same requesting ID

Request Man-agement

Data Man-agement

Data Pro-vision

User & Log Man-agement

Information Management

- Dataset List for Transmission – Data Generation for Transmission – provide management

Search Condition

Mapping List of Requests and data sets

Information of the selected row in the mapping lists

11

KODAPS(3)- Dataset List for Transmission

Request Man-agement

Data Man-agement

Data Provi-sion

User & Log Man-agement

Information Man-agement

- Dataset List for Transmission – Data Generation for Transmission – provide management

Provided Data Search

KODAPS(4)- Data Provision

12

Request ID Request

Genera-tion

Request Man-agement

Data Man-agement

Data Provi-sion

User & Log Man-agement

Information Management

- Dataset List for Transmission – Data Generation for Transmission – provide management

Search Condition

List of Requests

Data Genera-tion

(SDMX)

Under Construction(1)-DSD Management

13

Request Man-agement

Data Man-agement

Data Provi-sion

User & Log Man-agement

Information Management

-Co code – Organization code – SDMX DSD Management – Board management – status of providig

14

Under Construction(1)-DSD Management

SDMX DSD Register & modification

Request Man-agement

Data Man-agement

Data Provi-sion

User & Log Man-agement

Information Management

-Co code – Organization code – SDMX DSD Management – Board management – status of providig

Provide data file via REST URI

DSD data management process

KODAPS

DB

WAS

User(External System)

WEB-SERVICE RESTful API

JDK 1.5 or aboveJAX-RS

KOSIS

DB

Manage DSD, Compact Schema files

Interpret requested URI

OECD

INFRA_ANNUAL_LABOUR

STES

UN

KOSTATData

Administrator

Send via EmailDSD file, Compact

schema

Register DSD data by or-ganization

Manage DSD by organization, data

Manage Compact Schema by organization, data

Manage KOSIS DB mapping by data

Requested data mapped to KOSIS DB

Request URIhttp://stat.kosis.kr/kodaps/ws/data/

OECD,STES,1.0/M.KR.LFACT-TFE.ST.PR

etc...Extract data for agency (Agency, KeyFamily)

Extract numeric data by period or point of time (DataSet)

Create data file (Generic/Compact Data XML)

Transmit XML file(SDMX format)

Under Construction(2)-Web Service Plan

3

5

2

1 4

1 23

4

15

KODAPS in Use

16

Regarding Data Provision to Int’l Organizations (Since May 2012) MEI(Main Economic Indicator), TCB(The Conference Board) and MBS (Monthly

Bulletin Statistics) data are compiled monthly via KODAPS and sent by e-mail manually

Regarding Pilot project on STES (Since the second half of 2011) Applied separated STES DSDs (labor, STES) to the system (April,

2012) Generated SDMX data file according to the pre-defined DSD (July,

2012) Its validation is going on in the OECD

Finish successfully “KODAPS Enhancement Project” by this December to adopt SDMX version 2.1 to develop SDMX Web Service (Pull method) to make it more convenient to use

Participate actively in the OECD Pilot STES

Open this system to other domestic agencies in order to prevent inefficient use of resources (e.g. development of du-

plicate system) hard to make its use mandatory through legislations or regulations

The help of the International Organizations will be crucial for this.

Propose to host “The SDMX Expert Group Meeting” in Korea in 2014

17

Future Plans

18

Kang, Yu-GyungDirector,

Statistical Information Portal division

E-mail: summaul@korea.kr

Phone: 82-42-481-2377

Fax : 82-42-481-2474

Thank you for your listening.

19

Provider Data List Provider Data List

Statistics Korea (9)

STRUCTURAL STATISITCS FOR INDUSTRY AND SERVICESBUSINESS STATISTICS BY SIZE-CLASSMAIN ECONOMIC INDICATORS ECONOMICALLY ACTIVE POPULATION SURVEYPPP(PURCHASING POWER PARITIES)PROGRAMME CPI RECLASSING DATAINCOME DISTRIBUTION INDICATORSCOMPOSITE LEADING INDICATORPOPULATION PROJECTIONS

The Bank Of Korea (5)

NATIONAL ACCOUNTS(ANNUAL)NATIONAL ACCOUNTS(QUARTER)BALANCE OF PAYMENTSSERVICE TRADEMONEY-FLOW

Ministry of Education, Sci-ence and Technology (2)

EDUCATION STATISTICSRESEARCH AND DEVELOPMENT STATIS-TICS

Ministry of Health and Wel-fare (2)

HEALTH CARE STATISTICSHEALTH CARE INDICATORS QUALITY

The Ministry of Knowledge Econ-

omy(9)

OIL SUPPLY AND DEMAND(MONTHLY)CRUDE OIL IMPORTS RECORD(MONTHLY)OIL SUPPLY AND DEMAND(ANNUAL)FOREIGN DIRECT INVESTMENT STATISTICSCOAL SUPPLY AND DEMAND(ANNUAL)NATURAL GAS SUPPLY AND DEMAND(ANNUAL)ELECTRICITY & HEAT SUPPLY AND DEMAND (ANNUAL)RENEWABLES AND WASTES SUPPLY AND DE-MAND(ANNUAL)GAS SUPPLY AND DEMAND(MONTHLY)

Ministry of Public Adminis-tration and Security(1)

ICT INDICATOR

Ministry of Land(1)

REGION STATISTICS

Ministry for Food, Agricul-ture, Forestry and Fisheries

(1) FISHERIES STATISTICS

Ministry of Employment and Labor(1)

EMPLOYMENT PROJECTION

Korea Customs Service (1)

TRADE STATISTICS

Ministry of Strat-egy and Finance

(6)

TAX STATISTICSDISBURSEMENTS AND COMMITMENTS OF OF-FICIAL AND PRIVATE FLOWSFOREIGN DIRECT INVESTMENT STATISTICSTHE MULTINATIONAL CORPORATIONS MAN-AGEMENT ACTIVITIESTAXATION WAGES CENTRAL GOVERNMENT DEBT BY INSTRU-MENT

Road Traffic Authority(1)

INTERNATIONAL ROAD TRAFFIC STATIS-TICS

Financial Supervisory Ser-vice(1)

PRIVATE PENSION STATISTICS

40 statistics, 13 Providers

Data list provided to the OECD

Int’l Orga-nization

Provider Data ListInt’l Organi-

zationProvider Data List

FAO

Ministry for Food, Agriculture,

Forestry and Fish-eries

FISHERIES STATISTICS ESCAP Statistics Korea ESCAP SHORT-TERM INDICATOR

Statistics Korea FARMERS THE PRODUCER PRICE

UN

Statistics Korea ANNUAL POPULATION STATIS-

TICS

ILO

Statistics Korea CPI RECLASSING DATA Statistics Korea MONTHLY BULLETIN STATISTICS

Statistics Korea ANNUAL ABSTRACT OF LA-

BOR STATISTICSStatistics Korea INDEX OF PRODUCTION

IRTADRoad Traffic Au-

thorityTHE ROAD TRAFFIC STATIS-

TICS UNCTAD Ministry of Public

Administration and Security

COMPANIES ICT USAGE INDICA-

TOR

ITU

Korea communica-tions commission ICT MAIN INDICATOR

IMF

Financial Supervi-

sory Service

FINANCIAL SOUNDNESS INDICA-

TORSMinistry of Public Administration and Security

ITU COMMUNICATION AND

ICT INDICATORThe Bank Of Korea INTERNATIONAL FINANCIAL STA-

TISTICS

UIS

Ministry of Educa-tion, Science and

Technology EDUCATIONAL STATISTICS WHO Statistics Korea CAUSE OF DAETH

ADB Statistics Korea ADB MAIN INDICATOR 17 statistics, 8 Providers

20

Data list Provided to Other International Agencies