Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS...

Statistisches Bundesamt

eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS

Joint ECE/Eurostat/OECD Meeting on the Management of Statistical

Information Systems (MSIS)

(Bratislava, Slovakia, 18-20 April 2005)

Michael Schäfer

- IT-Development -

Federal Statistical Office, Germany

© Statistisches Bundesamt, Referat II C 4


Profile of eSTATISTIK.core

CORE = Common Online Raw Data Entry „Common“: a single point of delivery (URL)

regardless of survey and collecting office Economic statistics Integrates IT systems of reporting businesses and

administrations and those of the collecting offices Allows automated reporting (compilation,

transmission, validation, forwarding, transformation)

Can significantly reduce the burden of respondents Generic (XML, metadata-driven software)



Political and organisational frame

Co-operation with the targeted user community Respondents, service providers and software producers

(Lufthansa, Datev, SAP, Peoplesoft, Oracle, UBM, …), represented by the AWV (Working Party for Economical Administration); WG established in early 2003

Part of the common strategic program of the German statistical offices („Masterplan“, „eSTATISTIK“)

Submitted to the national eGovernment initiative „Deutschland Online“ for standardisation



Data Collection

Server

Recognition,validation,forwarding

Architecture of eSTATISTIK.core

HTTPS(OSCI)

Stat.Office

Stat.Office

Stat.Office

Stat.Office

DatML/RAWRaw data

DatML/ASK

Questionnaire

definition

DatML/RESProtocol

DatML/SDFSurvey definition

ERP system

Statistics module

CORE.connect

HR

Accoun-ting

Etc.

Compilation, validation,download, upload,authentication (user, passw.)

+ history, user mgmt, forms

CORE.reporter

CORE.connectASCIICSV

ECXEL

Etc.



Metadata management

Web Service

ResourceDB

MySQL

Statspez

SDF Editor Data Edit Designer

Questionnaire Editor

Word, Acrobat

DatML/SDF

DatML/EDT(+variables)

DatML/ASK

DatML/MAP

Datasetdefinition(INI)

documentation

Java classes

Stat.Office

Stat.Office

Stat.Office

Linux

Resource id after release:

statistics.refp.offid.restype.ver



Components of eSTATISTIK.core

1. Infrastructure A single point of delivery on the internet

2. Data Standardised XML document types for raw data, survey definitions

and protocols

3. Client software Libraries for integration into ERP systems (CORE.connect) A stand-alone application with an interactive GUI (CORE.reporter) Compilation, upload, download, validation

4. Server software Java-based server applications Recognition, validation, decompilation and forwarding Protocol management



Features of the common raw data entry

Automated detection, validation & forwarding of raw data messages for any survey and any collecting office

Validation against electronic survey definitions (Automated) download of survey definitions and

protocols Identification and authentication of respondents by

means of user id and password Secure transmission (HTTPS, OSCI)



XML document types

DatML/RAW for statistical raw data Generic, cross-survey, supports third-party reporting and collection Supports acknowledgement requests, testing, address updates A single document may contain any number of raw data messages

DatML/SDF for survey definitions Survey identification, reference period, periodicity, etc. Input and output data models (variables and structures) Useful for both compiling and validating DatML/RAW documents

DatML/RES for protocols For documenting delivery and validation of DatML/RAW documents Generic, cross-survey, supports third-party reporting and collection



Supporting software: CORE.connect

Businessdata

repository

ERP system DatML/SDF

Statistics module

CORE.connect

DatML/RAW

Software library for easy implementation of eSTATISTIK.core into business IT systems(ERP systems)



Supporting software: CORE.connect

Supports respondents and software producers in the implementation of eSTATISTIK.core

Supports/provides client-side functionalities Compilation Validation against DatML/SDF survey definitions Automated connecting, authentication and upload Automated download of DatML/SDF and DatML/RES documents

Transport protocols: HTTPS, OSCI (Online Services Computer Interface (planned))

APIs: JAVA, C/C++ (JNI)



Supporting software: CORE.reporter

DatML/SDF

Data(ASCII-CSV,

EXCEL,. . . )

CORE.reporter

CORE.connect

DatML/RAW

Java application with GUI for creating DatML/RAWmessages from files (mapping approach) andforms (off-line)

HTTPS / OSCI



Supporting software: CORE.reporter

Targets respondents without ERP systems (small businesses)

Features Stand-alone Java application with a GUI, using CORE.connect Mapping facilities for loading raw data from files (CSV, EXCEL,

will be extended) Support of forms (DatML/ASK) for entry and display of raw data

(planned) User / client management for third-party respondents, history Uses CORE.connect for validation, download and upload Driven by DatML/RES survey definitions



Project state

Productive for two selected wage statistics since March 2005 (CeBIT).

Supporting software released in March 2005 Statistics modules to be implemented by SW

producers (SAP, ORACLE, PeopleSoft, DATEV, P&I, UBM Drecker) by mid-2005

To be productive for selected economic statistics by the fourth quarter of 2005.



Information and contacts:

eSTATISTIK.core:

http://www.statistik-portal.de

Mr. Christian Bösnecker, phone 0611/75-3361,

[email protected]

Mr. Michael Schäfer, phone 0611/75-3652,

[email protected]



Thank you very muchfor your attention!

Any questions?

Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS...

Documents

Transcript of Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS...