IDEV EDR Software for Germany

24
1 IDEV EDR Software for Germany Presentation during the meeting of the Cord Working Group May 12, 2004 Luxembourg

description

IDEV EDR Software for Germany. Presentation during the meeting of the Cord Working Group May 12, 2004 Luxembourg. Historical Overview. Start of the W3stat Project for Intrastat1998 Filetransfer and Webform for Intrastat 2000 Interactive Data Entry (IDES) for Intrastat2001 - PowerPoint PPT Presentation

Transcript of IDEV EDR Software for Germany

Page 1: IDEV EDR Software for Germany

1

IDEVEDR Software for Germany

Presentation

during the meeting of the

Cord Working Group

May 12, 2004

Luxembourg

Page 2: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 2

• Start of the W3stat Project for Intrastat 1998

• Filetransfer and Webform for Intrastat 2000

• Interactive Data Entry (IDES) for Intrastat 2001

• W3stat for all central Statistics 2002

• IDEV prototype Software for EDR 2004

• IDEV, E-Workflow and .Core Integration 2005

Historical Overview

Page 3: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 3

Organisational Overview

Cooperation in Software Developement Common IT-standards

17 Statistical Offices

Federal Statistical Office16 State Statistical Offices

Page 4: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 4

different software in German statistics StBA: W3stat Intrastat

W3stat used for other centrally processed surveys

Statistik-Online (LDS NRW ) used by various other state statistical

offices (presented also at Cord)

Xima Software (Saxonia)

Integration of the Applications very different no standardization of processes

Technical Overview

Use of standardized applicationsnot possible or very difficult

Page 5: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 5

Initiative Bund Online 2005Federal Chancellor Gerhard Schröder in his address before the

Congress of the Initiative D21 "on 18.09.2000 at the Expo Hannover

„..The Federal Government will provide all services of the federal administration electronically by 2005..“

Political Overview

Deutschland-Online

Page 6: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 6

Statistical Data Flow

PSI NSA

E-Workflow

Produce Send Receive Edit AnalyseDissemi-

nate

Process Overview

EDR

Page 7: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 7

Solution

Common Layout Unified technical Architecture Portability of the Software common Interfaces Standardisation of functions and workflow common online rawdata entry

Concept for a Unified Software Solution for EDR

Portable Implementation based on modern technology

IDEV - Common Internet Data capture Software

Page 8: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 8

Layout

Page 9: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 9

Technical Architecture I

Internet

IDEV-WebServer Firewall Data Entry

Server

Processing

Encrypted

Other Edi MediaProvider of StatisticalInformation

Register

Application

Page 10: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 10

InternetFirewall

WWW-Server

Firewall

Authenti-fizierungs-

Server(Auszug

derRegistrier-Datenbank)

Firewall

Registrier-Daten-bank

Sachbearbeitung

ADABAS-Daten-banken(Register)

HTTP/HTTPS

HTTP FTP

Entire-X

HTTP

DMZ DMZ

Haus- / TESTA-Netz

NATURAL

Daten-Server

HTTP

(Login/Infos)

(DataInfos)

MAIL (Daten)

HTTP

FTP (Daten)

oderAufbereitung

Adress-Dateien

FTP(Statistikbezogene Informationen zurErhebung)

Technical Architecture II

Page 11: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 11

Java J2EE and other Open SoftwareLinux : operation systemApache : web serverTomcat : servlet engineOpenSSL : SSL implementationMySQL : data baseJboss : application serverXerces-J : XML parsing and validationXalan-J : XSLT transformations

Software Architecture

Page 12: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 12

XML data flow

DatML/RAW

Internet datacollection Collection mgmt.

StandardSoftware

CORE(B2B)

IDEV(online)

DatML/SSP

DatML/RAW

businessapps

DatML/RAW

Page 13: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 13

XML Interfaces

DatML ( Data Markup Language )DatML/RAW : raw data messagesDatML/RES : raw data message response formatDatML/SDF : survey definition format (for enabling business apps to create

raw data messages automatically and generically )DatML/EDT : data editing and validationDatML/SET : productive data sets and archivingDatML/ASK : for describing web formsDatML/SSP : shared and core components

TabML ( Table Markup Language )TabML/LAYOUT: presentation and dissemination purposesTabML/MATRIX : n-dimensional tables and time series, fully metadata-

equipped (non-disclosure, analysis, merging,

subsets…)

Page 14: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 14

Web data collection workflow

web datacollection

CORE(B2B)

IDEV(online)

businessapps

CORE.reporter

ST

AT

SP

EZ

Me

tada

ta System

DatMLRAW

DatMLRES

DatMLRAW

DatMLSDF

DatMLEDT

DatMLASK

FormsDesigner

Data EditDesigner

SurveyDesigner

webforms

HTMLJAVA

upload

Page 15: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 15

Data processing workflow

STATSPEZ Metadata System

DatMLRAW

DatMLEDT

Data EditDesigner

Data SetDesigner

TableDesigner

tabulationprograms

DatMLSET

dataediting

subjectmatterapps

TabML

DatMLSET

DatMLSET

Page 16: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 16

Application Functions

For the reporting of Statistical raw data Metadata, characteristics and values Parallel reporting (generic)

for multiple surveys Only characteristics depend on the Survey

for multiple clients and administrations send and receive side

additional functions Response and PSI information corrections of addresses Possibilities for tests Data upload for interviewer

Page 17: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 17

DATML/EDT

jar-Archiv Import

PL-EDITOR

- data record- PL-checks- PL-procedures

Forms-EDITOR

- Forms- other PL-checks

Registration DB (IDEVI)

Respondent DB

- Adress Register

- User data

Authentification DB (IDEVE)

Authorisation

IDEV Components

Web-Server

- encryption

- ssl

.core

Page 18: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 18

PL-Editor

server side checks client Side checks editing procedures XML-based

Universal Standard Tool for data editing

Page 19: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 19

Forms Editor

Easy to use automatic data fill ins Layout support XML-based

Universal Standard Tool for Definiton of Forms for data collection

Page 20: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 20

Respondent DB Administrator

definition of surveys User authentification Survey periodicity Multi User Multi Administration

Standard Tool for the respondents data base

Page 21: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 21

Web Server

encryption checks Data transformation data distribution

Universal Web Server for Surveys

Page 22: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 22

Core.connect Library

Java Iibrary for data transmission to IDEV

Page 23: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 23

Core.reporter

Standard Tool for generation of DatML/Raw messages

Page 24: IDEV EDR Software for Germany

Presentation Cord 12. 5. 2004 IDEV 24

Thank you very much for

your attention

Fritz Pfrommer

Statistisches Bundesamt, D-65180 Wiesbaden

Phone: +49 (0)611 / 75-2707

E-Mail: [email protected]