MISSY 2[Microdata Information System – part 2]

andias.wira-alam@gesis.org oliver.hopt@gesis.org

1

Implementing DDI 3: The German Microcensus Case Study

Wei Shen

Andias Wira Alam Benjamin Zapilko Daniel Hienert Engin Sagbas Frank Sawitzki

Oliver Hopt

Peggy Fischer Peter Mutschke Dr. Philipp Mayr Philipp Schaer

Siegfried Schomisch

Simon Bachenberg Timo Wandhöfer

Ute Koch

Prof. Dr. York Sure Sure

Information Processes in the Social Sciences

2

Issues:

1. Documenting the Metadata at Variable Level.

2. DDI 3 Editor?

3. Metadata Presentation?

3

General Work Flow

4

Federal Statistical Office Public(Scientific Community)

A B

AThe Federal Statistical Office (Destatis)…• provides access to microdata for scientific purposes

(scienitifc use files).• provides survey documents for MISSY.• in collaboration with, produces scientific use files of

the Microcensus (e.g. anonymisation, construction of variable labels).

BGESIS provides…• provides metadata for the Microcensus scientific use

files on the Web (MISSY): codebook and detailled variable information in DDI 3 format.

• study description and study related material (e.g. questionnaires, definitions, interviewer guides).

• examples and recommendations on analysing the metadata.

5

Available Materials(Example: Code Book and Questionnaire)

Code Book

6

Available Materials(Example: Code Book and Questionnaire)

Questionnaire

7

What goes to where? (DDI 3 structure)

Code Book Questionnaire

1. Variable Name (EF Number)2. Variable Label3. Question Number (no text and other details)4. Frequencies

1. Question Number2. Question Text

Code Book & Questionnaire

8

Code BookCode Book & Questionnaire

1. Variable Name (EF Number)2. Variable Label3. Question Number4. Question Text5. Frequencies

DDI 3DDI 3

<DataCollection>

<QuestionScheme>

<QuestionItem>

<LogicalProduct>

<CategoryScheme>

<VariableScheme>

<Variable>

<PhysicalInstance>

<Statistics>

<VariableStatistics>

referencereference

What goes to where? (DDI 3 structure)

9

Comparable Variables (DDI 3 structure ++)

Subjects (Categorization)Subjects (Categorization)

Subject 1Subject 1.1Subject 1.2

Subject 2Subject 2.1 Subject 2.1.1

Subject 2.1.1.1 Subject 2.1.1.2

EF xy (1995)EF xy (1995)

EF yz (1996)EF yz (1996)

belongs to

belongs to

comparable

compara

ble

comparable

Subject 1.1 EF xy (1995)EF xy (1995) EF yz (1996)EF yz (1996)Subject 1.2

presentatio

n

10

DDI 3 Editor

1973.ddi1978.ddi2004.ddi2007.ddiSupport

Multi User

11

12

DDI 3EDITOR

WebDAVServer

store

DBClearData Service

Transforming DDI 3 into DBClear format

WebServer(Typo3)

XML + XSLT + Groovy

USERS

HTML View

edit

DD

I 3.0 Editor

DD

I Service

Web Inform

ation S

ystem

request

Software Architecture

Model

Views

ab

c

13

DDI to Metadatabase

Lucene IndexDatabase

Indexing

Web Information System in MISSY:(3 detail views of the metadata - dynamic pages)

1. List of Variables (Variablenliste). 2. Subject Outline (Thematische Gliederung). 3. Timeline Matrix of Variables (Variablen-

Zeitpunkte-Matrix).

14

15

16

17

18

AcknowledgementThis project is funded by the BMBF Germany (01UW0707 - "Servicezentrum für Mikrodaten der GESIS / MISSY II").

Future Work1. Integrating with regional microcensus.2. Improving our application (e.g. performance,

search capabilities, object oriented database, etc) so it can be used also by other studies.

3. Open Research Data.