ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data...

20
Slide 1 ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 A dynamic data integration approach to build scientific workflow systems Markus Kunde Simulation and Software Technology German Aerospace Center (DLR) ICWM 2009, May 5 th 2009

Transcript of ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data...

Page 1: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

Slide 1ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

A dynamic data integration approach to build scientific workflow systems

Markus Kunde

Simulation and Software Technology

German Aerospace Center (DLR)

ICWM 2009, May 5th 2009

Page 2: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 2

Overview

German Aerospace Center (DLR)

Challenge

Approach

Conclusion & Outlook

Page 3: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 3

The DLRGerman Aerospace Research Center Space Agency of the Federal Republic of Germany

Page 4: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 4

6,000 employees working in 29 research institutes and facilities

at 13 sites.

Offices in Brussels, Paris and Washington. Köln

Lampoldshausen

Stuttgart

Oberpfaffenhofen

Braunschweig

Göttingen

Berlin-

Bonn

Trauen

Hamburg

Neustrelitz

Weilheim

Bremen-

Sites and employees

Page 5: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 5

Mission

To open up new dimensions for exploring the earth and the universe, for protecting the environment and for promoting mobility, communication and security:

Research portfolio ranging from basic research to innovative applications and the products of tomorrow

Operating large-scale research facilities for DLR’s own projects and as a service provider for its clients and partners

Promoting the next generation of scientists

Advisory services to government

Page 6: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 6

Challenge

Preliminary design in aviation

Iterative development of aircraft

Duration: Minutes; Hours; Few days

Target: Complete aircraft or components

Pre-Design is an interdisciplinary task

Different domains (in our case: institutes/departments)

Problems

No omniscient person

Usage of “external” knowledge

Reuse of existing applications

Page 7: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 7

Goal

Under development at DLR in the following aeronautics projects:

TIVA I/II Technology integration for the virtual aircraft

UCAV 2010 Unmanned combat air vehicle

EVITA Evaluation of innovative turbine engines

CATS Climate-compatible air transport system

… and more to come!

A DLR-wide system to enable the multi-disciplinary design and analysis of airplane configurations in the pre-design phase. A DLR-wide system to enable the multi-disciplinary design and analysis of airplane configurations in the pre-design phase.

Page 8: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 8

Solution

Framework ModelCenter & AnalysisServer

Common Dataset CPACS

Supporting Libraries TIXI & TIGL

Wrapping Mechanism CPACSAccess

Page 9: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 9

Common Dataset CPACSCommon Parametric Aircraft Configuration Scheme

Basis for all applications

XML

Hierarchical

Internal references

External references

Page 10: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 10

Common Dataset CPACSCommon Parametric Aircraft Configuration Scheme

Basis for all applications

XML

Hierarchical

Internal references

External references

Configuration

Vehicles

Aircraft

Model

Engines

Engine

EngineUID 3PW066

Page 11: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 11

Common Dataset CPACSCommon Parametric Aircraft Configuration Scheme

Basis for all applications

XML

Hierarchical

Internal references

External references

Configuration

Vehicles

Aircraft

Model

Engines

Engine

EngineUID 3PW066

Engines

uID=“3PW066” ExternalDATA

Page 12: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 12

Mapping Mechanism CPACSAccess

Decoupling application from CPACS and framework

Changes in CPACS are not affecting applications

XML node mapping or XSLT

Page 13: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 13

Mapping Mechanism CPACSAccess

Decoupling application from CPACS and framework

Changes in CPACS are not affecting applications

XML node mapping or XSLT

Page 14: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 14

Mapping Mechanism CPACSAccess

Decoupling application from CPACS and framework

Changes in CPACS are not affecting applications

XML node mapping or XSLT

Toolwrapp

er

Page 15: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 15

Server

ToolWrapper

ServerToolVersionDirectoryCommand…

Mapping

Decoupling

Reduced I/O Files

Application

Client

Page 16: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 16

Framework - In reality

Page 17: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 17

Framework - In reality

Easy creation of scientific workflows

Supporting GUIs

Easy insertion of applications

Reading/writing CPACS

Real-time monitoring of each application

Parametric studies with standard visualization techniques

Optimization of parameters

Page 18: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 18

Conclusion

Framework ModelCenter & AnalysisServer

Common Dataset CPACS

Supporting Libraries TIXI & TIGL

Wrapping Mechanism CPACSAccess

AdvantagesUsage of external knowledgeEvaluation experts only need a fundamental understanding of each domainExisting applications can be easily addedNo need to share knowledge

Page 19: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Slide 19

Outlook

Integration in RCE (open source framework for distributed computations)http://www.rcenvironment.de

Data management with Datafinder (application for data management)http://datafinder.sourceforge.net

Provenance information for traceability of processes and data originhttp://www.uprovenance.com

STEP Integration for a standard data exchangeISO 10303

CPACS Development for more domains

Page 20: ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009 Slide 1 A dynamic data integration approach to build scientific workflow systems Markus.

Slide 20ICWM2009 > Arne Bachmann > Markus Kunde > Markus Litz > 05.05.2009

Questions?