GEM: Requirement-Driven Generation of ETL and Multidimensional ...
Requirement-driven Design and Deployment of ...
1
Third European Business Intelligence Summer School (eBISS 2013) – Dagstuhl, Germany Requirement-driven Design and Deployment of Multidimensional and ETL Designs Petar Jovanovic, Oscar Romero, Alberto Abelló Universitat Politècnica de Catalunya, BarcelonaTech Iterative processes to support the evolution of DW designs. ORE: Integrates each new requirement into the existing DW constructs and produces the unified DW schema that satisfies the entire set of requirements. CoAl: Integrates ETL flows which answer each new requirement, into the existing ETL process design and produces the unified ETL process that satisfies the entire set of requirements. [petar | oromero | aabello]@essi.upc.edu Domain ontology Data sources Alkis Simitsis HP Labs, Palo Alto, CA, USA [email protected] ? Physical-level queries (Expressed in terms of data sources) High-level information requirements (Expressed in terms of domain ontology) GEM: A tool to semi-automatically produce multidimensional (MD) and Extract-transform-load (ETL) conceptual designs from a given set of business requirements (like SLAs) and data source descriptions. Conceptual/Logical designs per requirement MD design ETL design ORE Conceptual/Logical DW design Physical design CoAl Import plugin Export plugin MD design ETL design MD and ETL designs are correlated materialized views vs. OLAP querying iterative tuning of both designs state space optimization multi-engine support multi-objective support execution plan creation Further reading: Oscar Romero, Alkis Simitsis, Alberto Abelló: GEM: Requirement-Driven Generation of ETL and Multidimensional Conceptual Designs. DaWaK 2011: 80-95 Petar Jovanovic, Oscar Romero, Alkis Simitsis, Alberto Abelló: Integrating ETL Processes from Information Requirements. DaWaK 2012: 65-80 Petar Jovanovic, Oscar Romero, Alkis Simitsis, Alberto Abelló: ORE: an iterative approach to the design and evolution of multi-dimensional schemas. DOLAP 2012: 1-8 Alkis Simitsis, Kevin Wilkinson, Petar Jovanovic: xPAD: a platform for analytic data flows. SIGMOD Conference 2013: 1109-1112 GEM
Transcript of Requirement-driven Design and Deployment of ...
Third European Business Intelligence Summer School (eBISS 2013) – Dagstuhl, Germany
Requirement-driven Design and Deployment of Multidimensional and ETL Designs
Petar Jovanovic, Oscar Romero, Alberto Abelló Universitat Politècnica de Catalunya, BarcelonaTech
Iterative processes to support the evolution of DW designs.
ORE: Integrates each new requirement into the
existing DW constructs and produces the unified DW schema that satisfies the entire set of requirements.
CoAl: Integrates ETL flows which answer each
new requirement, into the existing ETL process design and produces the unified ETL process that satisfies the entire set of requirements.
[petar | oromero | aabello]@essi.upc.edu
Domain ontology
Data sources
Alkis Simitsis HP Labs, Palo Alto, CA, USA
?
Physical-level queries (Expressed in terms
of data sources)
High-level information requirements
(Expressed in terms of domain ontology)
GEM: A tool to semi-automatically produce
multidimensional (MD) and Extract-transform-load (ETL) conceptual designs from a given set of business requirements (like SLAs) and data source descriptions.
Conceptual/Logical designs per requirement
MD design ETL design
ORE Conceptual/Logical DW design
Physical design
CoAl
Import plugin
Export plugin
MD design ETL design
MD and ETL designs are correlated
materialized views vs. OLAP querying
iterative tuning of both designs
state space optimization
multi-engine support
multi-objective support
execution plan creation
Further reading:
Oscar Romero, Alkis Simitsis, Alberto Abelló: GEM: Requirement-Driven Generation of ETL and Multidimensional Conceptual Designs. DaWaK 2011: 80-95
Petar Jovanovic, Oscar Romero, Alkis Simitsis, Alberto Abelló: Integrating ETL Processes from Information Requirements. DaWaK 2012: 65-80
Petar Jovanovic, Oscar Romero, Alkis Simitsis, Alberto Abelló: ORE: an iterative approach to the design and evolution of multi-dimensional schemas. DOLAP 2012: 1-8
Alkis Simitsis, Kevin Wilkinson, Petar Jovanovic: xPAD: a platform for analytic data flows. SIGMOD Conference 2013: 1109-1112
GEM
![New York City’s Vehicle Pilot Deployment Project · Connected Vehicle Pilot Deployment Project Quick Overview This is a DEPLOYMENT project [driven by R&D]! “After more than a](https://static.fdocuments.in/doc/165x107/5f1645a49e1ef05ebc0668a2/new-york-cityas-vehicle-pilot-deployment-project-connected-vehicle-pilot-deployment.jpg)
