Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de...

32
1 Informatica PowerCenter How to extend the enterprise data integration capabilities to include virtual data integration services Pei Yung Chan Product Manager [email protected]

Transcript of Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de...

Page 1: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

1

Informatica PowerCenterHow to extend the enterprise data integration capabilities

to include virtual data integration services

Pei Yung ChanProduct Manager

[email protected]

Page 2: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

2�2

Corporate Overview

Page 3: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

at a Glance

$300

$350

$400

$450• Founded: 1993• Headquarters: Redwood City, CA • Employees: 1,300+• Offices: N. & S. America,

Europe, Asia Pacific• Revenue: $391 million (2007)• 3-year Compound

Annual Growth Rate: 21% per year• Market share leader (Gartner Dataquest)

3

$100

$150

$200

$250

2004 2005 2006 2007

( q )• Customers: 2,950+

• 91 of Fortune 100• 80%+ of Dow Jones• Government organizations in 20 countries

• Partners: Over 400 major SI, ISV,OEM and On Demand

� Singular focus on Data IntegrationProducts and Services

Page 4: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

OfferingOffering � Technology� Professional Services & Education� INFA Technical Support in EMEA & LATAM

CompanyCompany � Founded in 1999� Over 80 employees

Leader in Data Integration

4

OfficesOffices � Madrid, Barcelona� Lisboa � Buenos Aires� Santiago de Chile

CustomersCustomers � 5 out of the 10 biggest companies (by revenue) -Telefónica, Endesa, Cepsa, Iberdrola, Carrefour

� 9 of the main companies listed in Ibex 35 (Banesto, BSCH, Corporación Mapfre, Endesa, Iberdrola, Inditex, Sogecable, Telefónica)

Page 5: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Insurance

Financial

Services

PowerData Customers

5

Telco

Retail & Services

Pharma & Healthcare

Page 6: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Public Sector

Telco

PowerData Customers

6

Energy

Other verticals

Page 7: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

7�7

Enterprise Data Integration

Page 8: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

The Information EconomyEnabled Through Data

TraditionalEnterprise

On-demand Enterprise(SaaS)

Partner TradingEnterprise (B2B)

8

HIPAA

SEPA

NAACHA

On-demand Integration Enterprise Data Integration B2B Data Integration

Data Quality Across the Whole Enterprise

Page 9: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

The Information EconomyKey Customer Business Imperatives

BusinessImperatives

Improve Decisions &RegulatoryCompliance

ModernizeBusiness & Reduce IT

Costs

FacilitateMergers &

Acquisitions

Improve Customer Service &

Operational Efficiency

OutsourceNon-coreFunctions

IncreasePartner network

Efficiency

IT Business Customer

9

IT Initiatives

Intelligence & Regulatory Reporting

Legacy Retirement

Application Consolidation

Customer,Supplier,

Product Hubs

BPOSaas

B2B Integration

Projects

Data Warehouse

DataMigration

DataConsolidation

Master DataManagement

Data Synchronization

B2B DataExchange

Page 10: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

The Information EconomyKey Customer Business Imperatives

Data Warehouse

DataMigration

DataConsolidation

Master DataManagement

Data Synchronization

B2B DataExchange

10

Data Warehouse

DataMigration

DataConsolidation

Master DataManagement

Data Synchronization

B2B DataExchange

The extended enterprise – data everywhereB2BUnstructuredApplication DatabaseOn-Demand

HIPAA

SEPA

NAACHA

SWIFT

= Less for moreHand Coding

Page 11: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Gain Business Value From DataCommon Project Lifecycle: Do More With Less

Data Warehouse

DataMigration

DataConsolidation

Master DataManagement

Data Synchronization

B2B DataExchange

11

Page 12: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

1212

Why Informatica?

Page 13: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

InformaticaThe Data Integration Platform To Enable Business Imperatives

Improve Decisions &RegulatoryCompliance

ModernizeBusiness & Reduce IT

Costs

FacilitateMergers &

Acquisitions

Improve Customer Service &

Operational Efficiency

OutsourceNon-coreFunctions

IncreasePartner network

Efficiency

13

PowerExchange PowerCenter

Data QualityData ExplorerB2B Exchange B2B Exchange

Page 14: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

MetadatosEIM, Content Management

…) Real

Complex Data

Exchange

ETL

Data Grid

High Availability

Data Profiling

Data

Quality

F d ti

Web Services

(SOA)

La visión de InformaticaIntegración de Datos

14

Apl

icaç

ione

s y

Mid

lew

are

(SAP

, Sie

bel,

TIBC

O, B

izta

lk, …

BI(BO

, SAS, Microstrategy,

Hyperion, C

ognos …)

DB(Oracle, Microsoft, IBM, …)

EAI

Real

Time

SchedulingChanged

Data Capture

Mainframe

ETL

DWL

Auditing Team Base

Develop/

Federation

Page 15: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

1515

Data Federation

Right Time Data Integration

Page 16: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Why Enterprise Information Integration?The Value Proposition of EII or Data Federation

� Need for on-demand current data from volatile operational systems

� Large volume of data costly to replicate and copying disallowed

� No upfront requirements and incremental development needed

� Real-time access to data needed

PORTALSBI TOOLS

16

Real time access to data needed without data movement or copying

� Creates a virtual data layer that serves as a single data source

� Direct updates to source data are necessary

Page 17: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Why Extract-Transform and Load?The Value Proposition of ETL or Data Consolidation

� Need for historical or more stable data

� Complex queries, large volumes of data, with persisted results

� Upfront end-user requirements available with complete details

� Can’t tolerate any impact on

PORTALSBI TOOLS

17

Can t tolerate any impact on operational systems

� Involves complex data integration (transformation, etc.)

� Direct updates to source data not a requirement

Page 18: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Why Blended Data Integration?The Value Proposition of a Hybrid Approach

� Delivers holistic information i.e. both historic and current

� Provides choice of data integration modes for flexibility

� Delivers right-time data - real-time, near real-time, batch

� Enables rapid prototyping followed

PORTALSBI TOOLS

18

Enables rapid prototyping followed by validation phase

� Provides a blended architecture with flexibility for specific needs

� Supports highly optimized data delivery by any access mode

Page 19: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

The Informatica AdvantageIntegrated Platform - Blended Right-Time Data Integration

� Integrated functionality from leading data integration provider

� Provides single environment for batch and real-time use cases

� Optimized performance for both physical and virtual modes

� Extends data access capabilities to a broad range of clients

� Provides flexibility of data access - SQL, Web Services

19

Provides flexibility of data access SQL, Web Services

� Enables both platform and database independence

� Ensures high developer and data analyst productivity

� Architected for SOA by providing a data abstraction layer

Page 20: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

2020

Use cases

Page 21: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Blended Data Integration Use CasesDrivers and Competitive Differentiation

# Use Case Scenarios Driver Value Prop. Competitive Differentiation

1 DW Extension Mergers and Acquisitions

New Apps On-

Efficient Consolidation

Flexible Data Federation

Best of Breed

Light Footprint

21

New Apps Onboarding

New Data Source Extension

Richer BI/Reporting Environment

Easy to Use

Data Breadth

Proven Installs

2 Data Services SOA Service Enable Data

Complement Process Services

Easy Integration w/ Other SOA Components

No Stack Required

Page 22: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Use Case 1Data Warehouse Extension for Operational BI

Data Federation – Caching, Query Optimization

PortalsOperational BI Tools

22

Power Center

DW/DM

Operational Databases

Bus

ines

s U

nit 1

Bus

ines

s U

nit 2

ETL Job

Page 23: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Use Case: Data Warehouse ExtensionWell Management Reporting at Large Oil & Gas Producer

� Situation and Requirements− 10,000 wells, 1,800 ETL jobs with 110m records

moved nightly; SLA window – 6pm to 6am− Well Engineers are too burdened by data search,

collection and reporting− Wells are primary business assets – utilization and

revenue must increase− Complex environment with massive data volumes

and many disparate data sources (operational and historical)

Data Federation

Operational BI Reporting Tool

23

− Complex skill requirements, from engineer to dispatch

� Solution− Virtual view of well status, rig status and financial

information that improves real-time operational decisions to Operational Portal and Work Management Reporting System

� Results− 10% increase in well revenue-performance and

efficiency− 50% reduction in development time for

complex integration projects− 20% improvement in individual field Engineer efficiency

Reporting DM

ERP DW

Source Applications

PowerC

enter

PowerC

enter

Operational Store

PowerC

enter

PowerC

enter

Page 24: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Use Case 2Data Services/Portals & Composite Applications

Data Federation – Caching Query OptimizationPower Center

Composite Applications

SOA Data ServicesSQL

Portals

24

Data Federation Caching, Query Optimization(Real Time)

Operational Databases

Page 25: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

� Situation and Requirements:− Changing business needs from research scientists− Prototyping Rapid Applications Development tools with

flexibility of data integration and access− Complex analytics delivered on-demand from many

sources − SOA compliance− Share research data across the company

Research ScientistsDrug Discovery Application

Use Case: Data ServicesDrug Discovery Application at Pharmaceutical Company

SQL Data Services

25

− Structured and semi-structured data

� Solution: − Scientific Workbench that combines disparate data

� Results:− 50% reduction in development time for complex

data integration projects− SOA-compliance, with data services in the format

required by data users− Data quality improved through Rapid prototyping− Reduced cost of operational infrastructure

Historical DataPackaged AppsXML data

HTTP files

Data FederationPowerCenter

(Real Time)

Operational Store

Page 26: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

2626

Technical Overview

Page 27: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

What does the PowerCenter Data Federation Option do?

� Leaves enterprise data where it naturally lives

� Establishes a virtual data layer that applications can treat as a single data source

� Executes on-demand queries to retrieve and integrate data from a variety of systems

27

data from a variety of systems− Operational systems− Data warehouse

� Employs query optimization, caching, and prudent design to ensure performance

Page 28: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Step 1: Build the ViewStep 1: Build the View

(A ViewView contains MetadataMetadataon the actual data source

How does it Work at Design-Time?

Data Federation Option View

28

Data Source 1 Data Source 2

on the actual data source –format, type, location, access, etc.)

Page 29: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Data Federation Option View1 A B a b

2 C D c d

Step 2: Aggregate Data

(Queries are optimized

Step 3: Deliver DataStep 3: Deliver Data

(Combined data creates meaningful information)

Step 1: Build the View

(A View contains Metadataon the actual data source

Portals BI ToolsWeb Services

How does it Work at Run-Time?

29

Data Source 1 Data Source 2

1 A B

2 C D

3 E F

4 G H

1 a b

2 c d

3 e f

4 g h

3 E F e f

4 G H g h

(Queries are optimized for speed and efficiency)

on the actual data source –format, type, location, access, etc.)

Page 30: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

3030

Wrap-up

Page 31: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

Wrap-up� Advanced performance design

− Cost-based query optimization− Data path tuned for high-volume throughput− Extensive and flexible caching

� Broad data source and delivery options− Sources: JDBC/ODBC, SOAP/WSDL, LDAP, HTML and flat files− Delivery options: JDBC, ODBC and SOAP

31

� Acknowledged as easiest to install and use

� Database-independent

� Informatica Data Services− Model-driven (Data Objects) service development− Rich data access/transformation capabilities− SQL and web services access with a single engine from Informatica

Page 32: Corporate Overview - IDCDX · PDF fileLa visión de Informatica Integración de Datos 14 Aplicaçiones y Midleware (SAP, Siebel, TIBCO ... Hyperion, Cognos ) DB (Oracle, Microsoft,

3232

Muito obrigado