8/12/2019 bos_41

1/31

1

8/12/2019 bos_41

2/31

8/12/2019 bos_41

3/31

3

Agenda

About CME Group

Business Challenge

Solution Case Studies

Benefits and Use of Informatica

Future Roadmap

Lesson Learned

Q & A

8/12/2019 bos_41

4/31

4

The world's leading and most diverse derivativesmarketplace

Result of mergers between three major

exchanges 2007 merger of Chicago Mercantile Exchange and Chicago

Board of Trade

2008 acquisition of New York Mercantile Exchange

Headquarters in Chicagooffices around theworld

Partner ExchangesDME, Korean, and Green

8/12/2019 bos_41

5/31

5

CME Group Trading Floor

AlsoElectronic Trading and

Privately Negotiated Trades

8/12/2019 bos_41

6/31

6

CME Group Mergers and Acquisitions

2007

2008

2010

2011

Chicago Mercantile Exch merges with Chicago Board of Trade

New York Mercantile Exch and Commodity Exch Acquisition

Dow Jones Acquisition

Partner Exchanges Dubai and Korea

Combined organization became known as CME Group

Integration completed in 2008

Now four exchanges operating under CME Group

Integration completed in 2009

90% investment in Dow Jones Indexes

Including the Dow Jones Industrial Average

Continuing to seek global opportunities

8/12/2019 bos_41

7/317

CME Group Futures & Options Products

Crude Oil (WTI) , Natural Gas, Heating OilEnergy Gold, Silver, CopperMetals

Corn, Wheat, Soybeans, CattleAgriculture

Eurodollar, Treasury Notes and BondsInterest Rate

S&P 500, Dow Jones Industrial AverageEquity Indexes

G10 and Emerging Market Currency PairsFX

Interest Rate Swaps, Credit Default SwapsOTC

Home Price Index FuturesReal Estate Hurricane, Snowfall, RainfallWeather

8/12/2019 bos_41

8/318

Business Challenge

Data from 3 different exchanges needed to be ina single place in a single format

Complicated by complex code base and

divergent systems

Aging Technologies needs to be replaced

Mainframe decommission deadline

Volume increased exponentially, SLAs becameharder and harder to meet

Number of trades doubled from 1 to 2 Billion over 4 years

8/12/2019 bos_41

9/319

CME Group Data Processing Facts

Data in many formats Oracle, SQL Server, DB2, flat files, XML, FIXML,

Spreadsheets

Over 300 distinct production Oracle Schemas

Large data sets 15 TB data warehouse

Globex Audit Data tops at about 500+ million records a day

Millions of trades and quotes a day, copies everywhere

Diverse technology Java, .NET, shell scripts, perl, PL/SQL, COBOL, DB2,

other ETL tools

8/12/2019 bos_41

10/3110

Pre-Integration Data Flow

DB2Chicago

Mercantile

Exchange

Chicago Board

Of Trade

New YorkMercantile

Exchange

Oracle

Mainframe ETL

Flat Files

Java

Oracle ETL

Oracle/Excel

Streetbook/

Bridgeback

8/12/2019 bos_41

11/3111

Post-Integration Conceptual View

Market

Public Data

Pre Clearing

Trade Data

Post Clearing

Trade Data

Reference

Data

ERP

Other Data

Extract Control

Source Data

Cleansing

Data Integrity

Reference Data

Management

Business Rules

Error Handling

MarketData Liquidity

VolumeOrder

Quantity

Order

Execution

Trade

Revenue

Market

Maker Regulatory

Other

Internal Reports

Ad Hoc Requests

External Reports

Dashboards

Business Objects

Source Data ETL Architecture Data Warehouse Applications

Client Applications

8/12/2019 bos_41

12/3112

EFFICIENCIES GAINED INPOST TRADE REPORTING

Case Study 1

8/12/2019 bos_41

13/31

13

Stats

Data WarehouseReport Engine

CME Group andPartner Exchanges

Reports

Prices

Other Customers

Product Volume/OI Settlements

Data Cloud

Forward Contracts

Post Trade Reporting Informatica Utilization

8/12/2019 bos_41

14/31

14

Users and Reports

Users Over 350+ internal users

Reports, Dash Boards

3000+ hits per day for trade data reports

Traders, brokers, investors, and universities.

Reports

Business Objects, Qlikview, and Crystal Reports

Over 300+ reports for external customers

Over 1000+ internal reports

8/12/2019 bos_41

15/31

15

CME Group - Published Data

Crude Oil and Gold Futures Contracts

8/12/2019 bos_41

16/31

16

Efficiencies Gained

Mainframe ETL Processing Time Lines ETL Processes Completed around 11 PM

Reports were being generated at 1:30 AM

Informatica ETL Processing Time Lines ETL processing completes at 8:30 PM

Reports Generation completes at 9:30 PM

Trade Data Load

Mainframe ETL: 55 Minutes

Informatica ETL: 22 Minutes

Gain of 60%

8/12/2019 bos_41

17/31

17

Batch Processing Efficiencies Gained

Less jobs running due to simplified processes

SLAs consistently met

Improved Performance

Reuse versus customization

Ease of Maintenance

Much Shorter Learning Curve

8/12/2019 bos_41

18/31

18

Informatica Processing Benefits

Ease of Troubleshooting

Java error vs. Informatica error

In the middle of the night, which would you rather digthrough?

Standardized error handling

Programmers often forget to include error handling ormiss possible unexpected exceptions

Standardized monitoring All processes monitored side by side in standard format

8/12/2019 bos_41

19/31

19

Informatica Project Development Benefits

Safely retire legacy applications

Resources can easily retrain to Informatica

Keep people with valuable business knowledge

Even as systems are decommissioned

Share and reuse of code for faster delivery

Faster development cycle

Minimize business outages

8/12/2019 bos_41

20/31

20

SIMPLIFYING REGULATORYBATCH PROCESSING

Case Study 2

8/12/2019 bos_41

21/31

21

Past: Regulatory Trade Processing

Flat Files

DB2

Oracle

PL/SQL

SQL

Loader

MainframeFlat FileInterface

Java

Splitter

COBOL

Flat Files

External

Tables

Java

Processing

Informatica

Distributed

8/12/2019 bos_41

22/31

22

Complex Code

Overly complex code used to move datarepeatedly

Mainframe decommissioningopportunity for simplifying?

Java programs that were essentially ETL

PL/SQL packages, perl scripts, shell scripts, etc.

Lots of duplicate, obsolete, and unnecessary

coding

Hard to support

8/12/2019 bos_41

23/31

23

Some people see a problem and think I

know, Ill use Java!

Now they have a ProblemFactory.@Lonnen

Chris LonnenTwitter

8/12/2019 bos_41

24/31

24

Informatica to Simplify

Take a hard look at your code base Do you really need a custom app and framework for what

is essentially an ETL process?

Push back from coders

Gut reaction is to code and go with what they know

Need a strong champion of Informatica

Proving that it CAN be done in Informatica

Why not? vs Why?

8/12/2019 bos_41

25/31

25

Simplified: Regulatory Trade Processing

Oracle

Regulatory Data

Warehouse

Compliance Distributed

Systems

OracleInformatica

Informatica

Informatica

Java

ProcessingPL/SQL

Staging LoadProcessing and

Final Table Load

8/12/2019 bos_41

26/31

26

Simplified Process

80% + of data movement and processingperformed via Informatica

Every new process starts with, Can we do this inInformatica?

Still using PL/SQL and Java

Compelling arguments for usage

Iterative functionality

Complex business logic Cursor-driven logic required

Multi-threading

8/12/2019 bos_41

27/31

27

Future Roadmap

Upgrade to PowerCenter 9.1

Upgrade to Exadata

Add Informatica Source Control

Enforce development standards

Create in-house user group and share resources

and knowledge

Continue to look for opportunities to use

Informatica to simplify processes

8/12/2019 bos_41

28/31

28

Exadata Performance Improvement

RecordsBaseline

Time

Oracle

Exadata

TimeSavings /

N(X) Faster

60 GB

Flat FileLoad 365 Million 2:00:00 0:14:00 1:49:30

Staging

Load9 Million 0:16:00 0:15:00 1:00

Query 1 103,147 0:13:55 0:00:27 40

Query 2 2,605 0:18:15 0:00:06 183

8/12/2019 bos_41

29/31

29

Uses of Informatica at CME Group

Recurrent reports

Data loads

Data updates

Automated testing (QA)

Ad hoc extracts

Historical data loads from legacy systems

Archiving data off database to files

8/12/2019 bos_41

30/31

30

Lesson Learned

No SQL overrides Hides code and table usage

Lose benefits of Informatica

Define Standards Upfront We defined, but didnt enforce enforce!

Code Reviews

To enforce those standards!

Often overlooked because it isnt real code

8/12/2019 bos_41

31/31

Thank You