1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

30
1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

Transcript of 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

Page 1: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

1

The Mainframe Data Access& Replication Conundrum

In Today's Heterogeneous IT Environment

Page 2: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

2

Mainframe Integration without Compromise

Page 3: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

3

Agenda

• Introduction to Treehouse Software• Today’s Situation• IT Objective• tcACCESS

• Data Integration• tcACCESS SQL Engine• tcACCESS Demo

• tcVISION• Data Replication• CDC Methods• Processing Stages• tcVISION Demo

• Summary

Page 4: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

4

Introduction to Treehouse Software

• Established in 1982• Mainframe system tools vendor• Leading ISV for Software AG

• 70% penetration in North American market• Consultants with 20+ years experience• More than 300 man years of experience

• Supporting all mainframe operating systems• Focus for the past 15+ years on data migration,

replication, and integration• Over 700 customers worldwide• 20 products• 30 employees

Page 5: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

5

Treehouse Customers

Page 6: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

6

Today’s Situation

• Heterogeneous IT environments

• Legacy applications

• High-availability information systems

• Data silos

• Increasing data volumes

• Exploding costs

Page 7: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

7

IT Objective

• Intelligent data integration

• Efficient data synchronization

• Cost effective solution

Enterprise-wide Data Management through:

Page 8: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

8

Page 9: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

9

Enterprise Data Integration

• Bi-directional data-exchange across heterogeneous systems

• Direct data access across heterogeneous systems

• Data transformation for data analysis and exchange

tcACCESS Concepts

Page 10: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

10

Enterprise Data Integration

• Relational access to legacy data and applications

• Data federation – heterogeneous data views

• Integration of mainframe files and DBMS structures

• Data federation between mainframe and Windows/Open Systems data

tcACCESS Concepts

Page 11: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

11

tcACCESS SQL Engine

Host/PC & Host & Web Integration

Page 12: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

12

tcACCESS SQL Engine

• More than 90 SQL functions supported

• Operators (+, -, *, /, ||)

• Conditional Operators (>, <, =, BETWEEN, LIKE)

• Logic Operators (AND, OR)

• INNER and OUTER JOINS

• GROUP BY, ORDER BY

• Security may be applied (RACF, ACF/2, Top Secret)

• Stored Procedure Support

Page 13: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

13

tcACCESS SQL Engine

• Different data sources can be JOINed:SELECT IMS.NR, IMS.NAME, VSAM.ADDRESS FROM IMS, VSAM WHERE IMS.NR = VSAM.ID

• VIEWS can be created• Control Options available

(MAXIO, MAXROW, NOORDERBY, etc)

• Global SQL Exit available• Field Level Exits available

Page 14: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

14

tcACCESS Architecture

Page 15: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

15

Demo

Page 16: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

16

Page 17: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

17

CDC Replication

• Different data formats

• Different data models

• Large data volumes

• Limited batch window

• Requirement for up-to-date information

• Moving/replicating data...

• as much as needed

• as little...

• as transparent...

• as flexible...

• as secure...

• ...AS POSSIBLE

The Problem: The Solution:

...with

Page 18: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

18

Data Latency

Change Data Capture

Page 19: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

19

Data volume

Change Data Capture

Page 20: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

20

Mainframe Change Data CaptureChange Data Capture

• Efficient transfer of entire databases

• Analysis for data consistancy

• Best for Initial Load prior to log processing

• Best for periodic mass data transfer

• One step data transfer

Page 21: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

21

Mainframe Change Data CaptureChange Data Capture

• Comparison of data snapshots

• Efficient transfer of changed data since last processing

• IMS/DB, DL/I, VSAM, DB/2, ADABAS, CA-IDMS, DATACOM, sequential files

• Flexible processing options (SORT etc.)

• Automatic creation of deltas by tcVISION

Page 22: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

22

Mainframe Change Data CaptureChange Data Capture

• Usage of the DBMS logging capabilities

• IMS/DB, VSAM, DB/2, DL/I, ADABAS, IDMS, DATACOM

• Transfer of changed data in scheduled time frame

• Best for batch window

• Best for processing right after logfile creation

Page 23: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

23

Mainframe Change Data CaptureChange Data Capture

• Realtime capture of changed data

• Changes directly obtained from DBMS

• CA-IDMS, IMS/DB, VSAM, DB/2, DATACOM, ADABAS

• Secure data storage even across DBMS restart

• Flexible propagation methods

Page 24: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

24

Stage 0:Data in internal raw format

Stage 1:Data in tcVISION format (before and after images)

Stage 2:Data normalized with structure definition

Staged Processing

Stage 3: Data in DML or Loader format

Page 25: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

25

Stage 0:Data in internal raw format

Stage 1:Data in tcVISION format (before and after images)

Stage 2:Data normalized with structure definition

Stage 3: Data in DML or Loader format

Staged Processing

Exit pointsavailable at every stage

Page 26: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

26

Demo

Page 27: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

27

Summary• Relational access to legacy

data and applications

• Data Federation – heterogeneous data views

• Change Data Processing

• Bi-Directional real time replication

Page 28: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

28

SummarytcVISION Architecture

Page 29: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

29

SummaryBi-directional data-integration and data-synchronization

Page 30: 1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

30

E-mail: [email protected]