OGG_goldengate

7/31/2019 OGG_goldengate

1/20

WWW.TRANSFER-SOLUTIONS.COM

SPREKER :

E-MAIL :

DATUM :

Oracle GoldenGate

Oracle's strategic solution for real time data integration

Jos van den Oord

[email protected]

29 november 2011
mailto:[email protected]:[email protected]:[email protected]:[email protected]


2/20

COPYRIGHT TRANSFER SOLUTIONS B.V. 2

Who am I

Jos van den Oord

Working with Oracle products since 1998

Working at Transfer-Solutions since 2010

InterestsDatabases

Right Availability

Security, Performance

Blog :joordsblog.vandenoord.eu

Email :[email protected]


3/20

COPYRIGHT TRANSFER SOLUTIONS B.V.

Agenda

Introduction Oracle GoldenGate (OGG)GoldenGate Topologies

GoldenGate Intergration solutions

GoldenGate Products

Technology Overview GoldenGate

Simple, Flexible Instantiation

GoldenGate Modular Building Blocks

GoldenGate Capture/DeliveryGoldenGate Checkpointing

Architecture Process Components

Demo GoldenGate

3


4/20


Introduction Oracle GoldenGate (OGG)

Oracle GoldenGate provides low-impactcapture, routing, transformation, and delivery oftransactional data across heterogeneousenvironments in real time

Oracles real-time data movement solutionData replication for heterogeneous databases

Real-time information feeds to Oracle BI/EPM

Zero-downtime migrations and upgrades to Oracle

Database and Applications

4


5/20



GoldenGate Topologies

5

Unidirectional Bi-directional Peer to Peer

Broadcast Intergration /Consolidation

Cascading


6/20



6

Databases O/S and PlatformsCapture: Oracle

DB2

Microsoft SQL Server

Sybase ASE

Ingres Teradata

Enscribe

SQL/MP

SQL/MX

Delivery:

All listed above

MySQL, HP Neoview, Netezza, andany ODBC compatible databases

ETL products

JMS message queues

Windows 2000, 2003, XP

Linux

Sun Solaris

HP NonStop

HP-UXHP TRU64

HP OpenVMS

IBM AIX

IBM z/OS


7/20 COPYRIGHT TRANSFER SOLUTIONS B.V.


Heterogeneity Supports Afb Overview

7

Product / License Description

Oracle GoldenGate Includes GoldenGate Capture,Deliver, Active Data Guard andXStream

Oracle GoldenGate for Mainframe Includes GoldenGate Capture and

Deliver for HP NonStop and IBM DB2on z/OS

Oracle GoldenGate Veridata Add-on capability to validate data inreplicated systems

Management Pack for GoldenGate Add-on management pack, includes

Oracle GoldenGate Director

Oracle GoldenGate Adapters Pre-packaged application content,such as for Flat File and Javaadapters




OGG Modular Building Blocks

Database

Logs

LogsLogs

Deliver

Delivery: Applies transactional

data with guaranteed integrity

Trail Files

Deliver Capture

Trail Files

Bi-directional

Trail Files Trail Files

Trail files: Universal data format enables heterogeneity

Route: No Distance constraints

via TCP/IP.Compression & encryption.

Capture

Database

LogsLogsLogs

Capture: Committed changes are captures ( and can be filtered)

As they occur by reading the transaction logs

LAN/WANTCP/IP



LAN/WAN

TCP/IP


Simple, Flexible Instantiation Start Change Data Capture (CDC)

Initial Snapshot

Synchronization

9

Ongoing Data

Synchronization

Initial Load

Database

Redolog

Capture Data

PumpTrail Files Collector Trail Files DatabaseDelivery




Oracle GoldenGate Capture

10




Oracle GoldenGate Delivery

11




GoldenGate Checkpointing

12

Current

Read

Position

Data Pump Trail Files

------

------

-----

Begin TX2Insert TX2

Commit TX2

Current

Write

Position

PUMP

Checkpoint

Database

Delivery Database

------

------

-----

Current

Read

Position

Delivery

Checkpoint

Capture

Database

Trail Files

------

------

-----

Begin TX1Insert TX1Begin TX2Update TX1

Insert TX2Commit TX2Begin TX3Insert TX3Begin TX4

Commit TX3Delete TX4

Begin TX2Insert TX2

Commit TX2

Begin TX3Insert TX3

Commit TX3

Current Read

Position

Current Write

Position

Capture

Checkpoint

Start of Oldest Open (Uncommitted)

Transaction



Architecture Process Components

13

Log-basedVAM-basedLocal/Remote QueuingFilteringParallel CoordinationLocal/Remote

CAPTURE

Native database APIODBCBatch OperationsFilteringTransaction/Operations GroupingParrallel CoodinationLocal/Remote

DELIVERY

FilteringLocal/RemoteTCP/IPCompressionEncryption

PUMPQueue (Trail) ManagementProcess Management (Dynamic)Monitoring and Administration (Lag report)Reporting (Events, Error, Tresholds)Receive/Route request from UI

Trail FilesCheckpoint files (Capture, Pump, Delivery)Configuration FilesDiscard filesReport/Log filesBinaries

On

disk Components

MANAGER



Demo GoldenGate

Manager process

Extract process

DataPump Process

Replicat Process

Bi-Directional Replication

DDL Bi-Directional Replication

Extract /Replicat Filtering

Logdump

SQL statements van replicat

14


15/20WWW.TRANSFER-SOLUTIONS.COM

SPREKER :

E-MAIL :

DATUM :

Point of Interest for Oracle GoldenGateOracle's strategic solution for real time data integration

Jos van den Oord

[email protected]

29 november 2011
mailto:[email protected]:[email protected]:[email protected]:[email protected]



Point of Interest for Oracle GoldenGate

Understanding of thebusiness objectives

Approved by yourstakeholders?

Understanding of therequirements?

Appropriate replicationtopology

Requirementsand Planning

16




Creating Dedicated Users Encrypting Passwords

Creating a DedicatedInstallation Directory

Using a Checkpoint Table Verifying the Character Sets

Developing Naming Standards Using a Data Pump

Installationand Setup

17




Using GGSCI Command Shortcuts

Using OBEY Files

Generating Interim Statistics Using a Discard File

Reporting Regularly on ProcessHealth

Purging Old Trail Files Regularly

Automatically Starting Processes

Managementand

Monitoring

18




Running Performance Tests

Limiting the Number of Extracts

Using Passthru Mode for DataPumps

Using Parallel Replicats Using the Fastest Available

Storage

Tuning the Database

Performance

19


20/20

Q u e s t i o n sA n s w e r s

CONSULTING|MANAGED SERVICES|EDUCATION

WWW.TRANSFER-SOLUTIONS.COM

OGG_goldengate

Documents

Transcript of OGG_goldengate