Oracle GoldenGate 12 - DOAG
Transcript of Oracle GoldenGate 12 - DOAG
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle GoldenGate 12c
Joachim Jaensch Principal Sales Consultant
(12.1.2.0 and 12.1.2.1)
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
2
3
4
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A
4
5
1
Agenda
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 5
2
3
4
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A
5
1
Agenda
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 6
Oracle GoldenGate – Everywhere
Data Protection Reference Architectures
Oracle GoldenGate
Oracle Database
Oracle Data Integrator
Oracle Enterprise Data
Quality
Oracle Data Service
Integrator
Big Data
Database
Apps
Cloud
Oracle Enterprise
Metadata Management
Delivering Real-Time Integration for Big Data and Cloud
Oracle Data Integration Solutions
Oracle GoldenGate
Source: Oracle White Paper: Oracle MAA Reference Architectures – The Foundation for Database as a Service
Oracle GoldenGate
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 7
Oracle GoldenGate 12c - Products
1. Oracle GoldenGate (Core Product) – Heterogeneous Replication
2. OEM Management Pack for Oracle GoldenGate – GUI for Control & Monitoring
Oracle GoldenGate Monitor (Stand Alone GUI)
Oracle GoldenGate Plug-In for Oracle Cloud Control (OEM Add-On)
Oracle GoldenGate Director (Obsolete Stand Alone GUI for old OGG versions only)
3. Oracle GoldenGate Veridata – Compare and Repair Tool
License!
Additional License!
Additional License!
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Product History & Roadmap Summary
2012
OGG 11.2.1 • Integrated, Downstream Capture
(Oracle) • Conflict Resolution/Detection • Globalization • Updated Event Markers • New IBM iSeries, PostgreSQL
(Delivery), Coherence, MySQL 5.5
June
2013
Oracle GG 12.1.2.0 • Integrated & Coordinated
Delivery • FSFO/ADG Integration • Native DDL & OUI (Oracle) • Oracle Wallet/Credentials
Store • Schema Wildcarding • New Oracle DB 12c, MySQL
5.6, MySQL Cluster 7.x*, Sybase 15.7*, DB2 10.1/10.5, TD 14.10, SQL/MX 3.2, SQL Server 2012
Enhanced Big Data Support Enhanced Appliances Support Data Integration Studio for OGG Real-time Data Integration Hub Services Based Infrastructure GoldenGate as a Service
October 2014
OGG 12.1.2.1 • Capture from Active Data Guard • Capture ANYDATA datatype • Support multiple editions (EBR) • Extended Tag based filtering • Capture Global Temporary Tables • Capture Cloning, Streams Migration • New Informix, DB2 11.1, z/OS 2.1, TD
15.00, MySQL Community Edition, Oracle DB 12.1.0.2,
May
Monitor 12.1.3
• Secure Command & Control
• Deeper Troubleshooting
• Support for z/OS
November
February
Veridata 12.1.3
• Repair
• LDAP Support
Director 11.2.1
OGG Monitor 11.2.1
OEM Monitor 12.1.0.2
• Real-time Metrics
• Add/remove processes
Summer
Veridata 11.2.1
New OGG EM Plug-
in 12.1.0.0
November
Director
12.1.2.
Continued Innovation
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 9
Oracle GoldenGate 12c – Monitor & Veridata Version 12.1.3
WLS
Oracle Fusion Middleware Infrastructure required (with Oracle Coherence)
WebLogic Server (WLS) required
Pre-defined WLS domain templates for Monitor & Veridata shipped
Choose: One domain for both or both in same domain ?
WLS
Domain 1
GoldenGate Monitor
Domain 2
GoldenGate Veridata
Domain
GoldenGate Veridata
GoldenGate Monitor
Recommended!
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Enterprise Ready Simplified Data Recovery Process
Enhanced Management and Monitoring
Repair with Oracle GoldenGate Veridata
Cloud Enabled
Socks 5 Support
VPN Proxy Support
10
Heterogeneous New IBM Informix Capture and Delivery
MySQL Community Edition Capture and Delivery
SQL Server 2014 Capture and Delivery
IBM DB2 11/zOS 2.1 Capture and Delivery
New BatchSQL support for Sybase ASE
Oracle Focused
Streams to GoldenGate Migration Utility
Integrated Capture Enhancements
Integrated Delivery
Column Level Character Set
Oracle GoldenGate 12c
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle GoldenGate 12.1.2.1 Heterogeneous Support
11
Databases OS and Platforms
Oracle GoldenGate Extract: Oracle IBM Informix IBM DB2 LUW IBM DB2 for z/OS 2.1 IBM DB2 for i/Series Microsoft SQL Server 2012 & 2014 Sybase ASE MySQL Standard Edition MySQL Community Edition MySQL Cluster Enscribe SQL/MP & SQL/MX JMS message queues
Linux (Oracle, Red-Hat) Sun Solaris Windows HP Non-Stop HP-UX HP OpenVMS IBM AIX IBM zSeries/iSeries zLinux
Oracle GoldenGate Replicat: All listed above, plus: • Teradata • TimesTen, PostgreSQL, Coherence • ETL Tools, Flat File • Big Data Solutions
New
New
New
New
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 12
Oracle GoldenGate 12c - Enhancements
Area Enhancements
Oracle Integration Support for Oracle Multitenant, Integrated Replicat for automatic dependency-aware apply, integration with Data Guard for auto-restart of GG components after failover
Improved Ease of Use Simpler configuration of DDL replication, Coordinated Replicat for all databases to allow for better, simpler scalability
Enhanced Security Integration with Oracle Credential Store for database authentication
Enhanced Heterogeneity New capabilities for replication for MySQL, SQL Server, Sybase, Teradata, and DB2.
Cloud Ready Capture from and delivery to the Cloud, both Cloud to Cloud and on-premises to cloud
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Real-Time Data Integration & Transactional Replication
Oracle Confidential – Internal/Restricted/Highly Restricted 13
PERFORMANCE:
Low-impact Real-Time Data
Integration and Replication
FLEXIBLE:
Open, Modular Architecture
Heterogeneous including Cloud
and Big Data
RELIABLE:
Maintains, Transactional Integrity
Resilient against Failures
Real-Time Changed Data Capture
Data Integrator
New DB/ HW/OS/APP
Fully Active Distributed
DB
Reporting Database
Data Warehouse
Message Bus
Oracle & Non-Oracle Database(s)
Message Bus
Cloud
Cloud & On-
Premises
Big Data
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Real-Time Big Data Integration with GoldenGate
14
HDFS (Files)
HBase (NoSQL)
Hive / Hive Streaming (SQL)
Flume & Storm (Streaming)
Kafka (MPP Pub/Sub)
Spark Streaming (Machine Learning)
Capture Database Transactions and Deliver to Big Data in Real-Time
Cap
ture
Trai
l
Ro
ute
Del
iver
Pu
mp
GoldenGate
JMS
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 15
Agenda
1
3
4
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A 5
2
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Business Goals for Oracle GoldenGate 12c
Cloud Ready Lower TCO Improved
Performance
Optimized for Oracle 12c
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Optimized for Oracle Database 12c
• Overview
Oracle GoldenGate
12c
Optimized for Oracle Database 12c
Support for 12c specific features; non-consolidated /
consolidated databases (aka multitenant database), new data types (large Varchar) and GoldenGate Package for
Administration
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Support of Oracle Database 12c Multitenant
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Integrated Replicat for the Oracle Database
• Overview
Oracle GoldenGate
12c
Integrated Delivery for the Oracle Database
Unique, next generation, high-speed data apply using Oracle-
only technology.
Leverages the database parallel apply servers for auto dependency aware parallel apply.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 20
Integrated Capture & Integrated Replicat for Oracle Databases
New in 11.2.0.4 New in 12.1.0.1
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Integrated Replicat - Architecture
Replicat
Reads the trail file
Constructs logical change records (LCRs)
Transmits LCRs to Oracle Database via the Lightweight Streaming API
Inbound Server (Database Apply Process)
Receiver: Reads LCRs
Preparer: Computes the dependencies between the transactions (primary key, unique indexes, foreign key) , grouping transactions and sorting in dependency order.
Coordinator: Coordinates transactions, maintains the order between applier processes.
Applier: Performs changes for assigned transactions, including conflict detection and error handling.
Trail Files
Delivery Lightweight Streaming
API
Receiver Preparer Coordinator
Inbound Server
Applier N
Applier 2
Applier 1
Oracle Database
21
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Overview
Oracle GoldenGate
12c
Coordinated Delivery for All Databases
Full Coordination Across Events Requiring Ordering; DDL,
Primary Key Updates, EMI and SQLEXEC.
Simplified Parameter File Management
Applicable to All Database
Simplifying Deployments for All Databases
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Prior to OGG 12c - High Volume Replication
Trail
Files
Delivery
Delivery
Delivery
Delivery
Customer defined split
SQL
SQL
SQL
SQL
Target Oracle and Non-Oracle Databases
GoldenGate
Delivery
23
MAP sales.acct1, TARGET sales.acct1;
MAP sales.acct2, TARGET sales.acct2;
MAP sales.acct3, TARGET sales.acct3;
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Coordinated Replicat for Non-Oracle Databases
Trail
Files
Thread
Thread
Thread
Thread
Customer defined split
SQL
SQL
SQL
SQL
Single replication process for customer
GoldenGate coordinates
thread for barrier operations
Target Oracle and Non-Oracle Databases
GoldenGate
Delivery
24
MAP sales.acct1, TARGET sales.acct1, THREAD(2); MAP sales.acct2, TARGET sales.acct2, THREAD(3); MAP sales.acct,3 TARGET sales.acct3, THREADANGE(4-9);
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Coordinated vs. Integrated Replicat
25
Coordinated Replicat
Integrated Replicat
Thread management
User Specified Automatic based on foreign keys and unique identifiers
Maintain Commit Boundaries
Single Thread only
Fully Maintained
Database Support All databases Oracle 11.2.0.4 and 12c
SQL Execution Done by the OGG Replicat process Execution is done in the database server
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Improved Ease of Use
• Overview
Oracle GoldenGate
12c
Improved Ease of Use
Default Automatic Discard File
Enhanced Debugging with SHOWSYNTAX to view SQL
Generated by GoldenGate
Ease of Configuration with Schema Wildcarding
Improved Security
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
More Secure
• Overview
Oracle GoldenGate
12c
Expanded Security
Previous releases of Oracle GoldenGate stored user details as
either plain text or with light encrypted.
GoldenGate 12c includes integration with the Oracle Credential Store and Oracle Wallet provides deep encryption plus the
ability to store and retrieve of key username and passwords using aliases.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Expanded Heterogeneity
• Overview
Oracle GoldenGate
12c
Expanded Heterogeneity
Support latest version of major databases such as: Oracle
MySQL, Microsoft SQL Server, Sybase, and IBM DB2. Added Informix
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Expanded Oracle Application and Technology Support
• Overview
Oracle GoldenGate
12c
Expanded Oracle Application and Technology Support
Low downtime database migration for E-Business Suite and
Active-Active data center synchronization for ATG Web Commerce is now available.
Tight Integration with Oracle Coherence to enable real-time change data feeds from source database to the Coherence
Cache.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle GoldenGate
12c
Summary: Oracle GoldenGate 12c
Optimized for Oracle Database 12c
Integrated Delivery for the Oracle Database
Coordinated Delivery for All Databases
Improved Ease of Use
More Secure & Expanded Heterogeneity
Enhanced High Availability
Expanded Oracle Application and Technology Support
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Move Data To, and From Public Cloud-based Systems
Restricted Secure Proxies
Supports enterprises that utilize both cloud-based and on-premises system to host their database systems
31
Restricted network ports established between
cloud and on-premises
SOCKS 5 Compliance to enable
secure communication
Support HTTP Proxy Tunnel to enable communication
over http://
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle GoldenGate for On-Premises - Cloud Integration
Unidirectional Query Offloading Zero-Downtime Migration Data Integration Cloud or On-Premise
Bi-Directional Active-Active for Multi-Master/HA Cloud or On-Premises
Big Data Delivery Real/Time and Batch Delivery Structured Data to Data Reservoir
Data Distribution via Messaging
Cloud Apps Integration
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 33
1
2
4
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A 5
3
Agenda
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle GoldenGate 12c
Joachim Jaensch Principal Sales Consultant
12.1.2.1 – New Features Separate Presentation
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
1
2
3
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A 5
4
Agenda
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Streams to GoldenGate Conversion Utility
Streams is now deprecated (as of Oracle 12c)
Designed to help existing Streams users convert their replication into Oracle GoldenGate replication.
The streams2ogg tool will generate the appropriate GoldenGate 12c configuration files allowing for an easier way to migrate the Streams implementation into a GoldenGate implementation.
This tool will help
Eliminate manual conversion errors
Minimize the GoldenGate learning curve for Streams customers
Implement GoldenGate best practices
36
Later this day
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
Oracle GoldenGate 12c
Oracle GoldenGate 12.1.2 Review
Oracle GoldenGate 12.1.2.1 New Features separate PPTX
Streams to GoldenGate Conversions
Q&A 5
Agenda
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Questions and Answers
38 Oracle OpenWorld 2014
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Resources
39
Oracle Data Integration Oracle Data Integration OracleGoldenGate ORCL DataIntegration blogs.oracle.com/dataintegration
Oracle Data Integrator
Oracle GoldenGate
Oracle Enterprise Data Quality
Oracle Enterprise Metadata Management
Oracle Data Services Integrator
http://www.oracle.com/us/products/middleware/data-integration/overview/index.html
Data Integration
Oracle OpenWorld 2014
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 40