Data Consistency Verification with Veridata
description
Transcript of Data Consistency Verification with Veridata
Data Consistency Verification with Veridata
Lorena Lobato Pardavila - CERN
Replication Technology Evolution for ATLAS Data Workshop
Veridata Overview Is a high-performance cross-platform data comparison tool that supports high-
volume compares Allows data consistency validation on “hot” data sets
3Replication Technology Evolution for ATLAS Data Workshop
REPOSITORYSOURCE
TARGET
OGG Veridata CLI
OGG Veridata Server
OGG Veridata Agents
DATABASES
OGG Veridata Web
CLIENTS
n : n
Veridata Overview
4Replication Technology Evolution for ATLAS Data Workshop
System Requirements
5Replication Technology Evolution for ATLAS Data Workshop
DYNAMICPORTLIST in each GoldenGateManager process (Might use 20 ports)
For Veridata Agent
o Every VA must be installed for each database instance that contains data that is to be compared
o Possibility of running multiple agents from a single installo 1GB of RAMo Java 1.6.0 or later is required for release 11.2.1o Ojdbc6.jar
For Veridata Server : 200 MB of fixed virtual memory for basic task
Privileges: Create a user and password and database role named VERIDATA_ROLE
o CREATE SESSION, CREATE TABLE, CREATE VIEW, CREATE PROCEDURE, CREATE SYNONYM
o Grant VERIDATA_ROLE to the usero Specify QUOTA UNLIMITED on the user's default tablespace
Setting up the Veridata Compares
6Replication Technology Evolution for ATLAS Data Workshop
1. Create database connections, source and target
2. Create group, a group of comparing pairs
3. Create compare pairs, what tables to compare
4. Create a job, to run one or more groups
5. Run a job
6. Compare results
Step 1: Connection
7Replication Technology Evolution for ATLAS Data Workshop
Create the connection to the corresponding databases where Veridata Agents are displayed
Step 2: Groups Creation
8Replication Technology Evolution for ATLAS Data Workshop
Step 3: Compare pair
9Replication Technology Evolution for ATLAS Data Workshop
Step 4: Job Creation
10Replication Technology Evolution for ATLAS Data Workshop
Step 5: Run / Execute Job
11Replication Technology Evolution for ATLAS Data Workshop
Step 6: Results
12Replication Technology Evolution for ATLAS Data Workshop
Reports
13Replication Technology Evolution for ATLAS Data Workshop
Veridata Key Points
14Replication Technology Evolution for ATLAS Data Workshop
Powerful tool for the data missing-synchronization identification
Along with GoldenGate, allows data real-time integration and continuous availability solutions validated data consistency
Stores OOS(Out-of-Sync) reports in binary, XML or both
Agents can connect remotely, not needed installation in target databases
200GB production data have been compared in an ATLAS environment with a speed of 16.86 MB/sec
Veridata 12.1.3 coming soon
It will have the ability to repair/fix out of sync data It will require WLS 12.1.3
Summer Student to investigate deeply Veridata
Live Demo
15Replication Technology Evolution for ATLAS Data Workshop
itrac910:8830/veridata/