DB Migration for · PDF fileFJH has earned 1 st place in Oracle Certified Master AWARD ......
-
Upload
duongtuyen -
Category
Documents
-
view
216 -
download
1
Transcript of DB Migration for · PDF fileFJH has earned 1 st place in Oracle Certified Master AWARD ......
INTERNAL USE ONLYINTERNAL USE ONLY Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED
DB Migration for Oracle
September, 2010
Database Solution Div.Fujitsu Hokuriku Systems Ltd.
Takashi Ikeda
Outline
1. About FUJITSU HOKURIKU SYSTEMS (FJH)
2. Concerning Business Downtime
3. GRID Center Co-Evaluation Result Report
4. Cross Platform DB Migration
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED1
4. Cross Platform DB Migration
1. About FUJITSU HOKURIKU SYSTEMS (FJH)
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED2
About FUJITSU HOKURIKU SYSTEMS (FJH)
Since 2008, FJH has had the
largest number of certified Oracle
OCM engineers in Japan.
Oracle OCM is the most
advanced Database
FJH has earned 1st place in Oracle Certified Master AWARD
for 3 years running in Japan.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED3
advanced Database
Administrator certification.
FJH is the Oracle database professional organization
within the Fujitsu group.
Introduction
Name : Takashi IkedaORACLE Certified Master (OCM)- Oracle9i Database (2004.1 The 1st in JPN)- Oracle Database 10g (2008.3)- Oracle Database 11g (2010.6)
Work Experience1998 Joined Fujitsu Hokuriku Systems.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED4
1998 Joined Fujitsu Hokuriku Systems.Became engaged in Oracle database support.
2004 Provided support for DB tuning and DataGuard (DG) service. 2006 Engaged in construction of Large-scale DB systems. 2007 Successfully led the RAC+DG(logical+DG(physical)system project2008 Developed the "DB Migration for Oracle” service
Currently providing expertise on DB migration services to Fujitsu customers.
'DB Migration for Oracle'
Requirements
Definition
Fundamental
designDetailed
design
Imple-
mentation
Unit
Test
Integration
Test
System
Test
Migration OperationProposal
We provide the following as the assessment (evaluation report).
・The best DB Migration method for the project・Projected time necessary for migration・Migration risk (Compatibility, priority)
Hearing/data collection
Requirement/data analysis
Assessment report
Migration Assessment
Oracle Japanco-development
Our 3 services for a successful DB migration
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED5
Technology consulting for entire DB Migration project (Planning/Design/Construction/Test)Offering expertise of ORACLE Certified MASTER holder.
Select pattern and customize
Assessment report
Apply adequate migration
Migration using pre-verified high-quality method/procedure/tools
・Migration to Oracle11g environment・Migration with DB configuration change・Migration with platform change
Migration Consulting
Migration Solution
Oracle Japanco-evaluation
Positioning of ‘DB Migration for Oracle’
DB migration for Oracle・DB Migration assessment
・DB Migration solution
・DB Migration consulting
�Solutions for new environment migration
�The Services are specialized for DB Migration.
�DB migration knowhow is systematized.
Reduced customer/ systems engineer works for DB migration
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED6
8i/9i 11gMigration
New serverExisting serverworks for DB migration
→Specialized migration services are provided.
Customers does not need to acquire special skills for migration.
→Customers/systems engineers can focus on new base/operation system testing
2.Concerning Business Downtimeduring DB Migration
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED7
Challenges in DB Migration
In HW replacement and server integration projects, DB Migration is necessary and it is very important.
It is key to leading a successful project.
Customer requirements
� Shorten business downtime as much as possible.
� Minimize risk during DB migration.
� Identify risks early
Time is greatly shortened.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED85
� Identify risks early
Systems Engineer's Challenges
� Identify the best method of DB Migration.
� Achieving required business downtime.
� Limited time to examine DB Migration procedure.
� Lack of knowledge in system replacement projects.The ORACLE expert corresponds.
Risk/cost is determined.
OROROROR
・How long will it take to complete a large DB Migration?(Terabyte-scale)
Customer’s Concern
There is a big concern of DB migration project.
�Business Downtime
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED9
(Terabyte-scale)
・Downtime needs to be minimized (a few hours if possible).
・Downtime is critical success factorwhen planning and determining stages.
Business Downtime
�DB size is getting larger (TB scale ~).
�Required downtime is getting shorter (~ a few hours).
� Servers are often replaced at the same time as DB upgrade.
� Physical reallocation of data is necessary in the DB migration.
� With large-scale DB (TB scale), data migration time is key.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED10
9i 11g
DB size 1TB
How to transfer data to new
hardware in shortest time?
The key to migration.
3.GRID Center evaluation result reportFJH-ORACLE Japan co-evaluation
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED11
Purpose of testing
�The 1TB-size DB can be migrated and upgradedwithin 2 hours?
Evaluate and verify methods for migrating large-scale database in a short time (a few hours).
FUJITSU and ORACLE established the effective
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED12
FUJITSU and ORACLE established the effective
methods for large-scale DB migration.
- Target: Migration from Oracle9i to Oracle11g - Use only standard functions provided by Oracle Database Software,
use no additional middleware.
Summary of the evaluation
� Achieved migration speed of 65 minutes from 9i to11g DB Migration.
� Verified migration methods for terabyte-scale DB
all data(660GB)
recently data(60GB)
datafiles(1.2TB)
+archived log
datafiles(1.2TB)
+archived log
Migratiedobjects(size)
22h 13mDB Link + direct load(entire)
4
Data size should be minimized by selecting data.
2h 5mDB Link +
direct load(delta)
3
-nologging operations are not available
1h 25mDataGuard (physical)+ Upgrade script
2
-nologging operations are not available
-need self-contained tablespae
1h 5mDataGuard (physical)+ transportable tablespace
1
No. notestimeMigration method
all data(660GB)
recently data(60GB)
datafiles(1.2TB)
+archived log
datafiles(1.2TB)
+archived log
Migratiedobjects(size)
22h 13mDB Link + direct load(entire)
4
Data size should be minimized by selecting data.
2h 5mDB Link +
direct load(delta)
3
-nologging operations are not available
1h 25mDataGuard (physical)+ Upgrade script
2
-nologging operations are not available
-need self-contained tablespae
1h 5mDataGuard (physical)+ transportable tablespace
1
No. notestimeMigration method
Oracle9i
9i
①Export
dmp
Oracle11g
11g③Import
dmp
②Forwarding
(FTP etc.)
Oracle9i
9i
Oracle11g
11g
①DB link+ direct
Load
Oracle9i
9i
Oracle11g
①Migration inIn advancer.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED13
This benchmark is showcased in various seminars
and proposals.
The response from customers is very positive.
Implemented in projects for Manufacturing, Securities
and Power companies in Japan.
Successful in eliminating customer concerns about
business downtime.
datafiles(1.2TB)
+archived log
all data(660GB)
datafiles(1.2TB)
-nologging operations are not available
2h 15m(estimated)
Solaris Containers
STDBY+UPGRADE(8.1.7)
7
31h 2mFile copy + Upgrade script5
+ direct load(entire)
6 33h 12mExport/Import
datafiles(1.2TB)
+archived log
all data(660GB)
datafiles(1.2TB)
-nologging operations are not available
2h 15m(estimated)
Solaris Containers
STDBY+UPGRADE(8.1.7)
7
31h 2mFile copy + Upgrade script5
+ direct load(entire)
6 33h 12mExport/Import
11g ②The final Migration
Oracle11g
9i → 11g
② Upgrade To 11g
Oracle9i
9i
①The entire data filecopy
Oracle9i
Oracle11g
9i → 11g
④ To 11gUpgrade
Executing
Oracle9i
9i
Data Guard
composition
arc
①Archive forwarding
②REDO Apply
③Activate by 9i.
Oracle9i
Oracle11g
Oracle9i
9i
Data Guard
composition
arc
①Archive forwarding
②REDO Apply
③Activate by 9i.
Oracle9i
9i
meta
11g
④Export ⑤Import
Oracle8i
8i
Standby
configuration
arc
①Archive forwarding
②REDO application
③Activate by 8i.
8i 11g
④Up to 10g. ⑤Up to 11g.
Oracle11g
Solaris10Solaris8Containers
Oracle8i
10g
Evaluation Environment
100Mbps LAN
DB server (source)FUJITSU PRIMEPOWER 250
(SPARC64V 1.1GHz x 2CPU)
Solaris 9
Oracle9i R2 EE
DB server (target) FUJITSU SPARC Enterprise M4000
(SPARC64VII 2.4GHz x 4CPU(16CORE))
Solaris 10
Oracle11g EE
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED14
9i 11g
DB size 1TB DB size 1TB
ETERNUS 4000 M500
RAID5 (7+1)x3146GB(15000rpm)
ETERNUS 4000 M500
RAID5 (7+1)x3146GB(15000rpm)
Database Structure
� 1TB of user tablespace
526GB in USER01 tablespace
User 1:407GB
254GB 153GB
526GB in USER02 tablespace
User 3:120G
76GB 43GB
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED15
table size Index size
526GB in USER02 tablespace
User 2:407GB User 4:120G
254GB 76GB 43GB153GB
660GB 392GB = 1052GB +α* ≒ 1.2TB*: SYSTEM/SYSAUX, etc.
+
Oracle9i
9i
About 1.2TB
(660GB)
Export/Import
Over 33 hoursStep 1) 16 hours, 53 minutes
for Exporting 660GB
Step 2) 10 hours for Importing 660GB
3) 6 hours, 19 minutesfor creating index
Total duration: 33 hours and 12 minutes1) Export(NFS)
*parallel
dmp
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED16
Total duration: 33 hours and 12 minutes
Exporting to NFS speed is 11.1MB/s.
(Near limit of 100Mbps line)
� Transfer time depends on amount of data.
Reference: Local output: 4 hours and 43 minutes
File transfer: 16 hours and 46 minutes
Oracle11g
11g
OracleNet:SDU=32K
*parallel
2) Import
dmp
3) Index build
11.1MB/s
File Copy + Upgrade Script
Over 31 hoursStep 1) 30 hours and 12 minutes
for 1.2 TB copy
Step 2) 50 minutesfor executing upgrade
Total duration: 31 hours and 02 minutes
Oracle9i
9i
1) Copy entire data files
About 1.2TB
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED17
Copying to new HW speed is 11.2MB/s.
(Near limit of 100Mbps line)
� Migration method is simplebut it takes time.
� It depends on the data file size.
Oracle11g
9i → 11g
2) Upgrade
to 11g
Oracle9i
11.2MB/s
Oracle9i
9iAbout 1.2TB
(table: 660GB)
DB link + Direct Load Insert (Entire)
Over 22 hoursStep 1) 15 hours and 54 minutes
*Direct load (table:660GB)
Step 2) 6 hours and19 minutes*Index build
Total duration: 22 hours and 13 minutes 1) DB link
+ direct load
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED18
Loading to new HW speed is 11.2MB/s.
(Near limit of 100Mbps line)
� Time depends on the amount of real data.
Oracle11g
11g
+ direct load
*parallel
2) Index build
11.8MB/s
OracleNet:SDU=32K
DB link + Direct Load Insert (Delta)
2 hoursStep 1) 1 hour 27 minutes
*load data (60GB)
Step 2) 38 minutes*build index (36GB)
Total duration: 2 hours 5 minutes
Oracle9i
9i
-Prior migration
of the past data
(600GB)
- migration of
1) DB link + direct load
*parallel
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED19
Total duration: 2 hours 5 minutes
Loading to new HW speed is 11.2MB/s.
(Near limit of 100Mbps line)
� Scope of load is limited to
the latest part.
� Depends on amount of the latest data.
Oracle11g
11g
- migration of
the latest data
(60GB)11.8MB/s
OracleNet:SDU=32K
2) Index build
DataGuard + Upgrade Script
1.5 hours
Step 3) 35minutes*failover + α
Step 4) 50minutes*execute upgrade
Oracle9i
9iData Guard
configuration
arc
1) Archive transfer
2) REDO Apply
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED20
Total duration: 1 hour 25 minutes
� Time reduction using DataGuard
� Depends on componentsand numbers of objects for Upgrade
Oracle11g
9i → 11g
4) upgrade to
11g
2) REDO Apply
3) Activate by 9i.
Oracle9i
DataGuard + Transportable Tablespace
1 hour
Step 3) 35minutes*failover + α
Step 4,5) 30minutes*executing TTS
Oracle9i
9iData Guard
configuration
arc
1) Archive transfer
2) REDO Apply
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED21
Total duration: 1 hour 5 minutes
� Time reduction using DataGuard.
� Depends on componentsand numbers of objects for Upgrade
Oracle11g
2) REDO Apply
3) Activate by 9i.
Oracle9i
9i
meta
11g
4) Export 5) Import
Solaris Containers use STDBY+Upgrade
<Older Oracle version case>
About 2.3 hours (estimated)Step 3) 35minutes * failover + α
Step 4) 50minutes * upgrade to 10g
Step 5) 50minutes * upgrade to 11g
Total duration: 2 hour 15 minutes
Oracle8i
8iStandby
configuration
arc
1) Archive forwarding
2) REDO application
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED22
Total duration: 2 hour 15 minutes
� Solaris8 Containers is useful for upgrading. (e.g. Sol8 on Sol10 + Oracle 8.1.7)
� Copy DB made using Standby DB.
� 2 Phase upgrade by SQL script
2) REDO application
3) Activate by 8i.
8i 11g
4) Up to 10g. 5) Up to 11g.
Oracle11g
Solaris10Solaris8
Containers
Oracle8i
10g
Results of the co-evaluationNo. Migration method Migratied
objects(size)time notes
1 DataGuard (physical)+ Transportable tablespace
datafiles(1.2TB)
+archived log
1h 5m -nologging operations are not available
-need self-contained tablespae
2 DataGuard (physical)+ Upgrade script
datafiles(1.2TB)
+archived log
1h 25m -nologging operations are not available
3 DB Link +
Direct load(delta)
recently data(60GB) 2h 5m Data size should be minimized by selecting data.
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED23
4 DB Link + Direct load(entire)
all data(660GB) 22h 13m
5 File copy + Upgrade script datafiles(1.2TB) 31h 2m
6 Export/Import all data(660GB) 33h 12m
7 Solaris Containers
STDBY+UPGRADE(8.1.7)
datafiles(1.2TB)
+archived log
2h 15m(estimated)
-nologging operations are not available
No elimination of fragmentations → DataGuard is effective(1, 2, 7)Need to eliminate fragmentations → DB Link+direct load(delta) is effective(3)
4. Cross Platform DB MigrationOracle GoldenGate
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED24
Cross Platform DB Migration
How to migrate large-scale DB in short time?
�Using DataGuard is effective
- Basically need same platform
�DB Link+Direct load can be used for cross platform
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED25
Oracle GoldenGate is very effective
- Migration time depends on the amount of data
Is there rapid migration method in case of cross platform?
DataGuard Certified Matrix
No Source Target
1 2 3 4 5 6 7
1
Solaris[tm] OE (64-bit)
Solaris Operating
System (SPARC) (64-bit)
OK NG NG NG NG NG NG
2HP-UX (64-bit)
HP-UX PA-RISCNG OK
OK(10g onward)
NG NG NG NG
3HP-UX IA (64-bit)
HP-UX ItaniumNG
OK(10g onward)
OK NG NG NG NG
OK OK
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED26
4Linux (32-bit)
Linux x86 NG NG NG OK
OK(10g onward)
OK(10g onward)
NG
5Linux IA (64-bit)
Linux Itanium NG NG NG
OK(10g onward)
OKOK(10g onward)
OK(11g onward)
6Linux 64-bit for AMD
Linux x86-64NG NG NG
OK(10g onward)
OK(10g onward)
OKOK(11g onward)
7
Microsoft Windows 64-
bit for AMD
Microsoft Windows (x86-
64)
NG NG NG NGOK(11g onward)
OK(11g onward)
OK
e.g. If migrating to Solaris(SPARC), Oracle GoldenGate is very useful
Migration Using Oracle GoldenGate(GG)
Oracle 9i Oracle 11g
OLTP Users
OLTP Users
Oracle 9i Oracle 11g
OLTP Users Testers
OLTP Users
1)
2)
4)
5)
Start GG capture
Initial copy/load
Test New DB
Configureswitch-back
Capture
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED27
Oracle 9i Oracle 11g
Initial copy/load
Oracle 9i Oracle 11g
OLTP Users
Oracle 9i Oracle 11g
Oracle 9i Oracle 11g
OLTP Users3) 6)Apply(Replicat) Switch to New DB
Migration Using GoldenGate Evaluation
Public Network
1000 Base-T
Workload Client
Public Network
SPARC Enterprise SPARC Enterprise
GoldenGate ReplicatGoldenGate Extract
GoldenGate on SPARC Enterprise is validated and it is now available.
a few minutes for switching to New DB
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED28
1000 Base-T
1000 Base-T
SAN Storage for ASM
Private Network for GoldenGate
Private Network for RAC
1000 Base-T
Private Network for RAC
Private Network for GoldenGate
1000 Base-T
Linux box as a Network Simulator
Private Network for NAS
Eternus4000M300NR1000F250
SPARC Enterprise M3000
SPARC Enterprise M4000
NAS storage
Reduced Business Downtime
FUJITSU and ORACLE established the effective
methods for large-scale DB migration.
Methods
Same PlatformMigration
Cross PlatformMigration
A Few MinutesMigration
Data Guard OK -- --
Copyright 2010 FUJITSU HOKURIKU SYSTEMS LIMITED29
Data Guard OK -- --
DB Link + Direct Load OK OK --
GoldenGate OK OK OK
30