Performance Testing Progress and Oracle
-
Upload
bernard-madden -
Category
Documents
-
view
37 -
download
7
description
Transcript of Performance Testing Progress and Oracle
![Page 1: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/1.jpg)
Performance Testing Progress and Oracle
![Page 2: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/2.jpg)
Environment Variables and Installation
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Oracle
DLC /usr/dlc102B ORACLE_HOME /app/oracle/product/11.2.0
ORACLE_BASE /app/oracle
PATH $DLC/bin PATH $ORACLE_HOME/bin
To install
proinst To install runInstaller
Location /etc/oraInst.loc
inventory.xml
![Page 3: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/3.jpg)
Physical Structure (data files)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Database File sports.db Control File(s) control01.ctl
System Area sports.d1 System Tablespace system.dbf
D Files area.d Datafiles tablespace.dbf
Before-Image File + After-Image File
sports.b1 + sports.a1
Undo tablespace +Redo Log
undotbs.dbf + redo01.log
Copy of After-Image File
sports.date_time_etc
Archive Log sports.date_time_etc
Structure file sports.st Backup of control file to trace file
Log File sports.lg Alert Log alert_sports.log
Parameter File sports.pf pfile (or spfile) initsports.ora
![Page 4: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/4.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
sports.dbsports.d1sports.licsports.b1sports.stsports_7.d1sports_8.d1sports_9.d1sports.lgsports.pf
control01.ctlcre_controlfile.sqlredo01.logredo02.logredo03.logsystem01.dbfsysaux01.dbftemp01.dbfundotbs01.dbfusers01.dbf
.srt, .DBI
ORACLE_HOME
Physical Structure
![Page 5: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/5.jpg)
Logical Structure
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Area Schema Area Tablespace System Tablespace
Area consists of objects
Objects are Tables or Indexes
Tablespace consists of segments
Segments: Tables, Indexes, Undo, etc
Each Object has one or more Clusters
Clusters size could be 8,64 or 512 blocks
Each Segment has one or more Extents
An extent is a series of blocks that are consecutively numbered within a datafile
Clusters consist of blocks
blocks 1,2,4 or 8K Extents consist of blocks
blocks 2,4,8,16,32 or 64K
![Page 6: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/6.jpg)
Background Processes
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Asynchronous Page Writer APW Database Writer DBWn
Before/After Image Writer BIW, AIW Log Writer LGWR
AI Management AIMGT Archive Process ARCn
Watch Dog WDOG Process Monitor PMON
Database Broker _mproserv System Monitor SMON
Checkpoint process CKPT
Many other …. 20 at least
Login Broker _mproserv Listener lsnrctl
![Page 7: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/7.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Client Server -db db_name -H host -S service
Listener
Shared memory -db /full_path/db-name
N/A
Login Broker lsnrctl [start/stop/status]
Connecting to a database
$ORACLE_HOME/bin
![Page 8: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/8.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
-H host –S service1
-H host –S service2 S
Host:port:SIDSID
ListenerPort 1521
SID2
Connecting to a database
Host:port:SID2
![Page 9: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/9.jpg)
Meta-schema and VST
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Table Field Oracle View Column
_Area _Area-name DBA_TABLESPACES TABLESPACE_NAME
_AreaExtent _Extent-Path DBA_DATA_FILES FILE_NAME
_StorageObject _Object-type (1,2 or 3) DBA_OBJECTS object_type (38 types)
_File _File-name DBA_TABLES TABLE_NAME
_Field _Field-name DBA_TAB_COLUMNS
COLUMN_NAME
_Index _Index-name DBA_INDEXES INDEX_NAME
_Sequence _Seq-name DBA_SEQUENCES SEQUENCE_NAME
Progress Meta-schema tables -80 < _file-number < 0
Progress VST _file-number < -16384
![Page 10: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/10.jpg)
Meta-schema and VST
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Virtual System Tables V$ (Vee dollar) Views
_Connect v$session, v$process
_DbStatus v$instance, v$sysstat
_Trans v$transaction
_Lock v$lock
_Latch v$latch
_AreaStatus v$tablespace
_Filelist v$datafile
_Startup (some) v$parameter
![Page 11: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/11.jpg)
Data Types
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
character format "x(100)" varchar2 varchar2(100)
decimal format ">>>>9.99" number number(7,2)
integer format ">>>>9" number number(5)
date format 99/99/9999 date 'MMDDYY HH24:MI:SS'
logical format yes/no N/A N/A
datetime HH:MM:SS.SSS+HH:MM timestamp 'HH24:MI:SS.FF5'
int64 format ">>>>9" number number(38)
rowid rowid
recid N/A N/A
blob, clob,raw blob, clob,raw
10 -5
![Page 12: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/12.jpg)
Create Database
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 13: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/13.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 14: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/14.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 15: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/15.jpg)
Create Database
• prodb mydb• procopy empty8 mydb
• Min size 5 MB• Min memory 160KB• Time to create 1 second
• A set of .sql scripts • create database mydb;
• Min size 512 MB• Min memory 512MB• Time from 20 min to 1.5 hr
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 16: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/16.jpg)
Shutdown
• Unconditional Shutdown• Emergency Shutdown
• Shutdown Normal• Shutdown Transactional• Shutdown Immediate• Shutdown Abort
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress 10.2B-shutdownTimeout [ immed, 10m, 1h, maximum ]
![Page 17: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/17.jpg)
Startup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Closed ClosedNomount modeMount mode
Open Open
ProrestRestoreinit*.ora
.ctl
Shared MemoryBackground Proc
![Page 18: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/18.jpg)
Backup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress backup – simple Oracle RMAN – More complicated
probkup db_name file_name
Progress and Oracle : Online and Offline (Hot and Cold)
Progress and Oracle : Complete and Incremental
Oracle: could be Full and Partial
![Page 19: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/19.jpg)
Compressed Backup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
700 GB Progress DB makes about 600 GB probkup
1.4 TB Oracle DB makes either 1.2 TB regular backup or 250 GB RMAN compressed backup (BZIP2 is default).
![Page 20: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/20.jpg)
Dump and Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Dictionary Dump and Load in ASCII format (.d) or 4GL export/import
SQL select/insert“SQL Loader” or External Tables 10g
Binary Dump (proutil –C dump) Oracle export (exp tables=tbl_name)
Binary Load (proutil –C load) Oracle import (imp file=file_name)
Binary Dump multithreaded V10 Oracle Data Pump Export (expdp) 10g
Oracle Data Pump Import (impdp) 10g
Dump/Load .df Export/Import (exp full=y rows=n)
![Page 21: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/21.jpg)
ATM Database Tests
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Hardware: IBM POWER 6 p570, RAM 24GB, 2 CPUs 4704 MHz
Software: AIX 6.1, OpenEdge 11.0, Oracle 11gR2
Database: ATM database = 7GB
Tables # records
Branches 5,000
Tellers 50,000
Accounts 50,000,000
![Page 22: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/22.jpg)
Database Size
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress DB/area size 7,442,137,088Oracle DB/tablespace size 7,688,953,856
Oracle db appear to be 3% more in bytes
![Page 23: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/23.jpg)
Backup Size and Speed
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Oracle Oracle ( compressed )time 94 sec 140 sec 240 secondssize 7GB 7.8GB 735MB
![Page 24: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/24.jpg)
ASCII Dump (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle10,000 0.31 0.43100,000 1.56 3.321,000,000 15 328,000,000 115 259
for each account where account.id < "condition“ no-lock: export account.
select * from account where account.id < "condition"
![Page 25: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/25.jpg)
ASCII Load (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle100,000 3.75 0.81,000,000 53 1210,000,000 413 139
repeat: create account. import account.
insert into account select * from stg_account; -- External table
![Page 26: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/26.jpg)
Binary Dump (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 80.38 55.46
proutil atm -C dump PUB.account /dir -index 0 –RO
expdp user/passwd TABLES=ACCOUNT directory=DATA_DIR dumpfile=expdp.dmp parallel=2 -- Data Pump
![Page 27: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/27.jpg)
Binary Load with integrity
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 920.38 60.43
proutil atm -C load account.bd -B 50000 -TB 31 -TM 32 -T /tmp
impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump
![Page 28: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/28.jpg)
Binary Load no integrity (-i)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 216.28 60.43
proutil atm -C load account.bd -i -B 50000 -TB 31 -TM 32 -T /tmp
impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump
![Page 29: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/29.jpg)
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmptyRM BlockFreeRM BlockFullRM Block
HWM
![Page 30: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/30.jpg)
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmptyRM BlockFullRM BlockFullRM Block
HWM
![Page 31: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/31.jpg)
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyFullRM BlockFullRM BlockFullRM Block
HWM
![Page 32: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/32.jpg)
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmpty
HWM
![Page 33: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/33.jpg)
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
FullFullFull
HWM
![Page 34: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/34.jpg)
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
FullFullFull
HWM
![Page 35: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/35.jpg)
Build a brand new index
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 148.96 118.31
proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64
CREATE UNIQUE INDEX account_pk ON account (id);
![Page 36: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/36.jpg)
Rebuild existing index
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 153.95 81.88
proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64
ALTER INDEX account_pk REBUILD PARALLEL 2;
![Page 37: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/37.jpg)
ATM Test
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 38: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/38.jpg)
atm1.sql
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 39: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/39.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
CL Trans TPS Conc AvgR MinR 50%R 90%R 95%R MaxR Prog
1 329961 1100.0 0.8 0.00 0.0 0.0 0.0 0.0 99.1 atm1.p
5 341090 1137.0 3.9 0.00 0.0 0.0 0.0 0.0 93.0 atm1.p
15 358355 1194.5 13.9 0.00 0.0 0.0 0.0 0.0 95.0 atm1.p
25 360396 1201.3 22.4 0.02 0.0 0.0 0.0 0.0 97.6 atm1.p
50 367093 1223.6 49.8 0.04 0.0 0.0 0.0 0.1 88.4 atm1.p
100 348467 1161.6 99.6 0.09 0.0 0.0 0.0 0.2 88.2 atm1.p
250 341653 1138.8 248.9 0.23 0.0 0.0 0.1 0.6 98.6 atm1.p
500 315142 1050.5 495.6 0.47 0.0 0.0 0.3 1.2 82.8 atm1.p
1000 310793 1036.0 872.2 0.95 0.0 0.0 1.0 2.3 117.6 atm1.p
Progress ATM ResultsAll tests run for 300 seconds
![Page 40: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/40.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
CL Time Trans TPS Conc AvgR Prog
1 300 35589 118.6 1.0 0.01 atm1.sql
5 300 160492 535.0 4.8 0.01 atm1.sql
15 300 480898 1603.0 14.4 0.01 atm1.sql
25 300 803263 2677.5 23.7 0.01 atm1.sql
50 300 953962 3179.9 47.4 0.01 atm1.sql
100 300 1023948 3413.2 69.4 0.01 atm1.sql
250 300 1063454 3544.9 226.4 0.02 atm1.sql
500 300 1092404 3641.4 472.3 0.06 atm1.sql
1000 300 1113454 3711.5 861.3 0.13 atm1.sql
Oracle ATM ResultsAll tests run for 300 seconds
![Page 41: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/41.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 42: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/42.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
IBM Power 7 Model p75016 3.4 GHz CPUs x 4 SMTsRAM 124 GBSAN V7000
Big box Test
![Page 43: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/43.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 44: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/44.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Type: DBS and CC Only DBSAny -pf file anywhere init*ora In $ORACLE_HOME/dbsPromon R&D / 1 / 12 or _Startup select * from V$PARAMETER
Startup parameters
![Page 45: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/45.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
![Page 46: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/46.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
OEM parameters
![Page 47: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/47.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
-db db_name-B memory_target-bibufs log_buffer-n processes-spin spin_count-L dml_locks-Ma 1 Dedicated connections-Ma 2 or more Shared connections-cp* (I18N) NLS* National Language Support
Startup parameters
![Page 48: Performance Testing Progress and Oracle](https://reader036.fdocuments.in/reader036/viewer/2022062407/56812ea9550346895d944675/html5/thumbnails/48.jpg)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Questions
Web page www.proora.comEmail [email protected]