Oracle 10g RAC VMware Redhat RHEL4
-
Upload
sharathk79 -
Category
Documents
-
view
114 -
download
0
Transcript of Oracle 10g RAC VMware Redhat RHEL4
![Page 1: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/1.jpg)
Building a RAC Test Environment on VMWare For Free
Dan Norrisd i @ [email protected]://www.dannorris.com/Thanks to Tim Hall @ oracle-base.com
![Page 2: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/2.jpg)
Agenda
•Who is Dan?•VMWare Orientation•Importance of prerequisite checking•Configuring node #1•Cloning (VM) node #1•Installing Clusterware•Installing ASM and Database•Creating DatabaseC Ch ll d I•Common Challenges and Issues
2
![Page 3: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/3.jpg)
Who is Dan?
•Virgo•Scuba Diver (PADI Advanced OW, Nitrox)Scuba Diver (PADI Advanced OW, Nitrox)•Over 21, under 35•Oracle DBA & UNIX Admin backgroundg•Certifiable: OCM, ACE Director, RHCE•Consultant, mostly fixing things that are broken•Active community participant: RAC SIG, SIG Council, DBA Track Manager, blogger, tweeter
•ESA Practice Manager at Piocon Technologies
3
![Page 4: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/4.jpg)
VMWare Orientation•Desktop Products
–VMWare Workstation: “Full” product $VMWare Workstation: Full product, $–VMWare Player: Free, no creation, just use
•Server ProductsServer Products–VMWare Infrastructure (ESX Server): $$$, robust, clustering capable, OS replacement, g p , p
–VMWare VirtualCenter: $$, management tool for whole environment, Windows
–VMWare Server: free, limited, on top of OS
4
![Page 5: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/5.jpg)
VMWare Server Hardware•Almost any server will do, mine is:
–Dell SC440: 1 x dual-core 3.0 Ghz–2 x 500Gb internal SATA drives, using LVM–4 Gb RAM
•I use Linux (OEL 5) as host OS•I use Linux (OEL 5) as host OS•Let Linux use LVM (default), allows disk space to be pooled for 900+ Gb on /u01space to be pooled for 900 Gb on /u01
•VMWare Server 1.0.5•Two Virtual Networks: 1 bridged & 1 host-gonly
5
![Page 6: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/6.jpg)
RAC: System Architecture
Cl tNode1 Node2
rac2rac1Cluster
InterconnectNode1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
6
![Page 7: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/7.jpg)
First: Build Node1
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
7
![Page 8: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/8.jpg)
Node1: Create New VM
8
![Page 9: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/9.jpg)
Node1: Create New VM
9
![Page 10: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/10.jpg)
Node1: Create New VM
10
![Page 11: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/11.jpg)
Node1: Create New VM
11
![Page 12: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/12.jpg)
Node1: Create New VM
12
![Page 13: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/13.jpg)
Node1: Create New VM
13
![Page 14: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/14.jpg)
Node1: Create New VM
14
![Page 15: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/15.jpg)
Node1: Create New VM
15
![Page 16: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/16.jpg)
Node1: Create New VM
(Pretend it says RAC1)(Pretend it says RAC1)
16
![Page 17: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/17.jpg)
Node1: Create New VM
17
![Page 18: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/18.jpg)
Node1: Create New VM
18
![Page 19: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/19.jpg)
Node1: Create New VM
19
![Page 20: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/20.jpg)
Node1: Create New VM
20
![Page 21: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/21.jpg)
Node1: Create New VM
21
![Page 22: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/22.jpg)
Node1: Create New VM
22
![Page 23: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/23.jpg)
Node1: Create New VM
23
![Page 24: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/24.jpg)
Install Node1 OS•Plan the network addresses for public and private networksprivate networks
•Start the VM and the CD image should boot•Install the OS ensuring enough swap and•Install the OS, ensuring enough swap and /tmpA i t ti dd t h i t f•Assign static addresses to each interface
•See whitepaper for package and setup d t ildetails
24
![Page 25: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/25.jpg)
Post-Install Steps on Node1•Modify /etc/hostsSet kernel parameters•Set kernel parameters
•Set limits in /etc/security/limits.conf•Add groups (oinstall, dba), oracle user•Set up oracle user’s profile (shell limits,Set up oracle user s profile (shell limits, ORACLE_BASE)
•Set up SSH user equivalency•Set up SSH user equivalency
25
![Page 26: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/26.jpg)
Prerequisite Checking•Most issues arise from misconfigurationof OS packages networks or storageof OS, packages, networks, or storage
•Tools exist to help check prerequisitesCVU–CVU
–RDA•Some basic networking knowledge helps•Recipes can help, be sure you p p, yunderstand why, not just follow steps
26
![Page 27: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/27.jpg)
Prerequisite Checking - RDA•Metalink Note 314422.1 will orient you to the RDA and has links for downloadthe RDA and has links for download
•Download the .zip file, unzip and run (as root or oracle):root or oracle):–./rda.sh –T hcve–provide the release you want to check–answer additional questions–obtain results in ./output/RDA* files
27
![Page 28: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/28.jpg)
Prerequisite Checking - RDA
28
![Page 29: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/29.jpg)
Prerequisite Checking - RDA
29
![Page 30: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/30.jpg)
Prerequisite Checking - CVU•http://www.oracle.com/technology/products/database/clustering/cvu/cvu downloacts/database/clustering/cvu/cvu_download_homepage.htmlDownload a zip file unzip it run it:•Download a .zip file, unzip it, run it:–cluvfy stage -list
30
![Page 31: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/31.jpg)
Prerequisite Checking - CVU
On AMD64 platforms, some packages will be listed twice, once for i386 and once for AMD64
31
![Page 32: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/32.jpg)
On AMD64 platforms, some packages will be listed twice, once for i386 and once fori386 and once for AMD64
32
![Page 33: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/33.jpg)
Done: Build Node1
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
33
![Page 34: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/34.jpg)
Next: Add Shared Storage
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
34
![Page 35: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/35.jpg)
Node1: Add Shared Storage•Shut down guest OS in Node1On the VMWare ser er host OS create•On the VMWare server host OS, create a new directory for shared disk files: mkdir p /u01/vmware/vms/rac disksmkdir –p /u01/vmware/vms/rac-disks
•Back at the VMWare Server Console, dd di k t th N d 1 (RAC1) VMadd new disks to the Node1 (RAC1) VM
as shown in the following example.
35
![Page 36: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/36.jpg)
Node1: Add Shared Storage
36
![Page 37: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/37.jpg)
Node1: Add Shared Storage
37
![Page 38: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/38.jpg)
Node1: Add Shared Storage
38
![Page 39: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/39.jpg)
Node1: Add Shared Storage
39
![Page 40: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/40.jpg)
Node1: Add Shared Storage
40
![Page 41: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/41.jpg)
Node1: Add Shared Storage
41
![Page 42: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/42.jpg)
Node1: Add Shared Storage•Repeat to create the following:
Vi t l D iPath Size Virtual Device Node
/u01/vmware/vms/rac-disks/ocr1.vmdk 10 Gb SCSI 1:0/u01/vmware/vms/rac-disks/voting1.vmdk 10 Gb SCSI 1:1/u01/vmware/vms/rac-disks/asm1.vmdk 10 Gb SCSI 1:2/u01/vmware/vms/rac-disks/asm2.vmdk 10 Gb SCSI 1:3/u01/vmware/vms/rac-disks/asm3.vmdk 10 Gb SCSI 1:4
42
![Page 43: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/43.jpg)
Node1: Add Shared Storage•Now for the tricky part: hand-editing VMWare configuration fileVMWare configuration file.
•The changes we make enable the disks to be shared with other VMsto be shared with other VMs.
•Add or update the following parameters i th “/ / / / /in the “/u01/vmware/vms/RAC1/Red Hat Enterprise Linux 4.vmx” file
43
![Page 44: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/44.jpg)
Node1: Add Shared Storagedisk.locking = "FALSE"diskLib.dataCacheMaxSize = "0"diskLib.dataCacheMaxReadAheadSize = "0"diskLib.dataCacheMinReadAheadSize = "0"diskLib.dataCachePageSize = "4096"diskLib.maxUnsyncedWrites = "0"
i1 h dB "VIRTUAL"scsi1.sharedBus = "VIRTUAL"
44
![Page 45: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/45.jpg)
Node1: Add Shared Storagescsi1:0.deviceType = "disk"scsi1:0.redo = "" scsi1:1.deviceType = "disk"scsi1:1.redo = "" scsi1:2 deviceType = "disk"scsi1:2.deviceType = "disk"scsi1:2.redo = "" scsi1:3.deviceType = "disk"ypscsi1:3.redo = "" scsi1:4.deviceType = "disk"scsi1:4.redo = ""
45
![Page 46: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/46.jpg)
Node1: Add Shared Storage•Boot Node1 again and partition the disks to create partition 1 as the whole diskto create partition 1 as the whole disk
•“Quick and Dirty” setup: add this to /etc/rc local:/etc/rc.local:chown oracle:oinstall /dev/sd[b-f]1
/ /chmod 600 /dev/sd[b-f]1
46
![Page 47: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/47.jpg)
Done: Add Shared Storage
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
47
![Page 48: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/48.jpg)
Next: Clone Node1 to Make Node2
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
48
![Page 49: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/49.jpg)
Create Node2: Clone Node1•Node2 is a VMWare clone of Node1Sh t do n Node1 nicel•Shut down Node1 nicely
•On host OS, do cp –Rp /u01/vmware/vms/RAC1 \/u01/vmware/vms/RAC2
mv /u01/vmware/vms/RAC2/RAC1.vmx \/u01/vmware/vms/RAC2/RAC2 vmx/u01/vmware/vms/RAC2/RAC2.vmx
49
![Page 50: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/50.jpg)
Create Node2: Clone Node1•Boot Node2 (leave Node1 down)•During power on choose Create when•During power on, choose Create when prompted about handling the identifer.
•Modify•Modify –/etc/sysconfig/network–/etc/sysconfig/network-scripts/ifcfg-eth0/ / fi / k i /if f h1–/etc/sysconfig/network-scripts/ifcfg-eth1
•From the console, run “service network restart”restart
50
![Page 51: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/51.jpg)
Create Node2: Clone Node1•Boot Node2 (leave Node1 down)•During power on choose Create whenDuring power on, choose Create when prompted about handling the identifer.
•Modify y–/etc/sysconfig/network–/etc/sysconfig/network-scripts/ifcfg-eth0–/etc/sysconfig/network-scripts/ifcfg-eth1/ / y g/ p / g
•From the virtual machine’s console, run “service network restart”
•You can now power up Node1
51
![Page 52: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/52.jpg)
Prerequisite Checking - CVU•Finally able to complete more prerequisite checkingprerequisite checking
•As the oracle user, run CVU to confirm private networking and userprivate networking, and user equivalence: / l f t t h 1 2./cluvfy stage –post hwos –n rac1,rac2
52
![Page 53: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/53.jpg)
53
![Page 54: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/54.jpg)
Prerequisite Checking - CVU•Shared storage checks don’t work on VMWare since the disks do not supportVMWare since the disks do not support SMART (used by CVU to verify disk accessibility)accessibility)
•Next, check the pre-crsinst stage like this:/ l f i t 1 2 \./cluvfy –pre crsinst –n rac1,rac2 \–r 11gR1
54
![Page 55: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/55.jpg)
Prerequisite Checking - CVU
55
![Page 56: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/56.jpg)
Prerequisite Checking - CVU
56
![Page 57: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/57.jpg)
Prerequisite Checking - CVU•With all CVU checks complete and successful we can move ahead tosuccessful, we can move ahead to installing clusterware!
57
![Page 58: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/58.jpg)
Done: Node2 Created
Node1 Node2Node1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
58
![Page 59: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/59.jpg)
Next: Install Clusterware
Node1 Node2Cl tNode1 Node2ClusterInterconnect
Shared LocalLocal Shared Storage
Local Storage
Local Storage
59
![Page 60: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/60.jpg)
Installing Clusterware•Clusterware installation performed from one node (Node1)one node (Node1).
•Ensure /etc/hosts is configured with host addresses VIP addresses and privateaddresses, VIP addresses, and private addresses
60
![Page 61: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/61.jpg)
Installing Clusterware
61
![Page 62: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/62.jpg)
Installing Clusterware
62
![Page 63: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/63.jpg)
Installing Clusterware
63
![Page 64: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/64.jpg)
Installing Clusterware
64
![Page 65: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/65.jpg)
Installing Clusterware
65
![Page 66: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/66.jpg)
Installing Clusterware
66
![Page 67: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/67.jpg)
Installing Clusterware
67
![Page 68: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/68.jpg)
Installing Clusterware
68
![Page 69: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/69.jpg)
Installing Clusterware
69
![Page 70: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/70.jpg)
Installing Clusterware
70
![Page 71: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/71.jpg)
Installing Clusterware
71
![Page 72: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/72.jpg)
Installing Clusterware
72
![Page 73: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/73.jpg)
Installing Clusterware
Note: Do not run theserun these scripts in parallel. Theyparallel. They should be run sequentially.
73
![Page 74: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/74.jpg)
Installing Clusterware
74
![Page 75: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/75.jpg)
Installing Clusterware
Now go back and click OK on the installer prompt box.p p
75
![Page 76: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/76.jpg)
Installing Clusterware
76
![Page 77: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/77.jpg)
Installing Clusterware
77
![Page 78: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/78.jpg)
Installing Clusterware
78
![Page 79: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/79.jpg)
Installing Clusterware•Once the installation is complete, you can check the status with crs stat -tcan check the status with crs_stat t
79
![Page 80: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/80.jpg)
Finished: Install Clusterware
Node1 Node2Cl tNode1 Node2ClusterInterconnect
Shared LocalLocal Shared Storage
Local Storage
Local Storage
80
![Page 81: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/81.jpg)
Next: Install ASM and Database
Cl tNode1 Node2
+ASM2+ASM1Cluster
InterconnectNode1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
81
![Page 82: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/82.jpg)
Installing ASM & Database
82
![Page 83: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/83.jpg)
Installing ASM & Database
83
![Page 84: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/84.jpg)
Installing ASM & Database
84
![Page 85: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/85.jpg)
Installing ASM & Database
85
![Page 86: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/86.jpg)
Installing ASM & Database
86
![Page 87: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/87.jpg)
Installing ASM & Database
87
![Page 88: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/88.jpg)
Installing ASM & Database
88
![Page 89: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/89.jpg)
Installing ASM & Database
89
![Page 90: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/90.jpg)
Installing ASM & Database
90
![Page 91: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/91.jpg)
Installing ASM & Database
91
![Page 92: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/92.jpg)
Installing ASM & Database
92
![Page 93: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/93.jpg)
Installing ASM & Database
93
![Page 94: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/94.jpg)
Installing ASM & Database
94
![Page 95: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/95.jpg)
Installing ASM & Database
95
![Page 96: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/96.jpg)
Installing ASM & Database
96
![Page 97: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/97.jpg)
Installing ASM & Database
97
![Page 98: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/98.jpg)
Installing ASM & Database
98
![Page 99: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/99.jpg)
Finished: Install ASM and Database
Cl tNode1 Node2
+ASM2+ASM1Cluster
InterconnectNode1 Node2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
99
![Page 100: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/100.jpg)
Next: Create Database
Cl trac1 rac2
+ASM2+ASM1
ClusterInterconnectNode1 Node2
rac1 rac2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
100
![Page 101: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/101.jpg)
Create Database
101
![Page 102: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/102.jpg)
Create Database
102
![Page 103: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/103.jpg)
Create Database
103
![Page 104: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/104.jpg)
Create Database
104
![Page 105: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/105.jpg)
Create Database
105
![Page 106: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/106.jpg)
Create Database
106
![Page 107: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/107.jpg)
Create Database
107
![Page 108: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/108.jpg)
Create Database
108
![Page 109: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/109.jpg)
Create Database
109
![Page 110: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/110.jpg)
Create Database
110
![Page 111: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/111.jpg)
Create Database
111
![Page 112: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/112.jpg)
Create Database
112
![Page 113: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/113.jpg)
Create Database
113
![Page 114: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/114.jpg)
Create Database
114
![Page 115: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/115.jpg)
Create Database
115
![Page 116: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/116.jpg)
Create Database
116
![Page 117: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/117.jpg)
Create Database
117
![Page 118: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/118.jpg)
Create Database
118
![Page 119: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/119.jpg)
Create Database
119
![Page 120: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/120.jpg)
Create Database
120
![Page 121: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/121.jpg)
Create Database
121
![Page 122: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/122.jpg)
Create Database
…after a rather long pause while i t t t d (d ll l )instances are started…(drumroll, please)
122
![Page 123: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/123.jpg)
Done: Create Database
Cl trac1 rac2
+ASM2+ASM1
ClusterInterconnectNode1 Node2
rac1 rac2
Shared LocalLocal Shared Storage
Local Storage
Local Storage
123
![Page 124: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/124.jpg)
Common Issues #1: Firewalls•Firewall and SELinux should be disabledCan be done d ring install ith some•Can be done during install with some versions of Linux. If not, then…S t i•Set SELINUX=disabled in /etc/sysconfig/selinux•chkconfig iptables off
•RebootReboot
124
![Page 125: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/125.jpg)
Common Issues #2: Storage•Shared Storage misconfiguration –different names for disks on each nodedifferent names for disks on each node
•For RHEL or OEL 5, use udev for privileges and device mappingprivileges and device mapping
•Note Linux v4 and v5 handle things differentlydifferently
•Ensure you use proper device in multipath configurations (not applicablemultipath configurations (not applicable in VMWare)
125
![Page 126: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/126.jpg)
Common Issues #2: Storage, cont’dNote Title
443996.1 How to map raw device on RHEL5 and OEL5
414897.1 How to setup /etc/udev/rules.d for OCR and Voting for RAC on SLES10/RH5/EL5
371814.1 Using udev with Oracle Architecture (RAC & ASM) – Red Hat 4.0
456239.1 Understanding device-mapper in Linux 2.6 kernel
357472.1 Configuring device-mapper for CRS/ASM
465001 1 Configuring raw devices for Oracle 10gR2 (10.2.0) Clusterware on 465001.1 RH/EL 5
126
![Page 127: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/127.jpg)
Common Issues #3: Networking•Networking, especially private network, must be configured properlymust be configured properly
•NO CROSSOVER CABLES ALLOWED!•In VMWare ensure you use correct•In VMWare, ensure you use correct interface for public, private networksU h t l t k f i t b id d•Use host-only network for private, bridged for publicS t b di b f i t lli l t•Set up bonding before installing clusterware
127
![Page 128: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/128.jpg)
Common Issues #4: Filesystems•Don’t “go nuts” with Linux filesystemlayoutlayout
•Avoid too many filesystems (especially on a test system)on a test system)
•Ensure you create sufficient swap space
128
![Page 129: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/129.jpg)
Common Issues #5: Host equivalency
•Don’t hate SSH, just set it up properly!ssh keygen t dsassh-keygen –t dsacat ~/.ssh/id_dsa.pub >> \/ /~/.ssh/authorized_keys
scp –rp ~/.ssh othernode:.ssh <remote_node> date
•Metalink Note 300548 1 is helpful•Metalink Note 300548.1 is helpful
129
![Page 130: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/130.jpg)
References•Much of this article originated from Tim Hall’s article at oracle-base com (withHall s article at oracle-base.com (with permission--Thanks, Tim!): http://tinyurl com/39ywx2http://tinyurl.com/39ywx2
•Oracle 11g Documentation•Oracle Metalink, multiple notes and articles
130
![Page 131: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/131.jpg)
131
![Page 132: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/132.jpg)
RAC SIG Events• See www.oracleracsig.org for details
–Webcasts: Average 2x per month, liveC f–Conference Events: • Customer Panel, Monday @ 10:30a• Experts Panel, Tuesday @ 12:15p
Bi d f F th W d d @ 1 30• Birds of a Feather, Wednesday @ 1:30p–Forums (via OTN): Lots of participation from RAC
SIG as well as Oracle gurusJ i th RAC SIG t l i !• Join the RAC SIG at www.oracleracsig.org!
132
![Page 133: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/133.jpg)
Building a RAC Test Environment on VMWare For Free
S i #341Session #341
Dan Norris Twitter: dannorrisDan Norris, Twitter: dannorrisPiocon booth #1619dnorris@piocon [email protected]://www.dannorris.com/
![Page 134: Oracle 10g RAC VMware Redhat RHEL4](https://reader031.fdocuments.in/reader031/viewer/2022022213/5466b43fb4af9f06758b4ab2/html5/thumbnails/134.jpg)
LegalThe information contained herein should be deemed reliable but not guaranteed. The author has made every attempt to provide current and accurate information. If you have any p y ycomments or suggestions, please contact the author at:
You may request redistribution permission from [email protected].
Copyright © 2008, Piocon Technologies
134