Bixfr01g and Bixfr02g Sol 10 Implementation Plan

download Bixfr01g and Bixfr02g Sol 10 Implementation Plan

of 26

Transcript of Bixfr01g and Bixfr02g Sol 10 Implementation Plan

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    1/26

    Solaris 10 u9+ Live Upgrade from Sol8/9

    NOTE: as with all changes check work before making changes that would be difficult to undo.

    Summary:

    Fail resources over to secondary node. Rebuild bixfr01g to Sol 10 on MROOT. Bring back upon Sol 9. Fail resources back to primary node from secondary node. Rebuild bixfr02g to Sol 10

    on MROOT. Once upgrade is complete on secondary node, take down both nodes and bring

    back up on Solaris 10/configure Veritas cluster 5.0/Final step Patch Solaris 10

    Hostname / Regional Name:

    bic08533/bixfr01g

    bic08534/bixfr02g

    Application

    EDICONNECTDIRECT

    IP address

    139.76.72.19 bixfr01g

    139.76.72.20 bixfr02g

    Contact Database Application EDICONNECTDIRECT

    MSM Support Level: Application Hosting OS: SunOS 5.9

    Bixfr01g

    Disk

    Name Size Hardware Path Purpose OS status on disk

    c1t0d0 72G /pci@1f,700000/scsi@2/disk@0,0:a Root disk

    Current OS Disk with

    Solaris 9

    c1t1d0 72G /pci@1f,700000/scsi@2/disk@1,0:a

    Mirror

    disk

    Disk to be used for Sol

    10 OS

    c1t2d0 72G /pci@1f,700000/scsi@2/disk@2,0:a Alboot

    Bixfr02g

    Disk

    Name Size Hardware Path Purpose OS status on disk

    c1t0d0 72G /pci@1f,700000/scsi@2/disk@0,0:a Root disk

    Current OS Disk with

    Solaris 9

    c1t1d0 72G /pci@1f,700000/scsi@2/disk@1,0:a

    Mirror

    disk

    Disk to be used for Sol

    10 OS

    c1t2d0 72G /pci@1f,700000/scsi@2/disk@2,0:a Alboot

    The objective of the OS upgrade on this box is leaving the current OS untouched. Detach the mirror

    disk and repartition the mirror disk. Install new Solaris 10 OS on the mirror disk and boot from the

    mirror disk.

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    2/26

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    3/26

    Booted from root disk under Disk suite

    # dfk / ( Ensure it is booted from md device)

    # prtconf -pv |grep bootpath (note the hardware path and verify you are booted from

    /pci@1f,700000/scsi@2/disk@0,0:a

    (Identify the root D number and the primary and secondary disk from metastat)

    SunOS bic08533 5.9 Generic_122300-53 sun4u sparc SUNW,Sun-Fire-V440

    # echo |format

    (Match the prtconf boot-device physical path with format output of the root disk physical path -

    after ensuring you are booted from the correct root drive)

    Detach the mirror from Disksuite

    # metadetach d0 d2 (root)

    # metadetach d10 d12 (swap)

    # metadetach d20 d22 (/var)

    #metadetach d30 d32 (/opt)

    #metadetach d40 d42 (/bto)

    #metadetach d50 d52 (/globaldevices )

    # metaroot /dev/dsk/c1t0d0s0 and edit the /etc/vfstab to change disk format from metadevice to

    cXtXdXsX format.

    # grep md /etc/system

    rootdev:/pseudo/md@0:0,0,blk

    Comment out the above entry in /etc/system. Use * to comment

    3. After secondary mirror is detached, boot from the root disk and ensure it is still bootable

    # init 6

    4. Check if server comes on root disk (Should be in cXtXdXsX format)

    5. Comment all application file systems# cp -p /etc/vfstab /etc/vfstab.orig.`date`

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    4/26

    #vi /etc/vfstab (Remove all application file systems)

    Disable functions

    # vi /bto/sys/platform/root_cron/csa_cron (comment out the following entries)

    Reboot cron entry

    Broot update script cron entry SCIM cron entry

    # /bto/sys/platform/ bin/ merge_crons

    Make swap as dump devices

    # dumpadm -d swap

    Check with metastat -p and metadb and verify that all metadevices and metadbs are cleared from the

    mirror disk.

    Collect output of the following commands

    # cp -p /etc/vfstab /bto/csa/vfstab.beforeupgrade

    # cp -p /etc/system /bto/csa/system.beforeupgrade

    # metastat -p > /bto/csa/metastatp.beforeupgrade

    # metadb > /bto/csa/metadb.beforeupgrade

    # cp -p /etc/system /bto/csa/system.beforeupgrade

    # cp -p /etc/lvm/md.cf /bto/csa/md.cf.beforeupgrade

    # cp -p /etc/lvm/mddb.cf /bto/csa/mddb.cf.beforeupgrade

    # cp -p /etc/lvm/md.tab /bto/csa/md.tab.beforeupgrade

    # grep VERSION /var/sadm/pkg/SUNWmdr/pkginfo

    PKG_CLIENT_VERSION=9VERSION=11.9.0,REV=2002.04.06.15.27

    If the version is showing the same above, you should follow the steps, mentioned in the Step: 27 (Restoring

    metadevices configurations). Other versions will automatically converted metadbs access by Solaris 10.

    Clear metadevices

    # metastat -p

    # metaclearr d2 d12 d22 d32 d42 d52

    # metadb

    # metadb -d /dev/dsk/c1t0d0s7# metadb -d /dev/dsk/c1t1d0s7 (mroot disk)

    6. Install Solaris 10 Live upgrade packages

    Check the LU packages ( current version on system is 11.8)

    # pkginfo -l SUNWluu

    # pkginfo -l SUNWlur

    Remove old LU packages (version 11.8)

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    5/26

    # pkgrm SUNWluu

    # pkgrm SUNWlur

    Install new LU packages (version 11.10)

    # cd /bto/sys/csa

    # mkdir packages# chmod 755 packages

    # cd packages

    # ftp sundepot.bst.bls.com(90.152.52.80)

    ftp> cd packages

    ftp> binary

    ftp> mget SUNWlur.zip SUNWluu.zip

    ftp> bye

    # unzip SUNWlur.zip

    # unzip SUNWluu.zip

    # pkgadd -d . SUNWlur

    # pkgadd -d . SUNWluu

    # pkginfo -l SUNWlur

    # pkginfo -l SUNWluu

    Check Version 11.10 is installed.

    7. Install Live upgrade Patches

    Install the following patches (or higher) for the SUN packages (SUNWluu and SUNWlur) on the current

    OS. paClient may not be loaded on the server if this is a new server build. If not loaded, use

    patchadd to install patches.

    ***NOTE*** Do not apply rev 14 of patch 121430 (121430-14) -- instead, apply 121430-13.

    Check for Patches. The below example for Solaris 8# showrev -p | grep "Patch: 108987-15"

    # showrev -p |grep 108987 ( check if higher versions exists)

    # showrev -p | grep "Patch: 110934-21"

    # showrev -p |grep 110934 ( check if higher version exists)

    # showrev -p | grep "Patch: 121430-11"

    # showrev -p |grep 121430 ( check if higher version exists)

    ****NOTE***** Dont install 121430 latest patch after the revision 121430-13. It will give error on

    lu command in Solaris 8.

    Install required patches# /bto/sys/pa/bin/paClient -p 108987-15 110934-21 121430-11(Install patches in this order)

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    6/26

    # /bto/sys/pa/bin/paDownload.ksh

    #/bto/sys/pa/bin/paApply.ksh

    Check all application filesystems in /etc/vfstab are commented including /bto

    # cat /etc/vfstab

    If application filesystems or /bto is not commented out, comment it on /etc/vfstab

    8. Reboot the boxeven if patch is not installed and boot the box from main root disk.

    #init 0

    OK> boot

    # df -k(Ensure that you are booted from Root disk)

    9. Partition the Solaris 10 target Root disk depending on the specification.

    For the following use slice information presently allotted to each disk on each server

    #format (the following info is generic and may not be exactly like your disk layout, these at leastrepresent the minimums so adjust the slices to meet the following)

    Need to re-partion the new root disk (old broot) no need for globaldevices partition in sol 10

    / 30g s0

    /swap 4g s1

    /var 6g s3

    /opt 20g s4

    /bto 10g s5

    Current partitions-----

    partition> p

    Current partition table (original):

    Total disk cylinders available: 14087 + 2 (reserved cylinders)

    Part Tag Flag Cylinders Size Blocks

    0 root wm 0 - 8452 41.02GB (8453/0/0) 86017728

    1 swap wu 8453 - 8855 1.96GB (403/0/0) 4100928

    2 backup wu 0 - 14086 68.35GB (14087/0/0) 143349312

    3 var wm 8856 - 9458 2.93GB (603/0/0) 6136128

    4 unassigned wm 9459 - 11671 10.74GB (2213/0/0) 22519488

    5 home wm 11672 - 11731 298.12MB (60/0/0) 610560

    6 home wm 11732 - 13944 10.74GB (2213/0/0) 22519488

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    7/26

    7 unassigned wm 0 0 (0/0/0) 0

    10. Create file system on the Solaris 10 target disk

    # newfs /dev/rdsk/c1t1d0s0

    # newfs /dev/rdsk/c1t1d0s3

    #newfs /dev/rdsk/c1t1d0s4#newfs /dev/rdsk/c1t1d0s5

    11. Edit the LU Sync list

    # cd /etc/lu

    # cp -p synclist synclist.

    # ifconfig -a(Verify the valid network interfaces, and add the /etc/hostname. files in

    the synclist file)

    # ls -ld /etc/hostname.*

    # vi /etc/synclist

    /var/mail OVERWRITE

    /var/spool/mqueue OVERWRITE

    /var/spool/cron/crontabs OVERWRITE

    /var/dhcp OVERWRITE

    /etc/passwd OVERWRITE

    /etc/shadow OVERWRITE

    /etc/group OVERWRITE

    /etc/opasswd OVERWRITE

    /etc/oshadow OVERWRITE

    /etc/pwhist OVERWRITE

    /etc/default/passwd OVERWRITE

    /var/log/syslog APPEND/var/adm/messages APPEND

    /etc/ftpd/ftpusers OVERWRITE

    /etc/defaultrouter OVERWRITE

    /etc/inet/netmask OVERWRITE

    /etc/defaultdomain OVERWRITE

    /etc/default/init OVERWRITE

    /etc/resolv.conf OVERWRITE

    /etc/nodename OVERWRITE

    /etc/hosts OVERWRITE

    /etc/net/ticlts/hosts OVERWRITE

    /etc/net/ticots/hosts OVERWRITE

    /etc/net/ticotsord/hosts OVERWRITE

    /etc/hostname.hme0 OVERWRITE

    /etc/hostname.hme0:1 OVERWRITE

    /etc/hostname.qfe2 OVERWRITE

    /usr/openv/netbackup/bp.conf OVERWRITE

    12. Establish the new target boot environment

    (In this example, the boot disk is c1t1d0s0 and the target disk is c1t0d0s0)

    AT this point we can change the slice out of the disks as

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    8/26

    # lucreate -c c1t0d0 -n c1t1d0 -s - -m /:/dev/dsk/c1t1d0s0:ufsm /var:/dev/dsk/c1t1d0s3:ufs -

    m -:/dev/dsk/c1t1d0s1:swap

    Enter the following command to make sure the new environment installed properly

    # lustatus

    -- Boot Environment Is Active Active Can Copy

    -- Name Complete Now On Reboot Delete Status

    -- -------------------------- -------- ------ --------- ------ -------

    -

    -- c1t0d0 yes yes yes no -

    -- c1t1d0 no no no yes -

    13. Mount the jumpstart servers /export/install

    VARIOUS JUMPSTART SERVER THAT ARE PRESENT ARE GIVEN BELOW AS PER REGION.

    # mount 90.144.48.14:/export/install /mnt(Jackson Data center)

    # df -k(Ensure that /export/install from jumpstart is mounted)

    14. Execute the luupgradeThis will load the flash archive to the target boot environment.

    #ls -l /mnt/solaris/jump_servers/flars/gi_SunOS510_B01_09Q3.flar (Verify file exists)

    #luupgrade -n c1t1d0 -f -s /mnt/solaris/os/sparc/sol10_01.2006/boot_install -a

    /mnt/solaris/jump_servers/flars/gi_SunOS510_B01_09Q3.flar

    15. Execute luactivate

    Perform the luactivate against the target boot environment.

    This command also copy all files specified in the /etc/lu/synclist file

    # luactivate c1t1d0

    #lustatus

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    9/26

    16. Reboot the server

    Reboot using init or shutdown command against new boot environment.

    # init 6

    While booting UP from the new boot environment, if it go to maintenance mode then execute the

    following command.

    # svcadm clear system/boot-archive

    Mount old root disk to /mnt

    # mount /dev/dsk/c1t0d0s0 /mnt

    Update the ssh key

    # cp -p /mnt/.ssh/auth* /.ssh/

    17. Remove old Boot Enviornment

    Once the server is up, execute the ludelete command to remove reference to the inactive boot

    environment

    # df -k(Ensure that it is booting from New disk)

    # lustatus(Verify boot environment exists)

    # ludelete c1t0d0

    # rm /etc/lutab

    Remove unwanted directory (Optional)

    # cd /export/install

    # rm -r solaris(This command can take some time)

    Rename /var/svc/profile/name_service.xml /var/svc/profile/name_service.orig (Optional)

    # cd /var/svc/profile

    # mv name_service.xml name_service.orig

    Create a symbolic link for the name service profile.

    # ln -s ns_files.xml name_service.xml

    # ln -s ns_dns.xml name_service.xml

    # ln -s ns_nis.xml name_service.xml

    # ln -s ns_nis+.xml name_service.xml

    # ln -s ns_none.xml name_service.xml

    18. Comparing the files

    Check the following files and the files mentioned in the /etc/lu/synclist and edit as needed.

    /etc/netmasks/etc/resolv.conf (usually not on the server)

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    10/26

    /etc/inet/hosts

    /etc/hosts

    /etc/net/ticlts/hosts

    /etc/net/ticots/hosts

    /etc/net/ticotsord/hosts

    /etc/nodename/etc/hostname.xxx (3 interface cards)

    # wc /etc/hosts /mnt/etc/hosts

    129 525 4378 /etc/hosts

    129 525 4378 /mnt/etc/hosts

    258 1050 8756 total

    EDIT /etc/net/*/hosts files with appropriate hostname of the server

    Compare /etc/passwd and /etc/shadow files.

    If word count is different for /etc/passwd and /etc/shadow, then mount the original root disk

    and copy the /etc/shadow file over and execute pwconv to sync the two files.

    # wc -l /etc/passwd

    # wc -l /etc/shadow

    # cp -p /mnt/etc/shadow /etc/shadow

    # pwconv(to sync shadow and passwd files)

    Check Network Speed Setting

    # cd /mnt/etc/rc2.d# ls -l|egrep "ndd|net|tune|shmenic"(Ensure the script is used for network speed setting)

    # cp -p /mnt/etc/rc2.d/ /etc/rc2.d/ (for ex: S96net_tune)

    19. Copy Home Directory

    # ls -l /home

    # ls -l /mnt/home

    # ls -l /export/home (Dont copy if /export/home is a separate mount point)

    # ls -l /mnt/export/home

    Verify that which directory has data and retain the only correct data

    Some servers have home directories pointing to /export/home and after upgrade; the data retains in

    /home. So we need to clean /home directory and restore /export/home from the old root disk.

    # cd /home

    # rm -r *

    Verify with /etc/passwd file to use the correct home directory

    Run one of the below - based on which has data /mnt/home or /mnt/export/home

    #cd /mnt/export/home

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    11/26

    # chmod 755 /export/home

    # find . -xdev -depth | cpio -pdumv /export/home

    If the data is on /mnt/home

    # cd /mnt/home

    # chmod 755 /home# find . -xdev -depth | cpio -pdumv /home

    20. Copy TNG Table

    # mkdir -p /bto/sys/tng/catmp

    # chmod 755 /bto/sys/tng/catmp

    # cp -p /mnt/bto/sys/tng/catmp/TNG_tier1_client_config_table /bto/sys/tng/catmp/

    21. FORMAT issue

    If the command format shows some error messages at the top referring to MD21, then do the following

    to fix it.

    # cd /etc

    # cp -p format.dat format.dat.

    # vi format.dat (Comment all entries with MD21 and save the file)

    22. Correct the Root shell

    # grep root /etc/passwd(Verify the shell has the value /bin/ksh, otherwise correct it)

    23. Fix Profile

    #cd /

    # vi .profile (Ensure PATH=$PATH:....(Remove the $PATH at the end and put it in the beginning)

    # exit(exit and login again)

    24. Fix LOCALE

    Fix for message local not set correctly. Do the following to fix it, if you are getting this error while

    logging.

    # cp -p /etc/default/init /etc/default/init.orig

    # vi /etc/default/init(Remove all LC entries)

    25. Fix NAS

    Check the NAS is working

    # ls -l /nas/common

    #df -k (Ensure nas/common mounted)

    If NAS is not working, check the /etc/resolv.conf file and verify there are any unnecessary spaces before any

    line start. Remove the spaces and save. Check again NAS

    # vi /etc/resolv.conf(Remove any spaces on the starting of any line)

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    12/26

    26. Compare CSA Cron

    # df -k(Ensure old root is mounted on /mnt, if not mount it)

    Compare the entries in /mnt/bto/sys/platform/root_cron/csa_cron and

    /bto/sys/platform/root_cron/csa_cron

    Add the missing entries and leave it commented (Jobs like reboot/broot update should be left

    commented)

    Also copy any required cron scripts listed in csa_cron from the old root disk

    Make a copy of the /etc/system file

    # cp -p /etc/system /etc/system.aftersol10upgrade

    Compare /etc/system fie with old /etc/system file and update the kernel parameter (Higher in value)

    #diff /mnt/etc/system /etc/system

    Remove the unwanted kernel parameter as needed.

    Remove Oracle setting kernel commented values - If oracle is not in your box.

    For Example following are the kernel parameters may required for the application for reference

    set enable_sm_wa=1

    set msgsys:msginfo_msgmap=2048

    set msgsys:msginfo_msgtql=8192

    set msgsys:msginfo_msgmax=65536

    set msgsys:msginfo_msgseg=8192

    set msgsys:msginfo_msgssz=256

    set msgsys:msginfo_msgmnb=65535

    set semsys:seminfo_semaem=32767

    set semsys:seminfo_semmap=5434

    set semsys:seminfo_semvmx=32767

    set semsys:seminfo_semopm=100

    set shmsys:shminfo_shmmni=16384set semsys:seminfo_semmns=16624

    set msgsys:msginfo_msgmni=8192

    set shmsys:shminfo_shmseg=2048

    set shmsys:shminfo_shmmin=1

    set semsys:seminfo_semmni=5459

    set semsys:seminfo_semmnu=4096

    set semsys:seminfo_semmsl=2000

    set semsys:seminfo_semume=512

    set semsys:seminfo_semusz=1024

    forceload: sys/msgsys

    forceload: sys/shmsys

    forceload: sys/semsys

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    13/26

    set rstchown=0

    set shmsys:shminfo_shmmax=4294967295

    set rlim_fd_cur=2048

    set rlim_fd_max=4096

    set tmpfs:tmpfs_minfree=6400

    set pg_contig_disable=1

    Note :- Source SUN Doc - 817-0547

    Obsolete parameters might be included in the /etc/systemfile on this Solaris system. If so, theparameters are used to initialize the default resource control values as in previous Solaris releases.

    However, using the obsolete parameters is not recommended.

    The following related parameters have been removed. If these parameters are included in the

    /etc/systemfile on this Solaris system, the parameters are commented out.

    semsys:seminfo_semmns

    semsys:seminfo_semvmx

    semsys:seminfo_semmnu

    semsys:seminfo_semaem

    semsys:seminfo_semume

    semsys:seminfo_semusz

    semsys:seminfo_semmap

    shmsys:shminfo_shmseg

    shmsys:shminfo_shmmin

    msgsys:msginfo_msgmap

    msgsys:msginfo_msgseg

    msgsys:msginfo_msgssz

    msgsys:msginfo_msgmax

    27. Perform post-install tasks

    # cd /opt/gi/gi_SunOS510_B01_09Q3/bin

    Execute post-install script to perform post-install configuration of DDS software along with other

    functions specific to the release. Messages will display as software is processed.

    # ./gi_refresh.ksh ../media

    Execute the script to validate the gold image content have been installed correctly.

    # ./gi_validate.ksh

    28. Restoring metadevices configurations

    cat /mnt/bto/sys/csa/metadb.beforeupgrade (the following is an example use actual server info)

    flags first blk block count

    a m p luo 16 1034 /dev/dsk/c1t1d0s7

    a p luo 1050 1034 /dev/dsk/c1t1d0s7a p luo 16 1034 /dev/dsk/c1t1d0s7

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    14/26

    a p luo 1050 1034 /dev/dsk/c1t1d0s7

    29. Clean Reboot

    # cp -p /mnt/.ssh/auth* /.ssh/

    # umount /mnt

    # init 6

    # metadb

    # metastat -p

    30. Install Storage Foundation 5.0 MP3 (Veritas Volume Manager)

    Identify your hardware model and get the licence from license document from the SharePoint to match your

    hardware.

    # /usr/platform/`uname -i`/sbin/prtdiag -v |head -1

    Check the document to match the hardware from above command.0

    # df -k /opt(Ensure /opt is not a separate file system, if it is a separate then Dont Proceed)

    # cp -p /etc/passwd /etc/passwd.03202012vxvm

    # cp -p /etc/shadow /etc/shadow.03202012vxvm

    # wc -l /etc/passwd /etc/shadow (Ensure the count matches)

    Add the following entry at the end of the file /etc/passwd

    # vi /etc/passwd

    install:x:0:1:installpatch braindamage:/:/bin/true

    :wq!

    # pwconv

    # wc -l /etc/passwd /etc/shadow(Ensue the count matches)

    Check if NAS is configured on the box, if yes we can install from the NAS location

    # cd /nas/common/veritas/SUN/SF5.0_MP3

    # ./installer -precheck

    (This will check the installer can able to install the Storage foundation on the box. Select Option 5 for install

    storage foundation and look for the messages. The script will print the output SF can be installed on this box

    if everything is okay.

    Install Storage Foundation

    # ./installer

    Select : Install/Upgrade a Product (Option I)

    Select : Veritas Storage Foundation (Option 5)I

    Enter System name : Provide hostname of the box

    Enter License Key : Provide License key for SUN E4500/E5500

    VRTS STORAGE FOUNDATION STANDARD 5.0

    SOL TIER B STD LIC

    License Key(s):

    3JZG-ZNBY-Z3KB-M3P4-KRHA-PPZP-P

    Configure SF : Select No

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    15/26

    Check the version after installation(it should show the version 5.0MP3)

    # modinfo |grep -i vx

    # pkginfo -l VRTSvxvm

    # pkginfo -l VRTSvxfs

    Reboot the box# init 6

    Start Veritas Volume manager manually

    # rm /etc/vx/reconfig.d/state.d/install-db

    # vxiod set 10

    # vxconfigd -k -m disable

    # vxdctl enable

    # vxdctl init `uname -n`

    #vxdctl enable

    Uncomment Veritas filesystems from the /etc/vfstab

    # cp /etc/vfstab /etc/vfstab.VxVM.commented

    # cp /etc/vfstab /etc/vfstab.modify

    # vi /etc/vfstab.modify

    # cp /etc/vfstab.modify /etc/vfstab

    Check all the veritas mount points exists, if not create using mkdir command. Compare the

    permission and ownership with previous OS (mount the old root disk if needed)

    Start all the veritas volumes manually

    # vxdg list

    # vxvol -g startall# vxprint -th |grep ^v (Check all volumes are ENABLE state)

    Mount the veritas file systems with mount command.

    # mountall

    # df -h(Check and confirm all file systems mounted)

    Clean reboot

    # init 6

    # df -k(Ensure all file systems mounted including veritas file systems)

    Again comment all veritas file systems in /etc/vfstab and take a reboot.

    # vi /etc/vfstab # cp /etc/vfstab.VxVM.commented /etc/vfstab

    grep vx /etc/vfstab

    # init 6

    # df -k(Ensure no veritas file systems mounted)

    31. Veritas 5.0 MP3 Rolling Patch 2 Installation

    Stop all veritas volumes on each diskgroup

    # vxdg list

    # vxvol -g stopall

    # vxprint -ht |grep ^v(Should be show all volumes on DISABLE & CLEAN state

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    16/26

    # vxprint -Aht -e v_open(verify no volumes are remain open)

    # /opt/VRTS/bin/vxsvcctrl status(Check the VEA service running)

    # /opt/VRTS/bin/vxsvcctrl stop(If VEA service running, Stop the service using this command)

    Download the RP2 patches from NAS# cd /nas/common/veritas/SUN/SF5.0_MP3/RP2

    # cp -p 5.0MP3RP2-patches.tar.gz /bto/csa/

    # cd /bto/csa

    # gunzip 5.0MP3RP2-patches.tar.gz

    # tar xf 5.0MP3RP2-patches.tar

    Keep in mindBelow two will not be installing as per OS version

    123200-05 - Sun 5.8

    123202-05 - Sun 5.10

    123201-05 - Sun 5.9 (Must be Installed)

    The following are the lists of patches need to be installed. Use the following order to install. Patches marked in

    REDcolour is VCS patches and we can ignore if VCS is not installed on the box.

    122058-12 --

    123090-03

    123202-05

    123722-02

    123823-05

    139354-01

    139358-02139359-02

    139737-01

    139739-01

    139742-02

    139741-02

    139743-01

    139744-01

    139754-02

    140657-01

    140661-01

    141279-01

    141745-01

    Apply RP2 Patches

    # patchadd /bto/csa/patches/volume_manager/patches/140657-01

    # cd /bto/csa/patches/storage_foundation/patches

    # vi patch_RP2

    122058-12

    123202-05

    123722-02123823-05

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    17/26

    139354-01

    139737-01

    139739-01

    139742-02

    139741-02

    139743-01139744-01

    140661-01

    141279-01

    141745-01

    wq!

    # for i in `cat /bto/csa/patches/storage_foundation/patches/patch_RP2

    > do

    > patchadd $i

    > echo Patch $i Done

    > done

    # modinfo |grep -i vx( Should be showing 5.0MP3 RP2)

    Make sure all patches installed

    # showrev -p | grep

    Uncomment all fileystem of vxvm:

    # vi /etc/vfstab

    # cp /etc/vfstab.modify /etc/vfstab

    # grep vx /etc/vfstab

    # init 6

    # df -k(Ensure all filesytems mounted properly)

    Check the version is showing 5.0MP3 RP2

    # modinfo |grep -i vx

    # pkginfo -l VRTSvxvm

    # pkginfo -l VRTSvxfs

    Remove install entry from /etc/passwd

    # vi /etc/passwd

    #pwconv

    # wc -l /etc/passwd /etc/shadow(Confirm the count matches)

    Clean Reboot

    # init 6

    VERITAS Cluster ServerINSTALL 5.0MP3

    1. Download installation files for VCS 5.0 MP3 and also Agent Pack (This pack may be required to update the

    agents like Oracle, NetListner.)

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    18/26

    # cd /var/tmp/

    ftp 90.152.52.80

    ftp> bin

    ftp> cd veritas/VCS5_SF5/solaris

    ftp> get 5.0MP3-sparc.tar.gz

    ftp> get AgentPack-1Q2008-2008-03-19b.cd1.tar.gz

    # gunzip 5.0MP3-sparc.tar.gz

    # tar -xvf 5.0MP3-sparc.tar

    # cd dvd1-sol_sparc/cluster_server

    #. /installvcs

    # pkginfo -l VRTSvcs

    Cluster configuration can be completed when both servers have been upgraded.

    After VCS installation we have to install RP2 pkgs for VCS also (which are 139358-02 and 139359-02)

    After installing RP2 please check that #pkginfol VRTSvcs; pkginfol VRTScsocw ; pkginfol VRTSvcsor all

    must show MP3RP2.

    And install latest oracle agent pkgs (if oracle is there) from NAS server below path:

    /nas/common/veritas/SUN/old_versions/SF5.0_MP3/cluster_server_agents/oracle_agent/patches/123670-

    03.tar.gz

    And also install WebSphereMQ6 agent (VRTSmq6) if it is there. (Copy this pkg from crxdbr01/02:/var/tmp or

    /export/home/sg748j and install.)

    And take the backup of current config files and restore the old config files from old disk.

    #mkdirp /var/tmp/vcs_bkp

    #cp -p /etc/VRTSvcs/conf/config/*.cf /var/tmp/vcs_bkp

    #cp -p /etc/llttab /var/tmp/vcs_bkp/llttab.bkp

    #cp -p /etc/llthosts /var/tmp/vcs_bkp/llthosts.bkp

    #/sbin/gabconfig -a > /var/tmp/vcs_bkp/gabconfig.out

    #cp -p /etc/gabtab /var/tmp/vcs_bkp/gabtab.bkp

    And mount the old disk and restore the files from sol8 disk:

    #cp /mnt/etc/VRTSvcs/conf/config/main.cf /etc/VRTSvcs/conf/config/main.cf

    #cp /mnt/etc/llthosts /etc/llthosts

    #cp /mnt/etc/gabtab /etc/gabtab

    #cd /etc/VRTSagents/ha/conf/Oracle

    #cp -p OracleTypes.cf /etc/VRTSvcs/conf/config/OracleTypes.cf

    #cpp /etc/VRTSagents/ha/conf/WebSphereMQ6 /etc/VRTSvcs/conf/config/

    1. Reboot system

    # shutdown -i6 -g0y

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    19/26

    32. Configure Netbackup Client

    # /bto/sys/ebr/post_dds_config

    The script will ask for the following inputs, provide the proper value of your server.

    Some applications require special configurations.Please select one of the following categories (the full name

    or first character of the name is acceptible):

    (B)SLD

    (O)PEDS Remote - NOT Corporate OPEDS (For corporate choose N)

    (U)NE-319

    (Q)UANTUM

    (N)ONE OF THE ABOVE (includes AIC, BRIC, CRIC, and BBT)

    N for NONE

    What is the regname of the server you are currently on?(Unless server is for BSLD or OPEDS, regname must start with:

    br, cr, jr, ai, bi, or ci)

    bixfr01g

    bixfr02g

    What is the IP-address you will use for backups on bixfr01g?

    N/A

    This server appears to have been a client previously.

    Are you moving this client to the new BBT infrastructure in EBR?

    (answer: y or n) NO

    Contact EBR Team to check if they can connect to the server from their netbackup software. If yes, ask them

    for a test backup for checking the connectivity speed.

    33. Restore /bto ( it is a separate mount point)

    Ask EBR team to restore the /bto file system withoutoverwrite option against the AOTS task.

    30.a) Please restore below file before the sendmail push (Need to add ATTsend mail)

    /etc/mail/aliases

    /etc/mail/sendmail.cw/etc/mail/local-host-names

    /etc/mail/virtusertable

    /etc/mail/virtuser-domains

    34. DDS Push (Please request Tim Ryan PSA perform DDS pkg push)

    There should be 2 tasks in the CR for DDS team

    1. DDS Package verify with Model server

    2. Post Upgrade DDS push

    verify history is completed before install packages. 1-205-444-2985.This is a production server, so the ddspackages will need to be installed by DDS Operations. /bto is on a separate mount point, so no need to

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    20/26

    contact app support for any dds packages installation tasks.

    MODEL SERVER IP: 90.38.34.119 (for Sun)

    This is a request to use the DDS Verify Tool to update the DDS History. Please use the List, Verify, and

    Update functions, in order to update the DDS History of each Target Server above.

    Post Upgrade DDS Push

    Find the DDS packages currently installed on the server.

    #/bto/sys/csa/bin/dds

    It will list the current packages available on server. Compare the list with the SCIM data and sort out the

    packages need to be installed. We can ignore eranet, ebrpatch and ugc packages as it is not available in theDDS hub.

    Do the pre work for the DDS packages need to be installed. Pre-work for some common packages are following

    below.

    sendmail_00083

    # grep /etc/hosts

    Check and confirm the FQDN is present on the /etc/hosts, if not add the FQDN name otherwise sendmail

    installation will fail. Use the following two commands to find the FQDN from DNS.

    # nslookup

    # nslookup

    # vi /etc/hosts (Add the FQDN)

    etac_00168 is no longer used, instead we are pushing etacpltn* see attachment on CR

    Download the ETAC precheck utility script and run the script. It will show the prework status, do the changes if

    needed.

    #cd /var/tmp

    #ftp 90.38.34.128

    username: anonymous Password: attid (ex: np0974)

    ftp>binary

    ftp>hash

    ftp>cd /pub/Security

    ftp> get pre_cksvr.SunOS.tar

    ftp>bye

    #tarxvf pre_cksvr.SunOS.tar

    #./pre_cksvr

    Check the script is successful and ETAC is ready to install

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    21/26

    WE CAN ASK DDS TEAM TO START THEIR ACTIVITY ON CRXDB-1P AND CRXDB-2P,ONCE PRE-WORK

    DONE.

    Patrol software:

    Check the following entry should be present in /etc/passwd file. if not, add it

    patrol:x:50020:50020:techadm1.bis.bls.com:/bto/sys/bmc/patrol:/bin/ksh

    Check the following entry should be present in /etc/group file. if not, add it

    patrol::50020:

    Check the following entry should be present in /etc/ftpd/ftpusers file. if not, add it

    Patrol

    Change patrol home directory from /bto/sys/bcm/patrol to /usr/localcw/opt/patrol.

    Make sure the /bto/sys/bmc/patrol/B4OUT file and /bto/sys/bmc/patrol/pasa_prod_bkup directory exist. If

    they dont there, they will need to be copied from the old root disk.

    Run /nas/common/patrol/saptrol/cb/cb_after.sh (this script will install in the new location (preserving the

    old data) and start patrol)

    35. Create Dump Device

    # swap -l(Check swap is loaded from metadevice)

    # dumpadm

    (Check the dumpdevice is pointed to the metadevice, and Ensure the Save core directory is pointed to proper

    directory, if not do the following)

    # dumpadm -d swap

    # mkdir -p /bto/sys/crash/`hostname`

    # dumpadm -s /bto/sys/crash/`hostname`

    36. Create devalias for new booting devices

    # cd /bto/sys/csa

    # eeprom nvramrc > oldalias.bak

    # vi aliaslist(add the required alias names started with devalias aliasname and physical path)

    devalias root /pci@1f,700000/scsi@2/disk@0,0:a

    devalias mroot /pci@1f,700000/scsi@2/disk@1,0:a

    devalias altboot /pci@1f,700000/scsi@2/disk@2,0:a

    :wq!

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    22/26

    # eeprom nvramrc="`cat aliaslist`"

    # eeprom nvramrc (Ensure all alias names updated)

    # eeprom boot-device="root mirror"

    37. Setting permission as per the application requirement

    # chmod 755 /usr/local

    # chmod 755 /usr/local/bin

    38. Install ATT SUDO utility TOP(3.7),LSOF(4.82) (Required)

    # cd /nas/usr/sbc/sudo/pkg

    # ls -l ATTsudo-sparc.pkg

    # pkginfo -x |grep -i sudo(Ensure no SUDO packages installed)

    # ls -l /usr/local/bin/sudo(Ensure no sudo binary files exists)

    # pkgadd -d ATTsudo-sparc.pkg

    # mount /dev/dsk/c1t1d0s0 /mnt# cp -p /mnt/etc/sudoers /usr/localcw/opt/sudo/sudoers.d/SMCsudoers

    #cp -p /mnt/usr/localcw/opt/sudo/sudoers.d/CBSsudoers /usr/localcw/opt/sudo/sudoers.d/CBSsudoers

    # vi /usr/localcw/opt/sudo/sudoers.d/emocse

    #EMOC-SE

    %emocse ALL=/usr/local/bin/rootsh,/usr/localcw/bin/eksh

    %emoct2 ALL=/usr/localcw/bin/eksh,/usr/local/bin/rootsh

    # vi /usr/localcw/opt/sudo/sudoers.d/sysadmin

    # System administrators%sysadmin ALL=(ALL) ALL

    # chmod 440 /usr/localcw/opt/sudo/sudoers.d/emocse

    # chmod 440 /usr/localcw/opt/sudo/sudoers.d/sysadmin

    # chown root:root /usr/localcw/opt/sudo/sudoers.d/emocse

    # chown root:root /usr/localcw/opt/sudo/sudoers.d/sysadmin

    Edit PATH statement in /etc/profile to add /usr/localcw/bin

    # vi /etc/profile

    PATH=$PATH:/usr/localcw/binexport PATH

    # /etc/local/profile

    # ln -f -s /usr/localcw/bin/sudo /usr/local/bin/sudo

    Test SUDO functionality

    Login with your ATTID

    # sudo -i

    If it comes up with password prompt, it means sudo is working fine

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    23/26

    If it gives some syntax error in one of SMCsudoers or SBCsudoers, it means there is an error in those

    files and most likely, that file is not in use on the server.

    Install top software

    Login to saxon (89.30.203.23) ; sudo to root

    #scp /export/home/blgbngz/top-3.6.sol10-sparc-local.gz NEWSERVER:/tmp

    Login into upgraded server:

    #cd /tmp

    >tmp#gunzip top-3.6-sol10-sparc-local.gz

    >tmp#pkgadd -d /tmp/top-3.6-sol10-sparc-local

    The following packages are available:1 SMCtop top

    (sparc) 3.6

    The following packages are available:

    Select package(s) you wish to process (or 'all' to process

    all packages). (default: all) [?,??,q]: all

    Processing package instance from

    top( sparc) 3.6

    This appears to be an attempt to install the same architecture andversion of a package which is already installed. This installation

    will attempt to overwrite this package.

    LeFebvre et al

    Using as the package base directory.

    ## Processing package information.

    ## Processing system information

    17 package pathnames are already properly installed.

    ## Verifying disk space requirements.

    ## Checking for conflicts with packages already installed

    ## Checking for setuid/setgid programs.

    Installing top as

    ## Installing part 1 of 1.

    [verifying class ]

    Installation of was successful.

    tmp>pkginfo -l SMCtop

    PKGINST: SMCtop

    NAME: top

    CATEGORY: application

    ARCH: sparcVERSION: 3.6

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    24/26

    BASEDIR: /usr/local

    VENDOR: LeFebvre et al

    PSTAMP: Steve Christensen

    INSTDATE: Dec 11 2006 17:58

    EMAIL: [email protected]

    STATUS: completely installed

    FILES: 17 installed pathnames7 directories

    3 executables

    558 blocks used (approx)

    For installation of lsof software:

    See note below. You would probably want the highlighted one. cat /etc/release and if you

    are at update 3 or less then use the one right above it (u3). Use pkgadd d

    /nas/usr/sbc/lsof/ATTlsof-4.82-sol10u4-sparc.pkg (for example) to install it.

    ====================================================================

    All,

    Chuck Floyd has graciously and quickly recompiled the new lsof packages and I have put on

    our nas. The location is under the respective OS release at /nas/usr/sbc/lsof. See below.

    Please test these out and let me or Chuck know if this works for you.

    Thank You

    /nas/usr/sbc/lsof/ATTlsof-4.82-sol10u3-sparc.pkg

    /nas/usr/sbc/lsof/ATTlsof-4.82-sol10u4-sparc.pkg

    /nas/usr/sbc/lsof/ATTlsof-4.82-sol8-sparc.pkg

    /nas/usr/sbc/lsof/ATTlsof-4.82-sol9-sparc.pkg

    39. Need to install ATTSssh:

    Ref. linkhttp://wiki.web.att.com/display/USH/ATTssh

    Disable ssh and then remove below pkgs before installing ATTssh.

    SUNWsshcu, SUNWsshdr, SUNWsshdu, SUNWsshr, SUNWsshu

    Then Install ATTssh : 5.8p2,REV=1 from NAS server:

    # cd /nas/usr/sbc/pkgs

    #pkgadd -d ATTssh-5.10-sparc-64.pkg

    mailto:[email protected]://wiki.web.att.com/display/USH/ATTsshhttp://wiki.web.att.com/display/USH/ATTsshhttp://wiki.web.att.com/display/USH/ATTsshhttp://wiki.web.att.com/display/USH/ATTsshmailto:[email protected]
  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    25/26

    40. Need restore below directories with NO Overwrite optionies: as per apps request. (copy using cpio

    from Solaris 9 image is probably easier than EBR.)

    /opt/java

    /opt/mqm

    /opt/data (copy must preserve symbolic linksthis is required only when /opt/data is not a mount

    point)

    /var/app/

    /var/opt

    /usr/dmexpress and /usr/syncsort(copy must preserve symbolic links.)

    /var/spool/cron/crontabs

    41. Create One-way Root mirroring (Primary submirror only DO NOT ATTACH SECONDARY)

    Configure Primary Root disk One-way mirroring using Solaris Volume Manager

    # metadb -f -ac3 /dev/dsk/c1t1d0s7#metadba-c3 /dev/dsk/c1t0d0s7

    #metainitf d2 1 1 /dev/dsk/c1t1d0s0

    # metainit -f d12 1 1 /dev/dsk/c1t1d0s1

    # metainit -f d22 1 1 /dev/dsk/c1t1d0s3

    # metainit -f d32 1 1 /dev/dsk/c1t1d0s4

    #metainitf d42 1 1 /dev/dsk/c1t1d0s5

    #metainit d0m d2

    # metainit d10 -m d12

    # metainit d20 -m d22

    #metainit d30m d32

    #metainit d40m d42

    #metainit d50m d52

    # cp -p /etc/vfstab /etc/vfstab.noSVM.date

    # metaroot d0

    # vi /etc/vfstab (change the swap and /var slices to corresponding metadevices entry)

    # sync; init 6

    # df -h(Ensure that root and var mounted from metadevices)

    42. Perform CSA Sanity test

    43. Uncomment Cron entries

    # vi /bto/sys/platform/root_cron/csa_cron - (Uncomment the following entries, not Broot entry)

    Reboot cron entry

    SCIM cron entry

    # /bto/sys/platform/ bin/ merge_crons

  • 8/10/2019 Bixfr01g and Bixfr02g Sol 10 Implementation Plan

    26/26

    44. Enable Netcool Monitoring

    45. Verify MIR report

    46. Notify Application team that Upgrade completeOnce we got confirmation from the application team; we will proceed with the secondary mirror attachment.