Oracle ORAchk - An Overview Guide to Oracle Stack Health Checks

88
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Oracle ORAchk Oracle Stack Health Checks Version 12.2.0.1.2

Transcript of Oracle ORAchk - An Overview Guide to Oracle Stack Health Checks

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle ORAchk Oracle Stack Health Checks Version 122012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The following is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

2

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

3

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

4

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

ndashAutomated risk identification and proactive notification before business is impacted

ndashHealth Checks based on most impactful reoccurring problems across Oracle customer base

ndashRuns in your environment ndash no need to send anything to Oracle

ndashScheduled email Health Check reports

ndashFindings can be integrated into other tools of choice

Why Oracle ORAchk

Engineered Systems

Non Engineered Systems

Oracle EXAchk

Oracle ORAchk

Common Framework

Lightweight amp non intrusive Oracle Stack Health Checks

5

Note Oracle Database Appliance is the only Oracle Engineered System which uses ORAchk For all other Engineered Systems use EXAchk

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The following is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

2

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

3

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

4

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

ndashAutomated risk identification and proactive notification before business is impacted

ndashHealth Checks based on most impactful reoccurring problems across Oracle customer base

ndashRuns in your environment ndash no need to send anything to Oracle

ndashScheduled email Health Check reports

ndashFindings can be integrated into other tools of choice

Why Oracle ORAchk

Engineered Systems

Non Engineered Systems

Oracle EXAchk

Oracle ORAchk

Common Framework

Lightweight amp non intrusive Oracle Stack Health Checks

5

Note Oracle Database Appliance is the only Oracle Engineered System which uses ORAchk For all other Engineered Systems use EXAchk

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

3

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

4

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

ndashAutomated risk identification and proactive notification before business is impacted

ndashHealth Checks based on most impactful reoccurring problems across Oracle customer base

ndashRuns in your environment ndash no need to send anything to Oracle

ndashScheduled email Health Check reports

ndashFindings can be integrated into other tools of choice

Why Oracle ORAchk

Engineered Systems

Non Engineered Systems

Oracle EXAchk

Oracle ORAchk

Common Framework

Lightweight amp non intrusive Oracle Stack Health Checks

5

Note Oracle Database Appliance is the only Oracle Engineered System which uses ORAchk For all other Engineered Systems use EXAchk

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

4

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

ndashAutomated risk identification and proactive notification before business is impacted

ndashHealth Checks based on most impactful reoccurring problems across Oracle customer base

ndashRuns in your environment ndash no need to send anything to Oracle

ndashScheduled email Health Check reports

ndashFindings can be integrated into other tools of choice

Why Oracle ORAchk

Engineered Systems

Non Engineered Systems

Oracle EXAchk

Oracle ORAchk

Common Framework

Lightweight amp non intrusive Oracle Stack Health Checks

5

Note Oracle Database Appliance is the only Oracle Engineered System which uses ORAchk For all other Engineered Systems use EXAchk

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

ndashAutomated risk identification and proactive notification before business is impacted

ndashHealth Checks based on most impactful reoccurring problems across Oracle customer base

ndashRuns in your environment ndash no need to send anything to Oracle

ndashScheduled email Health Check reports

ndashFindings can be integrated into other tools of choice

Why Oracle ORAchk

Engineered Systems

Non Engineered Systems

Oracle EXAchk

Oracle ORAchk

Common Framework

Lightweight amp non intrusive Oracle Stack Health Checks

5

Note Oracle Database Appliance is the only Oracle Engineered System which uses ORAchk For all other Engineered Systems use EXAchk

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Stack Coverage bull Oracle Engineered Systems

bull Oracle Database Appliance

bull Oracle ASR

bull Oracle Systems

bull Oracle Solaris

bull Cross stack checks

bull Solaris Cluster

bull OVN

bull Oracle Database

bull Standalone Database

bull Grid Infrastructure amp RAC

bull Maximum Availability Architecture (MAA) Scorecard

bull Upgrade Readiness Validation

bull Golden Gate

bull Oracle Restart

bull Oracle Enterprise Manager Cloud Control

bull Repository

bull Agent

bull OMS

bull Oracle Middleware

bull Application Continuity

bull Oracle Identify and Access Management Suite (Oracle IAM)

bull Oracle E-Business Suite

bull Oracle Payables

bull Oracle Workflow

bull Oracle Purchasing

bull Oracle Order Management

bull Oracle Process Manufacturing

bull Oracle Receivables

bull Oracle Fixed Assets

bull Oracle HCM

bull Oracle CRM

bull Oracle Project Billing

bull Oracle Siebel

bull Database best practices

bull Oracle PeopleSoft

bull Database best practices

bull Oracle SAP

bull EXAdata best practices

6

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

7

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Recommended Usage ndash Automated Risk Notification

1) Schedule ORAchk to run in daemon mode weekly or daily and email report

2) Identify actions easily by viewing automated comparison of previous runs

3) Act on recommendations

8

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Schedule ORAchk

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

example orachk -set AUTORUN_SCHEDULE=820 25 will schedule runs on Tuesday and Friday at 0800 amp 2000

AUTORUN_SCHEDULE =

9 9

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull First email will contain the HTML report

Email Notification

10

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Health score

bull Summary of ORAchk run

bull Table of content

bull Controls for report features

bull Findings

bull Recommendations

11

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Report

bull Table of content

bull Controls for report features bull Checks which passed are not shown by default

bull Quickly show or hide checks based on their status

bull Show or hide major sections of the report

bull Collapse or expand check findings

bull Show check Ids

bull Remove the findings from the report ndash This doesnrsquot change the report but optionally hides findings on a check by check basis

bull Display a printable view

12

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View ORAchk Findings

bull Check status

bull Type of Check

bull Check Message

bull Where the check was run

bull Link to expand details

13

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull What to do to solve the problem

bull Links to relevant Knowledge docs

bull Where recommendation applies

bull Where problem doesnrsquot apply

bull Example of data the recommendation is based on

View Recommendations

14

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Subsequent emails compare results to previous run

bull Easily see if something has changed

bull Email attachment has

o Latest report

o Previous report

o Diff Report

Email Notification

15

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Diff overview

bull Summary of this run vs previous

Diff Output

16

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Differences between each run

Diff Output

17

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Upgrade or Patching

o Detects all databases registered in the clusterware automatically

o Presents list of databases to check

o Pre Upgrade Run during upgrade planning phase

Asks which version you plan to upgrade to

o Post Upgrade Run after upgrade

bull Other typical times to run ORAchk

o Machine moves

o Hardware failure repair

o Problem troubleshooting

o In addition to go-live testing

Other Recommended Usage

orachk -u ndasho pre

orachk -u ndasho post

18

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

19

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Report Demo

20

Example ORAchk HTML Report

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

21

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Supported Environments

22

Operating System Versions Supported

Linux zLinux Oracle LinuxRedHat 4 5 6 7 SuSE 910 11 12

Oracle Solaris SPARC x86-64 9 10 11

AIX 52 53 61 71 72

HPUX Itanium PA-RISC 1123 1131

Microsoft Windows (with cygwin) 2008 2012

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Included in Database and Grid infrastructure install

2 Download latest version from My Oracle Support (install lt 1 min)

3 Auto update when later version available

Roll Out amp Maintain

23

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 Download the orachkzip to your local machine from MOS Note 12689272

2 Transfer to a directory on the target System

3 Unzip orackzip

o As owner of oracle database or grid home

Installation

24

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Run as root (recommended)

o ORAchk will su to lower privileged owners of RDBMS or grid homes

bull Run as RDBMS or GRID Home Owner

o User must be able to switch to root for root level checks ndash several options

1 Provide the root userid password at prompts

or

2 Set up sudo

or

3 Pre-configure passwordless SSH connectivity

Which User to Run ORAchk as

25

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Option 1 With internet connection

o When ORAchk is older than 120 days it will prompt you to let it automatically download newer version from My Oracle Support

o Can also be specifically triggered with

Option 2 No internet connection

a) Download the latest orachkzip to a shared network staging location

b) Set environment variable RAT_UPGRADE_LOC

c) Next time orachk is started it will prompt to allow it to upgrade itself

Maintaining ORAchk

orachk -download

export RAT_UPGRADE_LOC=ltstaging dirgt

26

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Maintaining ORAchk

bull Option 3 Applied with PSU

o Each database PSU contains the latest ORAchk version available at time of creation

oWhen a database PSU is applied the ORAchk zip version contained will be staged in $ORACLE_HOMEsuptools

o The next run of ORAchk it will prompt you to upgrade if the version copied by the PSU is newer than installed ndash Just like option 2

27

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Automated Usage with the Daemon

28

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options When What amp Who to Tell

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

AUTORUN_SCHEDULE

bull Schedule when orachk will be run

bull Hour day of month month of year amp day of week

bull Comma separate multiple values for same timeframe

bull Wildcard

Hour (0 ndash 23)

Day of month (1 ndash 31)

Month (1 ndash 12)

Day of week (0 ndash 6) (0 to 6 are Sunday to Saturday)

orachk ndashset ldquoAUTORUN_SCHEDULE=2 135rdquo

AUTORUN_FLAGS

bull Command line options to be passed through to orachk run

orachk ndashset ldquoAUTORUN_FLAGS=-profile dba ndashtag dbardquo

NOTIFICATION_EMAIL

bull Comma separated list of emails to send daemon notifications to

orachk ndashset ldquoNOTIFICATION_EMAIL=somepersonacompanycomanotherpersonacompanycomrdquo

29

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Maintenance

orachk ndashset ldquoltoption_1gt=ltoption_1_valuegtltoption_2gt=ltoption_2_valuegtltoption_ngt=ltoption_n_valuegtrdquo

COLLECTION_RETENTION

bull Number of days to keep files created by scheduled run files older than this will be deleted

orachk ndashset ldquoCOLLECTION_RETENTION=30rdquo

PASSWORD_CHECK_INTERVAL

bull Frequency in hours of password validation

bull When found invalid daemon stops amp notifies via log amp email

orachk ndashset ldquoPASSWORD_CHECK_INTERVAL=48rdquo

30

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Set Daemon Options Multiple IDs

bull Only one Daemon process should be used across a database cluster

o Multiple daemon profiles can be configured using IDs

o Allows for multiple different types of orachk runs

orachk ndashid ltIDgt ndashset ldquoltoptiongt=ltvaluegtrdquo

31

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get Daemon Option

bull Find a specific daemon option which has been set

bull Use with or without ID

orachk ndashid ltIDgt ndashget ltoptiongt

Get value of particular option for specific id

orachk ndashget ltoptiongt

Get value of particular option for all IDs

32

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Get All Daemon Options

bull Find any Daemon options which have been set

bull Used with or without ID

orachk ndashid ltIDgt ndashget all

Get value of all options for specific id

orachk ndashget all

Get value of all options for all IDs

33

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Start Daemon

orachk ndashd start

1 Start the daemon

2 Follow the prompts

34

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Information

orachk ndashd status

Check if the daemon is running

orachk ndashd info

Get more detailed information about the daemon

35

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Next Autorun

orachk ndashd nextautorun orachk ndashid ltidgt ndashd nextautorun

Find when the next auto run will happen Find when the next auto run will happen for a specific ID

36

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Daemon Stopping

orachk ndashd stop_client orachk ndashd stop

Stop an orachk run mid-flow Stop the daemon

37

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Auto Restart Daemon

bull Restart daemon if machine restarts o Uses passwordless ssh

user equivalence to root

orachk ndashinitsetup

38

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Restart status of daemon can be queried If you want to remove restart settings

Auto Restart Daemon Check Status amp Remove Auto Restart

orachk ndashinitcheck orachk ndashinitrmsetup

39

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

With or Without the Daemon

bull When daemon is running if orachk is run in on-demand mode it will connect to the daemon by default and make use of pre-provided prompt values o To avoid connecting to the daemon use ndashnodaemon

o To only run orachk when the daemon is running use ndashdaemon

orachk ndashnodaemon

orachk ndashdaemon

40

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Email Notifications bull Run in ad hoc mode and receive html report via email

bull Verify email configuration function

bull Use ndashtestemail all to use email addresses stored in daemon configuration

orachk -sendemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail NOTIFICATION_EMAIL=abccompanycomxyzcompanycom

orachk -testemail all

41

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Additional Oracle ORAchk Capabilities amp Features

42

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Health Check Catalog bull Bundled within zip download

bull ORAchk_Health_Check_Cataloghtml

bull Contains all published checks

bull Filterable amp searchable bull Engineered System

bull Profiles

bull Alert Level

bull Release Check Authored

bull Platforms

bull Privileged User

bull Look up check id without running report

43

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Database Checks

bull ORAchk runs checks against all database nodes in the cluster by default

o To specify only a subset of nodes use

o Only local node

bull Automatically discovers all databases and prompts for which should be checked

o Do not prompt but run all checks on all discovered database

o Do not prompt and skip all database related checks

o Only run checks against a subset of databases

orachk ndashclusternodes ltnode_1gtltnode_2gt

orachk ndashlocalonly

orachk ndashdball

orachk ndashdbnone

orachk ndashdbnames ltdb_1gtltdb_2gt

44

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Output

bull ORAchk will output the collection results to the directory it is run from unless run from $ORACLE_HOMEsuptoolsorachk then output goes to $ORACLE_BASEorachk

o Output can be directed to a different directory with ndashoutput

bull Output will be directory and a zip of the same name

orachk ndashoutput ltOUTPUT_DIRgt

o log various log files

o outfiles collection results checks are based on

o reports subreports used to build the main report

o scripts scripts used during collection

o upload files for upload of collection into database or integration into other tools

o orachk_html Main HTML report output

45

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Temporary Working Directory

bull ORAchk will create temporary files during execution

bull Default location is $HOMEorachk of the user ORAchk is running as

bull Location can be changed by setting RAT_TMPDIR

bull If using sudo access to root from a lower privileged user id temporary directory must be reflected in etcsudoers file

bull Root privilege checks run from root_orachksh in the temporary directory

ndash If you want the root script in a different directory to RAT_TMPDIR use RAT_ROOT_SH_DIR

export RAT_TMPDIR=ltTEMP_DIRgt

orachk

ltusergt ALL=(root) NOPASSWDltTEMPDIRgtorachkroot_orachksh

46

oracle ALL=(root) NOPASSWDmylocationroot_orachksh

oracle ALL=(root) NOPASSWDtmporachkroot_orachksh

export RAT_ROOT_SH_DIR=mylocation

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Parallel Execution

bull Database collections are executed in parallel

bull The default number of slave processes used is calculated automatically

bull Default can be changed with ndashdbparallel lt slave processesgt or -dbparallelmax

bull Parallel execution can be disabled altogether if required with -dbserial

orachk ndashdbparallel lt slave processesgt orachk ndashdbparallelmax

orachk ndashdbserial

47

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Tagging Merging amp Comparing Reports

bull Collections are typically of the format orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgthtml

bull Tag collections so output contains another word to help differentiate it

orachk_ltdbservergt_ltdatabasegt_ltdategt_lttimestampgt_lttag_namegthtml

bull Merge multiple reports into one with ndashmerge and list of collection directories or zip files

bull Compare collections with ndashdiff

orachk ndashmerge ltcollection_1gtltcollection_2gt

orachk ndashdiff ltcollection_1gtltcollection_2gt

orachk ndashtag lttag_namegt

48

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Profiles provide logical grouping of checks which are about similar topics

bull Run only checks in a specific profile

bull Run everything except checks in a specific profile

Profiles

orachk ndashprofile ltprofilegt

orachk ndashexcludeprofile ltprofilegt

Profile Description asm ASM Checks

clusterware Oracle clusterware checks dba DBA Checks ebs Oracle E-Business Suite checks

emagent Cloud control agent checks emoms Cloud Control management server

em Cloud control checks goldengate Oracle GoldenGate checks hardware Hardware specific checks for Oracle Engineered systems

oam Oracle Access Manager checks oim Oracle Identify Manager checks oud Oracle Unified Directory server checks ovn Oracle Virtual Networking

peoplesoft Peoplesoft best practices preinstall Pre-installation checks prepatch Checks to execute before patching security Security checks siebel Siebel Checks

solaris_cluster Solaris Cluster Checks sysadmin Sysadmin checks

user_defined_checks Run user defined checks from user_defined_checksxml

49

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Run or exclude individual checks

bull Granular control to execute or exclude a single check

bull Ideal for testing new checks or troubleshooting

bull Run only specific check(s)

bull Exclude a specific check

bull Find check id either from report or Health Check Catalog

orachk -check ltcheck_id_1gtltcheck_id_2gt

orachk ndashexcludecheck ltcheck_id_1gtltcheck_id_2gt

50

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Track changes to the attributes of important files with ndashfileattr ndash Looks at all files amp directories within Grid Infrastructure and Database homes by default

ndash The list of monitored directories and their contents can be configured to your specific requirements

ndash Use ndashfileattr start to start the first snapshot

51

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr start

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app11204grid[yn][y]

Checking ssh user equivalency settings on all nodes in cluster

Node mysrv22 is configured for ssh user equivalency for oradb user

Node mysrv23 is configured for ssh user equivalency for oradb user

List of directories(recursive) for checking file attributes

u01apporadbproduct1120dbhome_11203

u01apporadbproduct1120dbhome_11204

orachk has taken snapshot of file attributes for above directories at

orahomeoradborachkorachk_mysrv21_20160504_041214

orachk ndashfileattr start

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 52

Keep Track of Changes to the Attributes of Important Files

bull Include other directories with ndashincludedir ltdirectoriesgt using a comma separated list of directories

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo

bull Exclude the default discovered directories with ndashexcludediscovery

orachk ndashfileattr start includedir ldquohomeoradbetcoatabrdquo -excludediscovery

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Note bull Use the same arguments with check that you used with start bull Will proceed to perform standard health checks after attribute checking bull File Attribute Changes will also show in HTML report output

bull Compare current attributes against first snapshot using ndashfileattr check

53

Keep Track of Changes to the Attributes of Important Files

$ orachk -fileattr check -includedir rootmyappconfig -excludediscovery

CRS stack is running and CRS_HOME is not set Do you want to set CRS_HOME to

u01app1220grid[yn][y]

Checking for prompts on myserver18 for oragrid user

Checking ssh user equivalency settings on all nodes in cluster

Node myserver17 is configured for ssh user equivalency for root user

List of directories(recursive) for checking file attributes

rootmyappconfig

Checking file attribute changes

rootmyappconfigmyappconfigxml is different

Baseline 0644 oracle root rootmyappconfigmyappconfigxml

Current 0644 root root rootmyappconfigmyappconfigxml

hellipetc

hellipetc

orachk ndashfileattr check

bull Results of snapshot comparison will also be shown in the HTML report output

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Keep Track of Changes to the Attributes of Important Files bull To prevent standard health checking after attribute checking add ndashfileattronly

bull To use a different snapshot baseline use ndashbaseline

bull To remove all snapshot use ndashfileattr remove

54

orachk ndashfileattr check ndashfileattronly

orachk -fileattr check -baseline ltsnapshotgt

orachk -fileattr remove

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

55

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Oracle Health Check Collection Manager Dashboard

56

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Dashboard Filters

Filter by Interval

Filter by configurable

business units Filter by systems

Click on color coded area to drill down

57

Filter by health score

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures amp Warnings

Click to see the recommendation details

58

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Failures

Click to drill into failures

59

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Most Warnings

Click to drill into warnings

60

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

No difference OR No regression failed in current collection

At least one regression from Non-WARNING to WARNING OR Found WARNING regression in current collection

At least one regression from Non-FAIL to FAIL OR Found FAIL regression in current collection

Non clickable green flag - Preceding collection not found

Recent Collections

Health Score Warning count

Fail count Info count Pass count

Ignore count

61

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Collection Link

62

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

View Collection

Recommendation

63

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks bull Use as a Health Checking Platform

bull You write your own business specific User Defined Checks

bull Collection Manager authoring UI very similar to Oraclersquos internal authoring tool

bull OS or SQL logic

bull Generates user_defined_checksxml sample in install directory

bull Utilizes framework features such as result output email notification CM storage etc

64

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

User Defined Checks

bull Have their own profile user_defined_checks

bull Can be excluded orachk -excludeprofile user_defined_checks

bull Have their own section of the report

orachk -profile user_defined_checks

bull Can be run on their own

65

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

1 First time installation done via the APEX workspace (either APEX 42 or 5x)

2 Use the sql script applicable for your APEX version

ndash APEX 42 CollectionManager_Appsql

ndash APEX 5x Apex5_CollectionManager_Appsql

3 Follow Health Check Collection Manager installation in the User Guide

4 Login to Collection Manager Application via a URL like the following

httphostnameportapexfp=ApplicationID

httphostnameportplsapexfp=ApplicationID

bull Collection Manager upgrade done from orachk

bull Will determine the APEX version you have and install the latest applicable Collection Manager app

bull If the Collection Manager schema changes in the future then ORAchk will prompt for auto upgrade

66

Setup

orachk -cmupgrade

Note APEX 42 version of CM app exists for backwards compatibility New features will only go into the APEX 5 Collection Manager app

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Collection Storage Table

bull Collection zip files are stored in the RCA13_DOCS table - already created during collection manager installation

bull Provide ORAchk details of where to upload collection results with ndashsetdbupload all and complete prompts

bull Get current values with -getdbupload bull Unset values with ndashunsetdbupload ltparametergt

orachk -setdbupload all

orachk ndashunsetdbupload RAT_UPLOAD_PASSWORD

orachk -getdbupload

67

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Store DB Upload Variables in Wallet bull Set all with

bull Set specific variables by specifying comma separated list

bull Unset all with

bull Check if variables are set correctly

orachk -setdbupload all

orachk -setdbupload RAT_UPLOAD_CONNECT_STRINGRAT_UPLOAD_PASSWORD

orachk -unsetdbupload all

orachk -checkdbupload

68

Other Upload Parameters Not Set by default

Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

69

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Oracle Enterprise Manager Cloud Control 131

70

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Enterprise Manager Integration

bullCheck results integrated into EM compliance framework via plugin

bullView results in native EM compliance dashboards

bullRelated checks grouped into compliance standards

bullView targets checked violations amp average score

bullDrill down into compliance standard to see individual check results

bullView break down by target

71

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Setting Up Enterprise Manager Plugin

bull The plugin is already installed by default with Enterprise Manager 131

1 Deploy the plugin using the Enterprise Manager Plugin Deployment feature

2 Provision the plugin to setup the ORAchk daemon

72

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Use Enterprise Manager provisioning feature and select ORAchkEXAchk

bull After selected this will launch the provisioning wizard choose the system type

Provision ORAchk

73

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Provide new or select existing credentials

bull Specify install location

bull Select when daemon should be run

74

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Provision ORAchk

bull Verify CRS Home

bull Finally choose Cell amp InfiniBand configuration

75

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Drill into applicable standard and view individual checks amp target status

View Results by Compliance Standard

Filter by Exachkrdquo

Click individual checks for recommendation details

76

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With 3rd Party Tools

77

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull The JSON provides many tags to allow dashboard filtering based on facts such as

bull Engineered System type bull Engineered System version bull Hardware type bull Node name bull OS version bull Rack identifier bull Rack type bull Database version bull And more

bull Kibana can be used to view health check compliance across your data center

bull Results can also be filtered based on any combination of exposed system attributes

78

JSON Output to Integrate with Kibana Elastic Search etc

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull ORAchk results are also output in JSON format in the upload directory of the collection

bull Writing JSON Results With syslog

1 JSON output results can be sent to the syslogd Daemon with ndashsyslog option eg

2 ORAchk uses the message levels of ldquocritrdquo ldquoerrrdquo ldquowarnrdquo and ldquoinfordquo

3 You can verify syslog configuration by running the following commands

4 Then verify in your configured message location (eg varadmmessages) that each test message was written

JSON Result Output

orachk ndashset ldquoAUTORUN_FLAGS=-syslogrdquo

79

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Integrating With Your Own Application

80

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

If you donrsquot use Collection Manager and have your own application which consumes the ORAchk results

1 Create the tables auditcheck_result auditcheck_patch_result amp RCA13_DOCS

2 Set default parameters

ndash This will prompt you for and set the RAT_UPLOAD_CONNECT_STRING amp RAT_UPLOAD_PASSWORD

3 Set optional parameters for RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

81

Configure Details for Upload of Collection Results

orachk ndashsetdbupload all

orachk -setdbupload RAT_UPLOAD_TABLERAT_PATCH_UPLOAD_TABLE

Other Upload Parameters Not Set by default Description

RAT_UPLOAD_USER The user to connect as (default is ORACHKCM)

RAT_UPLOAD_TABLE The table name to store non-zipped collection results

RAT_PATCH_UPLOAD_TABLE The table name to store non-zipped patch results

RAT_UPLOAD_ORACLE_HOME The ORACLE_HOME used during establishing connection and uploading (Uses GI HOME discovered by ORAchk by default)

RAT_UPLOAD_TABLE amp RAT_PATCH_UPLOAD_TABLE

Only needed if you are using your own custom application to view collection results rather than Collection Manager

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Agenda

1

2

Why Oracle ORAchk

Recommended Usage Overview

Report Structure

Detailed Usage Options

Oracle Health Check Collection Manager

Integration With Other Tools

Troubleshooting

3

4

5

6

7

82

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull View Component Elapsed Times

o Identify if one particular component is slow

bull View top 10 Time Consuming Checks

o If some in particular are slow show check_id and run again with

Troubleshooting Performance

orachk ndashexcludecheck ltcheck_idgt

bull Try increasing the number of parallel slave processes (Note will increase resource usage)

orachk ndashdbparallelmax

83

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull If checks are being killed this will be due to timeout

bull Timeouts can be caused by slow checks or interactive prompts

bull Try increasing default times with applicable environment variables

bull EBS checks query application data which can vary hugely in size depending on the size of your data

o If you suspect EBS checks try excluding EBS profile

oUse RAT_TIMEOUT to increase to a value where they are no longer killed

Troubleshooting Timeouts

orachk ndashexcludeprofile ebs

84

Environment Variable Timeout Controlled Default Value

(seconds)

RAT_TIMEOUT non-root individual

commands 90

RAT_ROOT_TIMEOUT root userid command

sets 300

RAT_PASSWORDCHECK_TIMEOUT ssh login DNS

handshake 1

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

bull Debugging via Daemon bull Debugging ondemand ORAchk runs

Collecting Debug

orachk ndashd start_debug orachk ndashdebug

bull Debug output

85

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved |

Safe Harbor Statement

The preceding is intended to outline our general product direction It is intended for information purposes only and may not be incorporated into any contract It is not a commitment to deliver any material code or functionality and should not be relied upon in making purchasing decisions The development release and timing of any features or functionality described for Oraclersquos products remains at the sole discretion of Oracle

86

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87

Copyright copy 2016 Oracle andor its affiliates All rights reserved | 87