Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core...

27
Core Competencies - C33 Core Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di t SOAP j t Director, SOAProjects San Francisco Chapter

Transcript of Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core...

Page 1: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Core Competencies - C33Core Competencies - C33Introduction to Automated Controls

Jay SwaminathanDi t SOAP j tDirector, SOAProjects

San Francisco Chapter

Page 2: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Agenda

• Automated Controls and its relationship with h lother controls

• The Value of Automated Controls• Common Testing Approaches• ITGC considerationsITGC considerations• The Concept of ‘Benchmarking’I i li d l• Increasing reliance on automated controls

• Questions / Comments

San Francisco Chapter

Page 3: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Application Control

• ISACA definition of a controlli i d i d i i lPolicies, procedures, practices and organizational 

structures implemented to reduce risks

• Control nomenclatureSOAPET S bj t Obj t A ti P E id d– SOAPET ‐ Subject, Object, Action, Purpose, Evidence and Timing

• Application control, ITAC, Automated Control, ITP

San Francisco Chapter

ITP

Page 4: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Control Layout

San Francisco Chapter

Page 5: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Examples

Example 1 Example 2 Example 3 Example 4

System calculatesdepreciation based on setting

Three way match 

Systemenforced journal approval based 

Custom logic to enforce sales order limits by sales personbased on setting approval based

on limitssales person

San Francisco Chapter

Page 6: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Type of Application Controls

• Inherent controlsB ilt i t th li ti– Built into the application

– Examples: DR = CR, Depreciation calculation, etc.

• Programmed controls (custom coded)• Programmed controls (custom coded)– Custom functionality – Based on specific business requirementq

• Configurable controls– Configured and can be disabled or set up to operate in specific manner

– Examples: tolerance, auto‐accounting

San Francisco Chapter

Page 7: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Nature of Application Controls

• Validationl l• Calculation

• Authorization

Application Controls 

If it works once, will work consistently

San Francisco Chapter

Page 8: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Examples

Example 1 Example 2 Example 3 Example 4Example 1 Example 2 Example 3 Example 4

System calculates

Three way match 

Systemenforced 

Custom logic to enforce sales 

Depreciation based on setting

journal approval based on limits

order limits by sales person

Type Inherent Configurable Configurable Customized

Nature Calculation Validation Authorization Authorization

San Francisco Chapter

Page 9: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Application Controls Benefits

• Implement once (cost depending on type of control)i i f l• Lower cost in operation of control

– Less dependence on humansFewer errors– Fewer errors

– Less paper

• Control assessment usually more efficient• Control assessment usually more efficient– Test of One– BenchmarkingBenchmarking

San Francisco Chapter

Page 10: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Application Control considerationspp

• Ignorance is not a controll h d f l i f i• Control where system defaults information are not 

strongL i l A t l A li ti t l• Logical Access controls as Application controls

• Restricted Access & SOD Controlsd l d l• Consider manual prevent and review control 

addressing the same riskC id iti it f t l i d f th i k• Consider sensitivity of control required for the risk

San Francisco Chapter

Page 11: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Testing Approach• Test of Design (Test of one)

– Inquiry and observation procedures.  – Review of configurations for configurable control– Examination of one or more transactions to confirm the design.

• Test of Effectiveness– Rely on underlying IT General Controls

• When is a ‘negative test’ appropriate?• How to confirm whether setup is same across the whole p

organization• What additional considerations for configurable controls• Do we review code for customizable controls?Do we review code for customizable controls?

San Francisco Chapter

Page 12: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Testing Examples• Inspect configuration

– Inspect 2/3/4‐way match configuration– Inspect tolerance levels configured

• Re‐performance via a walkthrough of each significant flow of itransactions

– Demonstrate the operating effectiveness of the control via positive and negative confirmation

• Inspect the authorizations and re‐perform controls to confirm the design– Inspect privileges assigned to all users– Inspect privileges assigned to all users

• Determine how overrides are possible throughout testing and how they are monitored

San Francisco Chapter

how they are monitored

Page 13: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

ITGC Considerations

• IT General Controls must be effective• ITGC must cover automated controls (e.g., configuration changes)

• Configuration not made at entity/instance level (customer, supplier, item, etc.)( , pp , , )

• Access issues that might provide override accessaccess

• Exception flows

San Francisco Chapter

Page 14: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

ITGC Considerations continued…

• SOD between access to configuration vs. transactionSO b d i• SOD between setup and transaction

• SOD between upstream and downstream t ti l bilittransactional ability

• Emphasis could shift between change management and logical accessand logical access– Authorizations, configurations – Logical AccessC l l ti t i ti I h t Ch– Calculation, customization, Inherent – Change Management

San Francisco Chapter

Page 15: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

ITGC Concerns

Change Management• Ability to make code changes is not limited to programmers• Ability to make code changes is not limited to programmers• Standard change management process not followed for 

configuration settingsLogical Access• End users have ability to change configuration settings (Users 

d i i )Vs. Super Users Vs. System Administrator)• Override of the control by super users or system/database 

administratorsadministrators• Improper Segregation of Duties (create document Vs. release 

holds)

San Francisco Chapter

Page 16: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

ExamplesExample 1 Example 2 Example 3 Example 4

System calculates

Three way match 

System enforced journal approval 

Custom logic to enforce sales 

Depreciation based on setting

j ppbased on limits order limits by 

sales person

Type Inherent Configurable Configurable Customized

Nature Calculation Validation Authorization Authorization

Walkthrough Positive Negative Positive Positive

CM aspects Program changes

Program and Configuration

Program changes Program changeschanges Configuration 

changeschanges

LA aspects None Access to configuration

Access to configuration

None

San Francisco Chapter

configuration configuration

Page 17: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Testing – Ineffective ITGC

• Sample based application control testing

• WCGW never went wrongE g configuration not changed although change– E.g. configuration not changed although change management around configurations not effective.

• Professional judgment on inherent controls

• Data analytics

San Francisco Chapter

Page 18: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Benchmarking• Benchmarking is the ability to roll forward prior conclusions 

on control effectiveness based on the ability to demonstrate a i d ll d istatic and controlled environment.

• Historically very difficult to achieve due to complexities within the ERP environment and the dynamic (regularly changing) nature.

• GRC Software packages enable benchmarking feasible.

San Francisco Chapter

Page 19: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Benchmark Testing Approach

• Considerations– Control can be matched with specific program– Application is stable– Reliability of report on compilation dates

• Consider for purchased software• Perform initial baseline• Monitoring• Monitoring• Rotational Testing

San Francisco Chapter

Page 20: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Case Study

Expanding Reliance on Automated Controls

San Francisco Chapter

Page 21: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Objective

• Identification of unmitigated risks or d d lredundant controls

• Identify additional automated controls• Increase the efficiency of testing the controls

San Francisco Chapter

Page 22: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Rationale

• Once implemented, application controls are significantly cheaper to operatesignificantly cheaper to operate.

• Application controls are more consistent and secure than manual controlsthan manual controls. 

• Application controls are very often the only controls within an automated processwithin an automated process.

• Application controls are most effective in heavy transaction controlstransaction controls

• It could be more efficient to rely on application controls rather than doing substantive testing.

San Francisco Chapter

g g

Page 23: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Process

1. Meetings with Process Owners to d d hunderstand the process

2. Working session to determine control set and testing approach

3. Draft implementation planp p4. Identify cost and benefit5 Confirm changes and discuss the plan to5. Confirm changes and discuss the plan to 

implement

San Francisco Chapter

Page 24: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Result

• Identified controls that were already implemented and contributed to the mitigation of riskg

• Implemented new application controls that reduced the need for manual controls

• Used benchmarking for some application controls to increase• Used benchmarking for some application controls to increase the efficiency of the controls assessment

Control mix prior to review – 90% manual, 10% automated

Control mix after review – 50% manual, 50% automated

San Francisco Chapter

Page 25: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Benefits of Automated Controls

duction Cost of controls

Cost ofduction Revenue risk

Cost risk emen

t Process Cycle time pl

iance Lower cost of 

audit

Cost Red

Cost of ResearchCost avoidanceRi

sk Red

Cost riskReputational risk

cess

Impr

ove

Complete validation & enterprise visibility

Comp

Reduction in penaltiesIncreased 

l

Pro

c visibilityDecision effectiveness

control effectiveness and coverage

San Francisco Chapter

Page 26: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Appendix – Control Syntax

• Subject – Human, group of humans, system, group of systems• Object Transaction record asset assertion access users• Object – Transaction, record, asset, assertion, access, users, 

change• Action – Checks, verifies, reviews, approves, tests • Purpose – Stop unauthorized activity, identify error, approve 

authorized users, check accuracy, verify completenessid i k d l l• Evidence – Ticket, document, report, system logs, alert, wet 

signature• Timing – As needed, Monthly, QuarterlyTiming  As needed, Monthly, Quarterly

San Francisco Chapter

Page 27: Core CompetenciesCore Competencies - C33 Introduction to … · 2012-10-07 · Core CompetenciesCore Competencies - C33 Introduction to Automated Controls Jay Swaminathan Di tDirector,

Questions?

San Francisco Chapter