@IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago...
Transcript of @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago...
![Page 1: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/1.jpg)
IIA Chicago Chapter 53rd Annual SeminarApril 15, 2013, Donald E. Stephens Convention Center
@IIAChicago
#IIACHI
Applying Six Sigma to Internal Audit
A practical approach
Kenneth J RamaleyManaging DirectorRamaley Group, LLC
![Page 2: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/2.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 2
Prologue – What is Six Sigma?
![Page 3: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/3.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 3
• Commitment to using statistical analysis of data to drive decision-making
• Prefer quantitative measurement to pseudo-quantitative aggregation of qualitative measurement
BIG IDEAS in Six Sigma
![Page 4: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/4.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 4
• Using Six Sigma Tools ON your audit process
(Six Sigma Audit Efficiency)
• Using Six Sigma Tools IN your audit process
(Six Sigma Audit Effectiveness)
• Auditing Six Sigma organizations / activities
Six Sigma and Audit - Connections
![Page 5: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/5.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 5
• Identify critical audit deliverables
• Perform S-I-P-O-C analysis on those deliverables
Six Sigma Audit Efficiency:Deliverable Analysis
![Page 6: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/6.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 6
• As-is process map:
• Analyze process map to find:– Bottlenecks
– Value-Added / Non-value-added / Required steps
– Opportunities for defects
Six Sigma Audit Efficiency:Process Mapping Analysis
![Page 7: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/7.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 7
• Conduct time study on process steps
• Identify variation in task performance
• Leverage simulation to understand overall process variation
Six Sigma Audit Efficiency:Simulation
![Page 8: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/8.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 8
• Pareto Principle: 80% of effects are produced by 20% of causes
Six Sigma Audit Effectiveness:Scoping Audit Jobs
![Page 9: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/9.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 9
• “Fishbone Diagram” produces visual depiction of root cause analysis
Six Sigma Audit Effectiveness:Identifying Root Causes
![Page 10: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/10.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 10
• FMEA (Failure Modes and Effects Analysis) quantitatively assesses risks based on:
– Severity
– Likelihood
– Detectability
• Application of FMEA, together with Pareto analysis can drive effective audit practices, focused on the “critical few” risks
Six Sigma Audit Effectiveness:Prioritizing Risk
![Page 11: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/11.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 11
• How many data points do you need for a “statistically sound sample”?
• Do you “feel lucky”?
• Revelation – sampling strength and efficiency are not incompatible
Six Sigma Audit Effectiveness:Statistically Sound Sampling
![Page 12: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/12.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 12
• An “in control” process will still generate exceptions
• Appropriate action plans must take into account normal variation and distinguish it from “special cause” variation
Six Sigma Audit Effectiveness:Monitoring “In Control” Processes
![Page 13: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/13.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 13
• Six Sigma programs represent a significant investment and usually a strategic commitment by management
• Audit must provide assurance that the programs are delivering appropriate return and not being diverted by the BIG RISKS of Six Sigma Programs
– BIG RISK #1 – Weak ROI
– BIG RISK #2 – Drive wrong decisions
Auditing Six Sigma
![Page 14: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/14.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 14
Audit can provide independent assessment of Six Sigma ROI by analyzing:
– Program emphasis on results vs. “certifications”
– Ongoing accomplishments of trained associates
– Project selection approach/focus
– Result replication
Auditing Six Sigma ROI
![Page 15: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/15.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 15
• Effective audit will often require outside SME
• Statistics and tools can obscure truth
• In every Six Sigma program, there will be volumes of data, BUT the results will be driven by:
– Model assumptions
– Measurement system design
– Variable inclusions/exclusions
• Local optimization can mask global inefficiency
Auditing Six Sigma Accuracy
![Page 16: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/16.jpg)
#IIACHI
April 15, 2013 IIA Chicago Chapter 53rd Annual Seminar 16
• Six Sigma is a powerful approach to problem solving
• Audit organizations should embrace Six Sigma tools to improve their process efficiency and effectiveness– Develop Six Sigma skillset within audit, OR
– Bring in Six Sigma expertise to jumpstart improvements and accelerate gains
• Auditing Six Sigma functions can be tricky and may require SME to wade through the sea of tools and techniques
Conclusions
![Page 17: @IIAChicago #IIACHI Applying Six Sigma to Internal Audit Seminar Presentations/E4... · IIA Chicago Chapter 53rd Annual Seminar April 15, 2013, Donald E. Stephens Convention Center](https://reader033.fdocuments.in/reader033/viewer/2022052708/5a6fbc4d7f8b9aa7538b5d4f/html5/thumbnails/17.jpg)
What do you think?Share your thoughts about this presentation on Twitter using the hashtag #IIACHI
@IIAChicago
Visit our Social Media booth in the Exhibit Hall to join the conversation today!
Not on Twitter?
Follow us on Twitter