1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research...
-
Upload
evelyn-bond -
Category
Documents
-
view
215 -
download
0
Transcript of 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research...
![Page 1: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/1.jpg)
1
Annual Self-Assessment (ASA) Template Training
Office of Quality ManagementOffice of Research ServicesNational Institutes of Health
21 March 2002
![Page 2: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/2.jpg)
2
Acknowledgments
ASA Template Training was jointly developed by:
• Office of Quality Management (OQM) Antonio Rodriguez, Amy Culbertson, Carmen Kaplan,
and Gay Presbury
• OQM Consultants Janice Rouiller (SAIC), Kate Fenton (Atlantic Rim
Group), Phil Nathanson (McManis Associates)
![Page 3: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/3.jpg)
3
Training Objectives
• Explain the background of the ORS ASA initiative• Describe the Balanced Scorecard (BSC),
performance measurement, and the ASAs• Provide orientation to the ASA Template• Provide resources for additional information
![Page 4: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/4.jpg)
4
Background of the ASA Initiative
![Page 5: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/5.jpg)
5
History of ASAs
• ORS senior leader visited organization doing great job at performance measurement and management We can do this! Fits well with implementation to activity-based
costing/management approach Started with the Service Area Reviews (SARs)
• SARs transitioned into ASAs in 2001 Used New Business Model as framework to organize ORS
products/services 41 discrete services chosen for 2001 Results presented at Performance Management Conference
October 31, 2001 Lessons learned provided input for 2002 implementation
![Page 6: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/6.jpg)
6
ASA Purpose
• Implement culture in ORS that manages and improves through the use of performance data Gauge extent to which ORS is delivering what customers
want and need Use data to make process improvements Plan how to invest in people and tools to be innovative and
competitive Understand reasons for change in costs and funding needs Make funding allocation decisions based on data-based
business case
![Page 7: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/7.jpg)
7
Why Use the ASA Approach?
• ASAs serve as the vehicle to implement performance measurement throughout ORS Need to develop people’s skills Need to fine-tune IT systems for data collection Need to develop methods for ORS-wide data collection and
analysis where appropriate
• Longer-term goal Performance measures will be deployed throughout ORS
and be used as part of daily business operations Measurement will form the basis for managing for present
and the future
![Page 8: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/8.jpg)
8
What’s in it for me?• A showcase for what you do and how you add value
• An opportunity to influence operational processes and decisions
• A way to eliminate unnecessary steps in your business process
• Help in finding better ways to serve your customers
• A chance to learn more about about what others do in ORS
• “Hard” data to support resource requests (e.g., funding, staff)
• Help in workforce planning
• Better outcomes, more satisfied customers, better business operations, more efficient processes …
![Page 9: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/9.jpg)
9
• Organized the ASAs at the Service Group level About 45 ASAs in FY02
• Established Common Measures Everyone will complete these Help teams to know where to start with performance
measurement Some information will be “rolled-up” for ORS ASA Template
• Identified need for ASA training sessions ASA Template Training Process Mapping Training Data Analysis and Graphing Training
• Implemented ASA Web Page http://www.nih.gov/od/ors/od/oqm/asa/asa.htm
Resources Timeline Training
• One Final Deliverable - ASA Presentation
ASA Changes in 2002
![Page 10: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/10.jpg)
10
Key Players in the ASAs
• Team Leaders• Team Members• Office of Quality Management (OQM)• OQM Consultants• ORS Executive Committee (ORSEC)• ORS Advisory Committee (ORSAC)
![Page 11: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/11.jpg)
11
ASA Roles and Responsibilities• ASA Team Leader
Lead and manage individual ASAs Select and assemble ASA team members Manage use of ASA Consultant assigned to Team Prepare ASA Template Guide data collection and analysis Serve as key point of contact throughout ASA process Prepare ASA Final Presentation
• ASA Team Members Attend trainings to learn new skills Assist in developing the ASA template Participate in process mapping Assist with data collection and analysis Participate in process improvement activities Help prepare ASA Final Presentation
![Page 12: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/12.jpg)
12
ASA Roles and Responsibilities (cont.)
• Office of Quality Management (OQM) Formulate ASA methodology Develop ASA training and tools for ASA Teams Provide Teams with technical advice/consultants Provide ASA status reports to senior leadership Conduct “roll-up” of common measures for ORS Evaluate ASA methodology and fine-tune the process
• OQM Consultants Deliver ASA training courses Serve as facilitators and technical experts to Teams
Provide consulting services at the Team level Will have approximately 20 hours per ASA Team for FY02
Provide feedback to OQM on ASA Teams’ progress
![Page 13: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/13.jpg)
13
ASA Roles and Responsibilities (cont.)
• ORS Executive Committee (ORSEC) Drive commitment to the ASA process by providing
leadership, personnel, resources Monitor Division/Office progress in ASA implementation Decision making based on ASA findings and
recommendations Recognize outstanding team efforts Allocate resources within Division/Office based on ASA
findings
• ORS Advisory Committee (ORSAC) Serve in advisory capacity to ASA effort Communicate to stakeholders ORS initiatives regarding
performance measurement
![Page 14: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/14.jpg)
14
The Balanced Scorecard, Performance Measurement, and the ASAs
![Page 15: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/15.jpg)
15
The Balanced Scorecard (BSC)
• BSC is the framework ORS is using for the ASAs
• BSC approach originated from research project with 12 companies at leading edge of performance measurement
• Set of measures to give managers a fast yet comprehensive view of their business
Method to translate business strategy into action Organizes measures in terms of 4 key “perspectives” Measures address both current and future success Integrates both external and internal measures
• Sources for more information on the BSC
Kaplan and Norton publications (see resources list) BSC collaborative (http://www.bscol.com)
ASPA Balanced Scorecard Interest Group (http://www.aspanet.org/bscorecard/index.html)
![Page 16: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/16.jpg)
16
BSC’s Four Perspectives
Customer Perspective
Are we providing our customers what they need and want?
Internal Business Process Perspective
To satisfy our customers, in which internal business processes must we excel?
Learning & Growth Perspective
To achieve our goals, how must our organization learn and innovate?
Financial Perspective
Are we operating efficiently within our budget constraints?
Adapted from Kaplan & Norton, 1996.
![Page 17: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/17.jpg)
17
BSC and Performance Measurement• Fits with Government emphasis on performance
measurement initiated with GPRA Government Performance and Results Act (GPRA)
http://www.whitehouse.gov/omb/mgmt-gpra/gplaw2m.html
NIH Performance Planhttp://www1.od.nih.gov/gpra/gpra_nih_c.htm
• Reemphasized in The President’s Management Agenda The President’s Management Agenda
http://www.whitehouse.gov/omb/budget/fy2002/mgmt.pdf
Government ExecutiveGovExec.com - Government Executive Magazine
• Many resources on performance measurement The Performance Based Management Handbook
http://www.orau.gov/pbm/pbmhandbook/pbmhandbook.html
Performance Measurement Documents http://www.orau.gov/pbm/documents/documents.html
NAPA, Center for Improving Government Performance The National Academy of Public Administration
![Page 18: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/18.jpg)
18
BSC and Performance Objectives
BSC Perspective
Customer
Internal Business Process
Learning & Growth
Financial
ExamplePerformance Objectives
• Increase customer satisfaction• Expand customer base
• Increase speed of service• Decrease amount of errors
• Increase employee satisfaction• Increase employee KSAs
• Understand causes of unit cost fluctuation
• Reduce unit cost
![Page 19: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/19.jpg)
19
BSC, Performance Objectives, and Performance Measures
Performance Objective Performance Measure
1. Improve service quality # days between request and response# responses with errors
Internal Business Process Perspective
Performance Objective Performance Measure
1. Increase customer satisfaction Scores on customer satisfaction survey2. Expand customer base % ICs purchasing services
Customer Perspective
Examples
![Page 20: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/20.jpg)
20
Customer Value
Proposition StrategyPerformance
Objectives
Performance
Measures
ASAs and Performance Measurement
![Page 21: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/21.jpg)
21
ASA Methodology
• Form Teams for the 45 ASAs by Service Groups Strategy, objectives, and measures will be discussed at both
Service Group and Discrete Service level• Become familiar with the ASA Template
Attend ASA Template Training• Formulate basis for why you are in business
Describe the Customer Value Proposition Clarify your Strategy
• Establish Performance Objectives for your area Represent outcomes to be achieved Common objectives
Every ASA Team will work to achieve Unique objectives
Specialized objectives to your area
![Page 22: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/22.jpg)
22
ASA Methodology (cont.)
• Define Performance Measures to gauge if achieved objectives Common measures
Every ASA Team will gather and report Used in “roll-up” fashion to provide snapshot of ORS overall
Unique measures Specialized for each ASA Team May be at the Service Group level, or the Discrete Service level
• Plan for data collection Complete ASA Implementation Plan
• Map your processes Take Process Mapping Training
• Gather and analyze data Take Data Analysis and Graphing Training Take other trainings as appropriate
• Prepare ASA Final Presentation Tell the story of your ASA Interpret data findings and make recommendations for change
![Page 23: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/23.jpg)
23
Orientation to the ASA Template
![Page 24: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/24.jpg)
24
ASA Template - Page 1
Team Members
DS1:
DS2:
DS6:
DS4:
Product Leadership Harvest
Operational Excellence Growth
Service Strategy
ASA Template - 2002
Customer Value Proposition
Team Leader
DS5:
Discrete Services
Service Group
DS3:
Customer Intimacy Sustain
![Page 25: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/25.jpg)
25
• Service Groups and Discrete Services are the way ORS describes what we do in the New Business Model
• Categorize ORS Services in the Service Hierarchy 5 Program Areas
Building and Space Acquisition and Development Municipal Services Program Support Property Management Services Management and Support
45 Service Groups 170 or so Discrete Services
• Listing of Service Groups available via ASA web pagehttp://www.nih.gov/od/ors/od/oqm/asa/asa.htm
Click on ORS Service Groups in first paragraph
Step 1: List Service Group/Discrete Services
![Page 26: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/26.jpg)
26
ORS ExampleVRP Service Group: Provide Animal Research Support
ASA Template - 2002
Customer Value Proposition
Provide Animal Research Support
DS5: Provide veterinary pharmacy services
Discrete Services
Service Group
DS3: Operate acute and intensive care animal service
DS1: Perform veterinary surgery
DS2: Provide pathology services
DS6: Conduct collaborative veterinary research
DS4: Conduct laboratory services
Type in Service Group and Discrete Services on Template
![Page 27: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/27.jpg)
27
Step 2: Describe the Customer Value Proposition
• Identifies what value your service provides to customers
• Shows how you differentiate yourself from your “competitors”
• Describes your unique mix of product and service attributes, customer relations, and image/reputation offered (Kaplan & Norton, 2000)
• Should be written from the customer’s perspective, not yours
For more information, see Kaplan & Norton (1996 pp. 73-85, 2000).
![Page 28: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/28.jpg)
28
ORS ExampleCustomer Value Propositions from 2001 ASAs
• Provide innovative and highly specialized critical care services to the NIH biomedical research community, utilizing state-of-the-art veterinary techniques, conveniently located, to accommodate the unique needs of each investigator (VRP)
• Support the biomedical and behavioral research needs of the NIH Community by acquiring and providing access to electronic and print information resources (Library)
• Provide flexible, timely, and cost-effective scientific equipment to the NIH research community to enhance the research efforts (SEIB)
• Provide planning, design, and construction guidelines to the Architects and Engineers to improve biomedical facilities (DCAB)
• Provide cost-effective, timely, and appropriate technical and craft services for the operation and maintenance of NIH facilities, under normal and emergency conditions, to ensure a physical environment that is functional, clean, safe, healthy, comfortable, and reliable (PWB)
• Provide child care services to NIH employees to enhance the quality of the NIH work environment and the recruitment, retention, and performance of employees (DSS)
![Page 29: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/29.jpg)
29
Customer Value Proposition
Type in Customer Value Proposition here
ASA Template - 2002
Customer Value Proposition
Team Leader
DS5:
Discrete Services
Service Group
DS3:
Customer Intimacy Sustain
DS1:
DS2:
DS6:
DS4:
Product Leadership Harvest
Operational Excellence Growth
Service Strategy
Team Members
![Page 30: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/30.jpg)
30
Step 3: Identify Service Strategy
• For all areas, choose from:
Operational excellence Most common strategy for public organizations Focus on competitive pricing, quality, selection, and timeliness
Customer intimacy Focus on the quality of the relationships with customers
Product leadership Provide innovative and outstanding performance on products
and services offered
For more information, see Kaplan & Norton (2000).
![Page 31: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/31.jpg)
31
Step 3: Identify Service Strategy (cont.)
• Fee-for-service operations, also consider:
Growth Expanding your market share Developing new products or enhancing features of current
products Sustain
Maintaining your market share Maintaining current product/service offerings Maintaining similar levels of service Recovering costs for providing services
Harvest Phasing out/eliminating services Retraining and relocating workforce
For more information, see Kaplan & Norton (1996, p. 48-50).
![Page 32: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/32.jpg)
32
Service Strategy
Check the appropriate box(es) on the Template.
Team Members
DS1:
DS2:
DS6:
DS4:
Product Leadership Harvest
ASA Template - 2002
Customer Value Proposition
Team Leader
DS5:
Discrete Services
Service Group
DS3:
Operational Excellence Growth
Service Strategy
Customer Intimacy Sustain
![Page 33: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/33.jpg)
33
Step 4: List ASA Team Leader/Members
• ASA Team Leaders Lead ASA effort Manage use of consultant hours, expertise Assign and track ASA related tasks Responsible for status of team, final presentation
• ASA Team Members Attend ASA related trainings
http://www.nih.gov/od/ors/od/oqm/asa/asa_training.htm
Attend ASA meetings Assist with data collection and analysis Provide input into final ASA Presentation
![Page 34: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/34.jpg)
34
Service Strategy
Fill in Team Information.
Team Members
DS1:
DS2:
DS6:
DS4:
Product Leadership Harvest
ASA Template - 2002
Customer Value Proposition
Team Leader
DS5:
Discrete Services
Service Group
DS3:
Operational Excellence Growth
Service Strategy
Customer Intimacy Sustain
![Page 35: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/35.jpg)
35
ASA Template - Page 2
Minimze unit cost at a defined service level.
Increase understanding of processes.
Performance Objective
Enhance quality of work life for employees in ORS.
Identify methods to measure processes.
Learning and Growth Perspective
Performance Measure
Financial Perspective
Performance Measure
Performance Objective
Increase understanding of customer base
Increase customer satisfaction
Performance Objective
Service Group:
Performance MeasureInternal Business Process Perspective
Complete process maps of Service Group/Discrete Services
Identify and report on process measures for Discrete Services
Maintain & enhance competencies for the future organization.Analysis of Readiness Index
Performance Objective
Awards/Recognition
Contacts/Complaints with EEO/ER/ADR
Sick Leave Usage
Customer segmentation of Discrete Services
Change in Unit Cost for each Discrete Service
Customer PerspectivePerformance Measure
Customer satisfaction ratings from the ORS Customer Scorecard for each Discrete Service
Turnover
Actual assets utilized/planned asset utilization for each Discrete ServiceMaximize utilization of assets.
![Page 36: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/36.jpg)
36
ASA Template - Page 2
• Four BSC Perspectives Customer Internal Business Process Learning and Growth Financial
• For each Perspective you must specify: Performance objectives
Common objectives already listed Blank space to add unique objectives
Performance measures Common measures already listed Blank space to add unique objectives
![Page 37: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/37.jpg)
37
Step 5: Describe Customer Perspective
Common Objectives and Measures
The first common measure for the Customer Perspective asks you complete customer segmentation for the Discrete Services in your Service Group.
Customer PerspectivePerformance Measure
Customer satisfaction ratings from the ORS Customer Scorecard for each Discrete Service
Customer segmentation of Discrete Services
Increase customer satisfaction
Performance Objective
Increase understanding of customer base
![Page 38: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/38.jpg)
38
ORS Example (VRP)
Revenue for Acute and Clinical Care by IC (FY01)
![Page 39: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/39.jpg)
39
ORS Example (DBEPs)Number of Collaborations by NIH IC
0
2
4
6
8
10
12
14
16
18
NINDS
NCINIAID
NICHD
NIAMS
NIDDK
NIMH
CCNEI
NIDCR
NIANIDCD
NHGRI
NIEHS
CIT
Nu
mb
er o
f C
olla
bo
rati
on
s
From DBEPs ASA in 2001.
![Page 40: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/40.jpg)
40
ORS Example (DSS)Customer Segmentation for NIH Dining Centers
![Page 41: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/41.jpg)
41
Step 5: Describe Customer Perspective (cont.)
Common Objectives and Measures
The second common measure for the Customer Perspective is ratings from the ORS Customer Scorecard. How these data will be collected will be something the Team will discuss with their Consultant. OQM will tally the data and provide your Team with summary graphs.
Customer PerspectivePerformance Measure
Customer satisfaction ratings from the ORS Customer Scorecard for each Discrete Service
Customer segmentation of Discrete Services
Increase customer satisfaction
Performance Objective
Increase understanding of customer base
![Page 42: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/42.jpg)
42
Draft ORS Customer Scorecard We are collecting customer information in an effort to better meet your needs, and appreciate your taking a few minutes to complete this scorecard. Note that your responses will be combined with the responses of others. Your candid feedback is appreciated. Rating Scale Don’t Not Unsatisfactory Average Outstanding Know Applicable 0 1 2 3 4 5 6 7 8 9 10 DK NA
Product/Service Rating
Cost 0 1 2 3 4 5 6 7 8 9 10 DK NA
Quality 0 1 2 3 4 5 6 7 8 9 10 DK NA
Timeliness 0 1 2 3 4 5 6 7 8 9 10 DK NA
Reliability 0 1 2 3 4 5 6 7 8 9 10 DK NA
Customer Service Rating
Availability 0 1 2 3 4 5 6 7 8 9 10 DK NA
Responsiveness 0 1 2 3 4 5 6 7 8 9 10 DK NA
Convenience 0 1 2 3 4 5 6 7 8 9 10 DK NA
Competence 0 1 2 3 4 5 6 7 8 9 10 DK NA
Handling of problems 0 1 2 3 4 5 6 7 8 9 10 DK NA
Professionalism 0 1 2 3 4 5 6 7 8 9 10 DK NA
Overall Value 0 1 2 3 4 5 6 7 8 9 10 DK NA Was there anything that was done particularly well? Do you have specific suggestions on how we can improve? Any other comments? Product/Service:________________________________________
ASA Discrete Service:______________________________
NIH IC:________________________________________
![Page 43: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/43.jpg)
43
ORS Example (Fictitious)Product/Service Ratings
Shows mean ratings on Product/Service categories on ORS Customer Scorecard.
FY02 Product/Service RatingsIndex = 7.4
0.0
2.0
4.0
6.0
8.0
10.0Cost
Quality
Timeliness
Reliability
Data obtained from 153 customers
![Page 44: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/44.jpg)
44
ORS Example (Fictitious)Customer Service Ratings
Shows mean ratings on Customer Service categories on ORS Customer Scorecard.
FY02 Customer Service RatingsIndex = 6.9
0.0
2.0
4.0
6.0
8.0
10.0Availability
Responsiveness
Convenience
CompetenceHandling of Problems
Professionalism
Overall Value
Data obtained from 153 customers
![Page 45: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/45.jpg)
45
Step 5: Describe Customer Perspective (cont.)
Unique Objectives and Measures
Space to add your own unique Customer objectives and measures if desired. Note that you will NOT be reporting the actual data collected for these measures on this form. These data will be part of your ASA Final Presentation.
Customer PerspectivePerformance Measure
Customer satisfaction ratings from the ORS Customer Scorecard for each Discrete Service
Customer segmentation of Discrete Services
Increase customer satisfaction
Performance Objective
Increase understanding of customer base
![Page 46: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/46.jpg)
46
ORS ExampleCustomer Measures from 2001 ASAs
• Number/type of customer complaints (DSS)• Rate of acquisition of new customers (VRP)• Increase market share of NIH customers (SEIB)• Customer retention by NIH IC (DSS)• Growth in users of Facilities Information Management
System (OFP)
![Page 47: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/47.jpg)
47
Step 6: Describe the Internal Business Process Perspective
Common Objectives and Measures
The first common measure for the Internal Business Process Perspective asks your team to complete process maps of your Service Group/Discrete Services. Process Map training and consultant support are available.
Performance Objective Performance MeasureInternal Business Process Perspective
Complete process maps of Service Group/Discrete Services
Identify and report on process measures for Discrete Services
Increase understanding of processes.
Identify methods to measure processes.
![Page 48: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/48.jpg)
48
ORS Example (HR)Process Map of the Staffing Process
![Page 49: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/49.jpg)
49
Step 6: Describe the Internal Business Process Perspective (cont.)
Common Objectives and Measures
The second common measure for the Internal Business Process Perspective asks you to indicate and report on process measures. These measures will be easy to identify once completing your process maps.
Performance Objective Performance MeasureInternal Business Process Perspective
Complete process maps of Service Group/Discrete Services
Identify and report on process measures for Discrete Services
Increase understanding of processes.
Identify methods to measure processes.
![Page 50: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/50.jpg)
50
ORS ExampleProcess Measures from 2001 ASAs
• Cycle time from customer request to providing of work (Locksmith)
• Time between customer order and delivery of product (MAPB)• Percent of equipment stock that is rented (SEIB)• Number of unscheduled repairs (PWB)• Number of billing transactions processed with errors (VRP)• Percent of notification memos sent out within 1 week (OFP)• Problem resolution of help desk requests (ITB)• Number of facility deficiencies (VRP)• Percent errors found in radioactive materials inventory (DS)
![Page 51: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/51.jpg)
51
ORS Example (VRP)Standard Holding Days for Acute/Intensive Care
Sample XmR Chart
Individual Values: Standard Holding Days
1,101
1,601
2,101
2,601
3,101
3,601
4,101
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep
Period
Nu
mb
er
of
Ho
ldin
g D
ays
UCL = 3,839
LCL = 1,607
Average = 2,723
FY00 FY01
= Signals
Moving Range: Standard Holding Days
0
200
400
600
800
1000
1200
1400
1600
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep
Month
Nu
mb
er
of
Ho
ldin
g D
ays UCL = 1,371
Average = 420
FY00 FY01
From VRP ASA in 2001.
![Page 52: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/52.jpg)
52
Step 6: Describe the Internal Business Process Perspective (cont.)
Unique Objectives and Measures
Space to add your own unique Internal Business Process objectives and measures if desired. Note that you will NOT be reporting the actual data collected for these measures on this form. These data will be part of your ASA Final Presentation.
Performance Objective Performance MeasureInternal Business Process Perspective
Complete process maps of Service Group/Discrete Services
Identify and report on process measures for Discrete Services
Increase understanding of processes.
Identify methods to measure processes.
![Page 53: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/53.jpg)
53
Step 7: Describe the Learning and Growth Perspective
Common Objectives and Measures
Four common measures for Learning and Growth have been identified for the objective “Enhance quality of work life for employees in ORS.” This information will be provided by HR at the Service Group level for analysis and interpretation by your ASA Team.
Turnover
Maintain & enhance competencies for the future organization.Analysis of Readiness Index
Performance Objective
Awards/Recognition
Contacts/Complaints with EEO/ER/ADR
Sick Leave Usage
Enhance quality of work life for employees in ORS.
Learning and Growth PerspectivePerformance Measure
![Page 54: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/54.jpg)
54
Step 7: Describe the Learning and Growth Perspective (cont.)
The second common measure for the Learning and Growth Perspective is analysis of data provided by the Readiness Index, a tool to help you with work force planning. HR will be developing the Readiness Index and it will be distributed to all ASA Teams for their use.
Common Objectives and Measures
Turnover
Maintain & enhance competencies for the future organization.Analysis of Readiness Index
Performance Objective
Awards/Recognition
Contacts/Complaints with EEO/ER/ADR
Sick Leave Usage
Enhance quality of work life for employees in ORS.
Learning and Growth PerspectivePerformance Measure
![Page 55: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/55.jpg)
55
Step 8: Describe the Financial Perspective
Common Objectives and Measures
The first common measure for the Financial Perspective is analyzing and understanding changes in the unit cost for each Discrete Service in your Service Group. More detailed information will be provided by OBSF on how to gather and analyze this data.
Minimize unit cost at a defined service level.
Performance Objective Performance Measure
Financial Perspective
Change in Unit Cost for each Discrete Service
Actual assets utilized/planned asset utilization for each Discrete ServiceMaximize utilization of assets.
![Page 56: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/56.jpg)
56
Step 8: Describe the Financial Perspective (cont.)
Common Objectives and Measures
The second common measure in the Financial Perspective is analyzing actual assets utilized compared to planned asset utilization for each Discrete Service. More detailed information will be provided by OBSF on how to gather and analyze this information.
Minimize unit cost at a defined service level.
Performance Objective Performance Measure
Financial Perspective
Change in Unit Cost for each Discrete Service
Actual assets utilized/planned asset utilization for each Discrete ServiceMaximize utilization of assets.
![Page 57: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/57.jpg)
57
Step 8: Describe the Financial Perspective (cont.)
Unique Objectives and Measures
Space to add your own unique Financial objectives and measures if desired. Note that you will NOT be reporting the actual data collected for these measures on this form. These data will be part of your ASA Final Presentation.
Minimize unit cost at a defined service level.
Performance Objective Performance Measure
Financial Perspective
Change in Unit Cost for each Discrete Service
Actual assets utilized/planned asset utilization for each Discrete ServiceMaximize utilization of assets.
![Page 58: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/58.jpg)
58
ORS ExampleFinancial Measures from 2001 ASAs
• Sales data by fiscal year (DSS)• Percent variation between budgeted and actual expenditures
(OD)• Comparison of in-house cost to commercial cost (MAPB)• Revenue generated from equipment sales/rental to other
Government Agencies (SEIB)• Amount of late fees and penalties paid per month (PWB)• Percent change in operation expenses (VRP)• Number of code-required design changes identified in reviews
(DES)• Actual costs/sq ft compared to contracted costs/sq ft (DCAB)
![Page 59: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/59.jpg)
59
ORS ExamplePrinting Sales Data by Fiscal Year
![Page 60: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/60.jpg)
60
Step 9: Submit ASA Template to Division/Office Director
• Due date of 30 May• Seek review of your work thus far• Provide approval that moving in the right direction• Give senior leaders opportunity to be involved in
performance measurement process• Make revisions to template based on feedback
![Page 61: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/61.jpg)
61
Step 10: Submit ASA Template to OQM
• Due date of 14 June• Submit completed ASA Template file (Excel) to Gay
Presbury [email protected]
• OQM and Consultants will review Ask questions if necessary Provide team with feedback Provide senior leadership with status report on
how ASA effort is proceeding
![Page 62: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/62.jpg)
62
Next Steps
• Complete ASA Template 30 May - to Division/Office Head 14 June - to OQM
• Take process mapping training Map Service Group Process, Discrete Services Identify process measures
• Set up data collection methods Complete ASA Implementation Plan Gather data Analyze data
• Take additional trainings Data Analysis and Graphing Customer Measurement Process Behavior Charts
• Complete ASA Final Presentation 22 Oct - to Division/Office Head 6 Nov - to OQM 18 Nov - ASA Conference
![Page 63: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/63.jpg)
63
Conclusions
• ASA provide framework to tie strategy, performance measurement, and process improvement together
• Made improvements in ASAs since FY01 Organized ASAs at the Service Group level Came up with common performance objectives and
measures for all ASA Teams Developed ASA-related trainings Implemented Web page for information/communication
• ORS leadership is expecting significant progress in 2002
Performance measurement is not going away ORS facing increasing “competitive” environment Must gauge how well meeting customer needs Implement culture that manages and improves through the
use of data
![Page 64: 1 Annual Self-Assessment (ASA) Template Training Office of Quality Management Office of Research Services National Institutes of Health 21 March 2002.](https://reader037.fdocuments.in/reader037/viewer/2022110403/56649e675503460f94b633d0/html5/thumbnails/64.jpg)
64
Resources• Kaplan, R. S., & Cooper, R. (1998). Cost & effect. Boston, MA: Harvard Business School Press.
• Kaplan, R. S., & Norton, D. P. (2000). Having trouble with your strategy? Then map it. Harvard Business Review On Point, Product Number 5165.
• Kaplan, R. S., & Norton, D. P. (1996). The balanced scorecard. Boston, MA: Harvard Business School Press.
• Kaplan, R. S., & Norton, D. P. (1992). The balanced scorecard—measures that drive performance. Harvard Business Review On Point, Product Number X92105.
• Kaplan, R. S., & Norton, D. P. (1993). Putting the balanced scorecard to work. Harvard Business Review On Point, Product Number X93505.
• Kinlaw, D. C. (1992). Continuous improvement and measurement for total quality: A team-based approach. San Diego, CA: Pfeiffer & Company.
• National Institutes of Health. (2001). Government Performance and Results Act (GPRA), Final FY 2001 GPRA Annual Performance Plan. Bethesda, MD: Author. (Available at: http://www1.od.nih.gov/gpra/gpra_nih_c.htm).
• Office of Management and Budget. (1993). Government Performance and Results Act. Washington, DC: Author. (Available at: http://www.whitehouse.gov/omb/mgmt-gpra/index.html).
• Performance-Based Management Special Interest Group. (1995). How to measure performance – A handbook of techniques and tools. Washington, DC: U.S. Department of Energy. (Available at: http://www.orau.gov/pbm/documents/ documents.html).
• Performance-Based Management Special Interest Group. (2000). The performance-based management handbook, Volume 2: Establishing an integrated performance measurement system. Washington, DC: U.S. Department of Energy. (Available at: http://www.orau.gov/pbm/documents/documents.html).
• Rogin, Ronne. (2001). Performance-based service contracting. Washington, DC: Department of Treasury.
• Wheeler, D. J. (2000). Understanding variation: The key to managing chaos. Knowville, TN: SPC Press.
• Wheeler, D. J., & Poling, S. R. (1998). Building continual improvement: A guide for business. Knoxville, TN: SPC Press.