© Crown copyright Met Office Met Office progress report Andy Brown WGNE, Tokyo, October 2010.
© Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.
-
Upload
jordan-lucas -
Category
Documents
-
view
219 -
download
0
Transcript of © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.
![Page 1: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/1.jpg)
© Crown copyright Met Office
Quality assurance approachesPhilip Merritt, Met Office, UK
![Page 2: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/2.jpg)
© Crown copyright Met Office
Aims
To understand the different approaches we have to quality assurance when assessing competence
![Page 3: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/3.jpg)
© Crown copyright Met Office
Objectives
By the end of this session you should be able to:
• Identify the right people to be involved with quality assurance processes
• Know different ways evidence can be standardised
![Page 4: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/4.jpg)
• If there is no formal approach to consistency then there may be differing levels to what assessors are looking for or what happens over time
Why is it important?
© Crown copyright Met Office
Your hired Your fired
![Page 5: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/5.jpg)
Why is it important?
• Therefore we need to find a way that ensures consistency between assessments
• This means consistency in different forms
• over time
• locations
• people
• Any pre-existing documentation setting out what is expected from the standards will help in defining required levels and expectations
© Crown copyright Met Office
![Page 6: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/6.jpg)
What came first......
© Crown copyright Met Office
![Page 7: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/7.jpg)
Who are our subject matter experts?
• Those with suitable qualifications in this subject
• Those with suitable experience in this subject
• A range of people across the subject
• Constantly review this
© Crown copyright Met Office
![Page 8: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/8.jpg)
Who are our assessors?
• In many ways similar to the subject matter experts
• Can be those in certain job roles – team leaders, trainers, managers
• Need to have currency in the subject
• Need to have the expertise but also skilled in areas like feedback
© Crown copyright Met Office
![Page 9: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/9.jpg)
How can we standardise assessments?
Standardisation meetings
• If several people are assessing within your organisation then have occasional meetings
• The assessors look at pieces of evidence and blind mark them
• Try to get agreement over what is deemed as sufficient evidence
• See if the assessments could have been completed in a more thorough way or in a different style
© Crown copyright Met Office
![Page 10: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/10.jpg)
How can we standardise assessments?
Internal Verification
• Identify someone who is the lead assessor or internal verifier
• This person (or persons for larger organisations) can then check consistency
• They can organise and lead standardisation meetings
• They can check a sample of work of other assessors to ensure standards
© Crown copyright Met Office
![Page 11: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/11.jpg)
Improving the process
• The standardised material should be formally documented as part of QMS
• Continuing standardisation and internal verification should help to ensure these have been implemented
• If not, then more formal action should take place to help raise standards and deliver best practice
• Always reflect on are we doing this in the most efficient and practical way
© Crown copyright Met Office
![Page 12: © Crown copyright Met Office Quality assurance approaches Philip Merritt, Met Office, UK.](https://reader036.fdocuments.in/reader036/viewer/2022082422/56649e685503460f94b63bda/html5/thumbnails/12.jpg)
• If we follow these processes we will see this
So hopefully....
© Crown copyright Met Office
Your hired Your hired