Quality Assurance Plans (QAP) Presentation to: KWWOA April 9, 2014 Department for Environmental...
-
Upload
frederick-hoover -
Category
Documents
-
view
246 -
download
0
Transcript of Quality Assurance Plans (QAP) Presentation to: KWWOA April 9, 2014 Department for Environmental...
Quality Assurance Plans (QAP)
Presentation to:
KWWOA
April 9, 2014
Department for Environmental ProtectionEnvironmental & Public Protection Cabinet
To Protect and Enhance Kentucky’s Environment
2
Quality Assurance Plan (QAP)
• QAP – A Quality Assurance Plan, also known as a Quality Assurance Project Plan (QAPP) documents the planning, implementation, and assessment procedures for a particular project, as well as any specific quality assurance and quality control activities.
QAP Requirements
The following items shall be addressed in the laboratory QAP:
1. Laboratory organization and responsibility
2. Process used to identify clients’ data quality objectives (DQO);
3. SOPs with dates of last revision;
4. Field sampling procedures;
3
4
QAP Requirements (cont)
5. Laboratory sample receipt and handling procedures; including corrective action;
6. Instrument calibration procedures (may reference an SOP);
7. Analytical procedures (may reference an SOP);
8. Data reduction, validation, reporting and verification (may reference an SOP);
5
QAP Requirements (cont)
9. Type of quality control checks, the frequency of their use and acceptance criteria(may reference an SOP);
10. List schedules of internal and external system and data quality audits and inter-laboratory comparisons (may reference an SOP);
6
QAP Requirements (cont)
11. Preventive maintenance procedures and schedules;
12. Corrective action contingencies;
13. Record keeping procedures and retention policy;
14. Training.
Section Elements of a
Quality Assurance Plan
7
Organization and Responsibility• Chart or table showing lab organization and lines of
responsibility, including QA managers• List of key individuals responsible for production of
valid results & routine assessment of the quality system• Reference to job description of staff (key personnel)• Describe training provided to keep personnel, include
updates to regulations and methodologies• Documentation of staff proficiency (MDL study & IDC)
8
Process Used to Identify DQOs• State the problem• Identify the decision• Identify the inputs to the decision• Define the boundaries of the study• Develop a decision Rule• Specify tolerable limits on decision errors• Optimizing the design
9
SOPs – Date and Last Revision• SOPs must accurately reflect all phases of
current laboratory’s activities• List of all SOPs and their effective dates• Current copies stored in laboratory & in
Quality Assurance Manager’s files• SOPs are reviewed annually & revised as
changes to procedure are made• SOPs have signature pages and revisions date
10
Field Sampling Procedures• Sample collectors• Sampling procedures & location(s)• Required preservatives• Proper containers• Sample container cleaning• Holding times from collection to analysis• Sample shipping & storage
11
Sample Receipt/Handling Procedure• Laboratory notebooks must be filled out in
indelible ink, entries dated & signed (electronic versions are acceptable)
• Samples stored at proper temperature, isolated from laboratory contaminants, standards and highly contaminated samples (WW / DW stored apart)
• Holding times are not exceeded
12
Receipt/Handling Procedure (cont)• Sample integrity is maintained by tracking
samples from receipt by laboratory through analysis to disposal – internal sample tracking document
• Chain-of-Custody procedures for all samples• Criteria for flagging or rejection of samples• Description of how samples are checked and
how checks are documented when received.
13
Instrument Calibration Procedure• Specify type of calibration used for each
method & frequency of use• Describe calibration standards source, age,
storage & labeling• Data comparability checks• Use control charts or trend analysis of QC
results• Ensure acceptance criteria met
14
Analytical Procedure• Cite complete reference method• Describe QC procedures required by the
methods that must be followed
15
Data Reduction, Validation, Reporting and Verification
• Data reduction process & method of conversion of raw data to required reporting limit (RRL)
• Data validation process & frequency of review• Reporting procedures, include procedures &
format(s)• Data verification process & frequency of review• Procedure for data corrections• Electronic reporting and LIMS reports
16
Chemistry QC Checks• Instrument performance check standards• Frequency & acceptability of method detection limit
(MDL) calculations• Frequency & acceptability of demonstration of low
level capability (MRL/RLS)• Calibration (incl. internal & surrogate standards)• Laboratory reagent blank, field reagent blank & trip
blank• Field & laboratory matrix replicates
17
Chemistry QC Checks (cont)• Quality control & Proficiency Test (PT) samples• Laboratory fortified blank & lab fortified sample
matrix replicates• Initial demonstration of method capability (IDC)• On-going demonstration of method capability
(ODC)• Use of control charts (for trend analysis)• Qualitative identification/confirmation of
contaminants
18
Micro QC Checks• Positive/Negative culture controls• Confirmation/verification of presumptive total
Coliform positive samples• Sterility controls• PT samples and QC samples
19
QAP Internal Audit & Schedule• Internal & external system audits• Data quality audits• Internal laboratory comparisons
20
Preventative Maintenance• Location of instrument manuals & schedules• Documentation of routine equipment
maintenance• List of maintenance contracts in place• Laboratory procedures to ensure sample
holding times are met – such as redundant instrumentation and/or contracts with other certified laboratories
21
Corrective Action• Response to unacceptable results from analysis
of PT samples & from internal QC checks, including schedule
• Position titles of individuals responsible for various corrective actions
• How corrective actions taken are documented and schedule of completion verified
22
Record Keeping• Procedures & documentation of record
keeping and procedures• Security policy of electronic databases• Record retention policy including backup
procedures
23
QAP Template• Field-only Laboratory QAP• Field-only Laboratory SOP
• General Laboratory QAP• General Laboratory SOP
• Available on KY Lab Certification Websitehttp://water.ky.gov/permitting/Pages/labcert.aspx
24
Questions
?
25
Contact InformationPatrick J. Garrity
Laboratory Certification OfficerDivision of Water
200 Fair Oaks Lane; 4th FloorFrankfort, KY 40601
Phone: (502) 564-3410Fax: (502) 564-2741
Email: [email protected]
http://water.ky.gov/permitting/Pages/labcert.aspx
26
Wastewater Quality System Tools• EPA Requirements for Quality Assurance Project
Plans (QA/R-5);• Guidance for Quality Assurance Project Plans (G-
5);• EPA Requirements for Quality Management Plans
(QA/R-2);• Guidance for Developing Quality Systems for
Environmental Programs (QA/G-1);• http://www.epa.gov/quality/qa_docs.html.
27
Updated Quality System Tools• EPA Quality Standard for Environmental Data
Collection, Production, and Use by non-EPA (External) Organizations (CIO Standard 2106-S-02) – DRAFT–Replaces QA/R-2 – QMPs–Replaces QA/R-5 – QAPPs
• CIO Guidance 2106-G-05 QMP (Draft)• Handbook for Developing QAPPs (Draft)
Specific Information
The following slides provide specific information to the reader for each of the major
topics required in the Laboratory Quality Assurance Plan.
29
30
Laboratory Organization and Responsibility
• A chart or a table showing the laboratory organization and lines of responsibility, including QA managers;
• List the key personnel who are responsible for ensuring the production of valid measurements and the routine assessment of measurement systems for precision and accuracy(e.g. who is responsible for internal audits and reviews of the implementation of the plan and its requirements);
31
Laboratory Organization and Responsibility
• Reference the job descriptions of the personnel and describe training to keep personnel updated on regulations and methodology, and document that laboratory personnel have demonstrated proficiency for the methods they perform(e.g. MDL Study, IDC, and ODC annually).
Laboratory Organization and Responsibility
Why is it Important?
To ensure all key project personnel are aware of their responsibilities and the timeframe for completion.
32
33
Process Used to Identify Clients’ Data Quality Objectives
An example:• Step 1: State the Problem• Step 2: Identify the Decision• Step 3: Identify the Inputs to the Decision• Step 4: Define the Study Boundaries• Step 5: Develop a Decision Rule• Step 6: Specify Tolerable Limits on Decision Errors• Step 7: Optimize the Design
34
Process Used to Identify Clients’ Data Quality Objectives
Why is it Important?
To provide sufficient information as a foundation for the project goals and to clarify the expected uses of the data.
DQO Process
35
36
SOPs with Dates of Last Revision• The laboratory shall maintain SOPs that
accurately reflect all phases of the current laboratory activities;
• A list of SOP’s and their effective dates;• Ensure that current copies of SOPs are in the
laboratory and in the QA manager files;• Ensure that SOPs are reviewed annually and
revised as changes to the procedure are made;
37
SOP’s Cont.• Ensure that SOPs have signature pages and
revisions dates;• Ensure that SOPs are read, understood, and
utilized by all applicable laboratory personnel.
38
SOP’s Cont.
Why is it Important?
To be sure that all personnel are doing things the same way and are following the most recent procedural updates.
39
Field Sampling Procedures• Describe the process used to identify sample
collectors, sampling procedures and locations, required preservative, proper containers, correct sample container cleaning procedures, sample holding times from collection to analysis, and sample shipping and storage conditions;
40
Field Sampling Procedures Cont.• Ensure that appropriate forms are legibly filled
out in indelible ink or hardcopies of electronic data are available;
• Ensure that sampling protocol is written and available to samplers.
41
Field Sampling Procedures Cont.Why is it Important?
To ensure that appropriate sampling methods are selected to meet project needs and produce data of sufficient quality for project decision making.
42
Sample Receipt and Handling Procedures
• Bound laboratory notebooks shall be filled out in indelible ink, entries dated and signed (electronic records are acceptable);
• Store unprocessed and processed samples at the proper temperature, isolated from laboratory contaminants, standards and highly contaminated samples. Holding times shall not be exceeded;
43
Sample Receipt and Handling Procedures Cont.
• Maintain integrity of all samples (e.g. by tracking samples from receipt by laboratory through analysis to disposal – internal sample tracking document);
• Require Chain-of-Custody (COC) procedures for all samples;
44
Sample Receipt and Handling Procedures Cont.
• Specify criteria for rejection of samples that do not meet shipping, holding time and/or preservation requirements and procedures for notification of sample originators (client/customer or field sampling contractor);
• Describe how samples are checked when they arrive for proper containers and temperature and how samples are checked for proper preservative before analysis.
45
Sample Receipt and Handling Procedures Cont.
Why is it Important?
To ensure sample authenticity and to avoid sample loss.
46
Instrument Calibration Procedures (may reference an SOP)
• Specify type of calibration used for each method and frequency of use;
• Describe calibration standard’s source, age, storage, labeling;
• Perform data comparability checks;• Use control charts for calibration check
standards to monitor for trends and ensure acceptance criteria are met or utilize acceptance criteria specified in QAP/SOP .
47
Instrument Calibration Procedures (may reference an SOP)Why is it Important?
To avoid poor instrument performance that could impact project data quality.
48
Analytical Procedures (may reference an SOP)
• Cite complete method reference;• Describe quality control procedures required
by the methods that shall be followed and specify acceptance limits; include what to do if outside of the set limits.
49
Analytical Procedures (may reference an SOP)
Why is it Important?
To be methods are being followed as written and can achieve project quality objectives.
50
Data Reduction, Validation, Reporting and Verification (may reference an SOP)
• Describe data reduction process; method of conversion of raw data to required reporting limits;
• Describe data validation process and frequency of review;
• Describe reporting procedures; include procedures and format(s);
• Describe data verification process and frequency of review;
• Describe procedure for data corrections.
51
Data Reduction, Validation, Reporting and Verification (may reference an SOP)
Why is it Important?
To ensure data integrity.
Type of QC Checks and the Frequency of Their Use (may reference an SOP)
For Chemistry and Radiochemistry:• Instrument performance check standards;• Frequency and acceptability of MDL calculations;• Frequency and acceptability of demonstration of
low level capability;• Calibration, internal and surrogate standards;• Laboratory reagent blank, field reagent blank and
trip blank;• Field and laboratory matrix replicates;
52
Type of QC Checks and the Frequency of Their Use (may reference an SOP) Cont.
• Quality control and Proficiency Test samples;• Laboratory fortified blank and laboratory fortified
sample matrix replicates;• Initial demonstration of method capability;• On-going demonstration of method capability;• Use of control charts or acceptance criteria;• Qualitative identification/confirmation of
contaminants.
53
Type of QC Checks and the Frequency of Their Use (may reference an SOP) Cont.
For Microbiology:• Positive and negative culture controls;• Confirmation/verification of presumptive total
Coliform positive samples;• Sterility controls;• Proficiency Test samples and quality control
samples.
54
Type of QC Checks and the Frequency of Their Use (may reference an SOP) Cont.
Why is it Important?
To provide confidence that the project data are of suitable quality to be used for their intended purpose.
55
System and Data Quality Audits and Inter-laboratory Comparisons (may reference an SOP)
• Can be internal audits by the QA Officer or external audits by a third party;
• After audits be sure to create a feedback loop to employees to let them know what deficiencies were found and how to correct them or to let them know where they are exceeding expectations.
56
System and Data Quality Audits and Inter-laboratory Comparisons (may reference an SOP)
Why is it Important?
To directly test that the SOP’s are being followed as written and that the results produced are of a known quality.
57
Preventive Maintenance Procedures and Schedules
• Describe location of instrument manuals and schedules and documentation of routine equipment maintenance;
• List any maintenance contracts in place;• Describe laboratory procedure to ensure
sample holding times are met (e.g. redundant instrumentation, contracts with other laboratory facilities, etc).
58
Preventive Maintenance Procedures and Schedules
Why is it Important?
To avoid poor instrument performance that could impact project data quality.
59
Corrective Action Contingencies• Describe response to obtaining unacceptable
results from analysis of PT samples and from internal QC checks;
• Position titles of individuals responsible for the various corrective actions;
• Describe how corrective actions taken are documented.
60
Corrective Action Contingencies
Why is it Important?
To be sure that if there is a failure in the analytical system, the people responsible for the corrective action know how to implement it how to document the process.
61
Record Keeping Procedures• Describe procedures and documentation of
those procedures;• Describe security policy of electronic
databases, include the storage and backup procedures of the electronic databases;
• All electronic data should have software support so it may be regenerated.
62
Record Keeping ProceduresWhy is it Important?
To ensure data integrity.
63