PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10....

31
1 ISO Guide 80 Training REMCO ISO Committee on Reference Materials ISO Guide 80 Guidance for the in-house preparation of quality control materials (QCMs) Angelique Botha NMISA

Transcript of PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10....

Page 1: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

1 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

REMCO ISO Guide 80

Guidance for the in-house

preparation of quality control

materials (QCMs)

Angelique Botha

NMISA

Page 2: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

2 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

ISO/REMCO ISO Committee on Reference Materials

Carries out and encourages a broad international effort for the harmonisation and promotion of reference materials, their production and their application.

REMCO’s vision is to be the global centre of excellence with respect to issues relating to reference materials.

Page 3: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

3 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

The REMCO Family of Guides

ISO Guide 34 – covering the required “competence of RM producers”

ISO Guide 80

On “minimum requirements for in-house preparation of

RMs for quality control

ISO Guide 35

On “characterisation and certification of RMs”

ISO Guide 33 on uses of RMs

(incl. calibration, method validation & verification, control charts, value transfer, PTs...)

ISO Guide 31 on accompanying documentation for RMs

(content of certificates / RM labels / statements / transport docs, etc.)

ISO Guide 30 on definitions and terminology related to RMs (incl. a thesaurus)

The reference for

accreditation

Page 4: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

4 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

REMCO Outline

Introduction to ISO Guide 80

Structure

Summary

Page 5: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

5 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

REMCO Introduction

Reference materials (RMs) are widely used in measurement laboratories for a variety of purposes.

The preparation of reference materials for metrological quality control (i.e. control of the quality of measurements not products) is an important activity.

Such materials do not require characterisation by metrologically (i.e. SI traceable) valid procedures, and is usually prepared “in-house”, i.e. by laboratory staff familiar with the behaviour of the materials and the specific quality control requirements.

Page 6: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

6 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

REMCO Why QCMs?

The rationale for preparing quality control materials can be one or a combination of the following factors:

to have a RM representing as closely as possible routine samples, suitable for quality control;

to have a suitable day-to-day RM to complement a commercially available CRM;

no suitable CRM exists;

the application does not require a material having the full characteristics of a CRM (e.g. traceability and uncertainty).

Page 7: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

7 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

4 Quality control materials (QCMs) (1)

“Quality Control Material” or “QCM” – definition specifically for this Guide, not intended to define a new class of reference materials.

These materials have several other names in the open literature, such as “in-house reference materials”, “QC samples”, “check samples”, “set up samples”, etc.

Where no suitable CRM exists, laboratories may use QCMs to provide an assessment of the repeatability / intermediate precision / reproducibility of a measurement result.

QCMs cannot be used to establish metrological traceability or trueness of a measurement result.

Page 8: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

8 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

4 Quality control materials (QCMs) (2)

QCMs should always comply with the basic requirements of any reference material, i.e. they should be sufficiently homogeneous and stable with respect to the properties of interest.

The level of heterogeneity should be less than the expected standard deviation of the measurement process or an established criterion value against which the assessment of laboratory performance or the “normalisation” of results is acceptable.

The QCM should be stable for a period of time that is at least as long as that during which it is intended to be used.

Page 9: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

9 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

5 Applications of quality control materials (1)

The principal function of QCMs is to provide laboratories with an economical means of checking their routine test procedures for precision on a regular basis (e.g. daily, weekly or monthly).

While CRMs can in all cases replace QCMs, QCMs are NOT replacements for CRMs.

Page 10: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

10 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

5 Applications of quality control materials (2)

Uses of QCMs include (but are not limited to):

preparation of QC charts

comparison of results

method development

instrument performance checks

repeatability and reproducibility studies

as check samples

checking operator variability

impact of any changes to the environmental conditions

Page 11: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

11 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

5 Applications of quality control materials (3)

Regardless of the intended use, it is required to assess the homogeneity and stability of a QCM[*].

* EMONS, H., T. P J. LINSINGER, B. M. GAWLIK, Reference Materials:

terminology and use. “Can’t one see the forest for the trees?” TrAC Trends Anal. Chem. 23(6), 2004

Page 12: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

12 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

6 Steps in the in-house preparation of quality control materials

The fundamental purpose of QCMs is to detect change.

The production of any reference material requires a level of technical and organisational competence.

The key steps involved in the in-house preparation of a typical QCM are shown on the next slide.

Page 13: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

13 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

QCM Preparation Steps

Material Specification

Material Sourcing

Material Processing

Sub-division & Packaging

Homogeneity Assessment

Characterisation / Value

Assignment

Stability Assessment

Documentation / Information

Storage

Page 14: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

14 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

7 Material specification

The key criteria in the specification and selection of a QCM are for the material to be as close as possible to real samples and available in appropriate quantities.

7.1 Matrix type, matching and commutability

7.2 Properties and property values

7.3 Unit size

7.4 Amount of bulk material

Page 15: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

15 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

8 Preparation of quality control materials

8.1 Sourcing of bulk material – options available:

Excess sample material,

Accurate gravimetric formulation.

Processing the bulk material may be costly?

Liquids easier to prepare than solids.

Page 16: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

16 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

8.2 Material processing

8.2.1 General

8.2.2 Drying

8.2.3 Milling and grinding

8.2.4 Sieving

8.2.5 Mixing and blending

8.2.6 Filtration

8.2.7 Stabilisation

8.2.8 Sterilisation

Page 17: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

17 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

8.3 Sub-division and packaging

8.3.1 General

8.3.2 Choice of containers

8.3.3 Sub-division procedures

Page 18: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

18 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

9 Homogeneity

9.1 Overview

9.2 Analytical approach

Page 19: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

19 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

9.3 Statistical treatment of homogeneity data (1)

Unit number Result 1 Result 2 Mean Variance

mg·kg1 mg·kg1

mg·kg1 mg·kg1

1 121,3 128,74 125,02 27,68

2 120,87 121,32 121,10 0,10

3 122,4 122,96 122,68 0,16

4 117,60 119,66 118,63 2,12

5 110,65 112,34 111,50 1,43

6 117,29 120,79 119,04 6,12

7 115,27 121,45 118,36 19,10

8 118,96 123,78 121,37 11,62

9 118,67 116,67 117,67 2,00

10 126,24 123,51 124,88 3,73

overall mean of 120.02 mg·kg1

Page 20: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

20 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

9.3 Statistical treatment of homogeneity data (2)

110

115

120

125

130

0 1 2 3 4 5 6 7 8 9 10 11

Ch

rom

ium

(m

g.k

g-1

)

Unit

Homogeneity (chromium in soil)

The data from unit 5 requires investigation?

Page 21: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

21 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

9.3 Statistical treatment of homogeneity data (3)

Statistical analysis to determine the within unit and between unit standard deviations. Single factor analysis of variance using spreadsheet software gives the following values:

Source of variation Sum of squares

(SS) Degrees of

freedom Mean squares

(MS)

Between units 284,94 9 31,67

Within unit 74,05 10 7,41

Total 358,99 19

Page 22: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

22 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

9.3 Statistical treatment of homogeneity data (4)

The between unit variance is estimated using:

The between unit standard deviation is the square root of this variance:

The repeatability standard deviation can be computed as:

The result shows a rather high between-bottle heterogeneity which is mainly caused by unit 5. If the heterogeneity is above pre-set limits and if it makes the QCM unsuitable for use, further manipulation of the material may be necessary in order to improve homogeneity

𝑠𝐴2 =

𝑀𝑆𝑏𝑒𝑡𝑤𝑒𝑒𝑛 −𝑀𝑆𝑤𝑖𝑡 ℎ𝑖𝑛𝑛0

=31,67− 7,41

2= 12,13 mg2 . kg−2

𝑠𝑏𝑏 = 12,13 = 3,48 mg. kg−1

𝑠𝑟 = 𝑀𝑆𝑤𝑖𝑡 ℎ𝑖𝑛 = 7,41 = 2,72 mg. kg−1

Page 23: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

23 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

10 Characterisation and value assignment

The purpose of QCMs is to monitor measurement processes for change.

In order to achieve this effectively an indication of the property values of the QCM used to monitor the process is needed. It is also necessary to have an indication of the likely variation in values due to heterogeneity between different aliquots.

An effective way of determining an indicative property value is to use the overall mean derived from the homogeneity study.

The deviation from the mean can be used to establish control chart warning limits.

Page 24: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

24 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

11 Stability (1)

11.1 Overview

Different materials will exhibit different types of (in)stability.

In principle, the approaches to stability testing described in ISO Guides 34 and 35 apply, however….

Adequate stability of QCMs is required.

Careful choice of the container used for the material can address some intrinsic stability issues.

Some materials (e.g. metallurgical materials) are inherently stable, while for others storage at a precautionary low temperature may lengthen the period of stability.

Failures in preparation or unexpected contamination/impurities may impair the stability significantly.

Page 25: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

25 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

11 Stability (2)

11.2 Assessing stability

Full stability assessment for any reference material is a costly, time consuming and involved process…

…and is inappropriate for QCMs as described in this Guide.

However, the financial implications of using QCMs whose property values have changed significantly can be large (e.g. release of out of specification products, or non release of in specification products.

11.3 Assigning an expiry date to a QCM.

The assignment of a formal expiry date is one of the most problematic tasks in reference material production.

Materials which are considered to be inherently stable do not need an expiry date, but a statement of ‘inherent stability’ is

required.

Page 26: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

26 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

12 Transportation

In general, this guidance relates to materials which are prepared and used in the same locality (i.e. not for wider distribution).

However, it is recognised that some materials are inherently stable and their property values will not be adversely impacted by transportation (controlled or otherwise).

Should there be a requirement to transport the material and there is any concern about its stability under transport conditions, a stability assessment following the principles of ISO Guide 35 should be carried out.

Page 27: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

27 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

13 Documentation for reference materials for quality control (1)

13.1 General

13.2 Information to be available with reference materials for quality control

13.3 Labeling of QCM units

13.4 Useful information to be retained

Page 28: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

28 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

14 Storage

14.1 General

14.2 Monitoring of storage conditions

Page 29: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

29 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

15 Using quality control materials

15.1 General

15.2 Minimum sample size

15.3 Mixing procedure

15.4 Dry mass correction

15.5 Storing opened containers of QCMs

Page 30: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

30 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

Summary

ISO Guide 80 describes the requirements for the preparation and characterisation of reference materials used for metrological quality control.

By definition these materials are designed to provide ‘evidence of control’ on a day-to-day basis.

Whilst CRMs can be used for this purpose, it may be more cost effective for the laboratory to use and prepare an ‘in-house’ material.

Establishment of traceability, or a comprehensive uncertainty budget is NOT required for these materials.

An evaluation of the homogeneity and stability is however required.

The examples in the Annexes provide comprehensive real life examples of the preparation of such QCM materials in different fields of application.

Page 31: PowerPoint Presentationnla.org.za/webfiles/conferences/2014/TM2014 proceedings... · 2014. 10. 28. · Title: PowerPoint Presentation Author: granier Created Date: 10/27/2014 11:14:49

31 ISO Guide 80 Training

REMCO – ISO Committee on Reference Materials

Thank You

Acknowledgements:

Dr Steve Wood

John P Hammond

ISO/REMCO