Metrology Laboratories Workshop - Rabat, Centre National pour la Recherche Scientifique et Technique...

Metrology Laboratories Workshop - Metrology Laboratories Workshop - Rabat, Centre Rabat, Centre National pour la Recherche Scientifique et National pour la Recherche Scientifique et Technique (CNRST)Technique (CNRST)

Provision of Interlaboratory Comparisons in

Calibration

Provision of Interlaboratory Comparisons in

CalibrationRobert Benyon, INTA

Metrology and Calibration Centre

Torrejon de Ardoz. (Madrid) Spain.

MIRA Workshop - Rabat - 2011Proficiency Testing: Calibration

Robert Benyon

SummarySummary

• What are interlaboratory comparisons?• What is their purpose?• Who needs them?• How do they work?• Why an accredited provider?• Why start in the Madrid Region?• Why INTA?• How was the accreditation process?• Scope of the service• Recognition of technical competence• Acknowledgements


Robert Benyon

What are interlaboratory comparisons?What are interlaboratory comparisons?

• “Organization, performance and evaluation of measurements or tests on the same or similar items by two or more laboratories in accordance with predetermined conditions” ISO 17043:2010

REF1

REF2

LAB3

LAB1 LAB

5LAB2

LAB7

LAB6

LAB8LAB4

Loop 1

Loop 2

A powerful QC tool

• Proficiency testing: “Evaluation of participant performance against pre-established criteria by means of interlaboratory comparisons


Robert Benyon

What is their purpose?What is their purpose?

• The typical objectives of interlaboratory comparisons include:

a) The evaluation fo the performance of laboratories in specific measurements and monitoring their capabilities as a function of time;

b) Detection of problem in laboratories and initiating improvements (measurement procedures, effectiveness of technical staff training andsupervision, or equipment calibration;

c) Establishing the effectiveness and comparability of measurement methods;

d) Providing additional confidence to laboratroy customers;

e) Identifying differences between laboratories;

f) Education of participating laboratories based on the resultsof the exercise;

g) Validation of declared uncertainties


Robert Benyon

What is their purpose?What is their purpose?

• Other objectives include:

h) The evaluation of the performance of a method – often described as collaborative trials;

i) Assignment of values to reference materials and evaluation of adequacy for use in specific tests or procedures;

j) Support of Mutual Recognition Arrangements for the equivalence of measurements performed by NMI and DI (Key and Supplementary Comparisons) organized under the auspices of the CIPM-MRA.


Robert Benyon

Who needs them?Who needs them?

• The controls include participation in interlaboratory comparisons

• Those who wish to compare their results with similar laboratories, monitor their results over time, detect tendencies and consider necessary preventive or corrective.

• All laboratories that wish to meet the requirements of ISO/IEC 17025:2005 (Section 5.9.1)

• The laboratory shall have quality control procedures for monitoring the validity of tests and calibrations undertaken.”


Robert Benyon


• ENAC: In additon to other actividades performed to check the validity of the calibration results:

• The Laboratory mustt participate regularly in interlaboratory comparisons that cover all the families in the scope of accreditation.

• Must have policies and procedures that ensure the participation in these comparisons and establish the method and responsibilities for evaluationg the results.

• All laboratories that wish to comply with ILAC and (in Spain, ENAC) requirements:

• ILAC R103 – GENERAL REQUIREMENTS: PROFICIENCY TESTING FOR ISO/IEC 17025 LABORATORIES


Robert Benyon


• The Laboratory must establish:

• A program for participation in interlaboratory comparisons

– That covers at least the period between re-evaluations

– Establishes the frequency of participation for each family.

• The policies and procedures must take into account the requirements of document NT-03 “ENAC policy on interlaboratory comparisons”.


Robert Benyon

How do they work?How do they work?

Development in 5 phases:

Planning Preparation Measurements Evaluation Closure


Robert Benyon

Planning.. The most importantPlanning.. The most important

EXERCISE DESIGN

Bi annual planCustomer requests

PREPARATION OF:•Draft Protocol•Travelling standard•Database of potential customers•Calibration request of transfer standard•Communication of ILC• Letter of presentation• Request form

ANNOUNCEMENT RECEIPT OF REQUESTS EVALUATION OF

REQUESTSCLOSING OF CALENDAR AND NUMBER OF PARTICIPANTS

COMMUNICATION OF ACCEPTANCE AND SENDING OF DRAFT PROTOCOL¿ALEGATIONS?

AGREEMENT ON PROTOCOL TRANSPORT CONTRACTKICK-OFF MEETING

¡DECISION TO START!

NO

START

A

SI


Robert Benyon

Why an accredited provider?Why an accredited provider?

• In order that the comparison gives its full potential for improvement and control for the laboratory, it is essential that all the process (prep./transport/evaluation.) high level of technical competence.

• The participation in exercises that do not guarantee this level is an expense of time and money that must be avoided at all cost.

• The laboratories thar use an accredited provider do not need to develop a methodology or invest resources to evaluate their suppliers, as they can have confidence in the evaluation performed by the accreditation body.

• As the evaluation is performed by expert professionals, it contributes to increase the level of quality of the existing programmes and hence, confidence in results.


Robert Benyon

Why start in the Madrid Region?Why start in the Madrid Region?

• The Madrid Region has a high number of calibration laboratories that have implemented ISO/IEC 17025:2005 and are accredited or in the process of being accredited by ENAC.

• The inexistence in Spain of an accredited provided of comparisons in calibration.

• Thus, these laboratories had a serious problem in meeting in a planned form the obligations with respect to participations in comparisons, due to the lack of offer of this type of service.

• The Madrid Laborarory Network had a calibration laboratory that fulfilled the necessary requirements to develop this service.


Robert Benyon

Why INTA?Why INTA?

• Has sufficient techically competent staff to take decisions that affect the development and design of interlaboratory comparion programmes (in order to evaluate the technical competence of the laboratory of a supplier, the prior accreditation of the laboratory to ISO/IEC 17025:2005 serves as the basis of demonstrating comptence).

• Ensures protection of confidential information an property rights of the participants in intercomparison programmes;

• Avoids participation in any activity that can risk confidence in its competence, imparciality, judgement or integrity of its operation;

• Has the necessary equipment to perform the comparisons.


Robert Benyon

Why INTA?Why INTA?

• INTA is the Public Research Body accredited by ENAC with the broadest CMC in calibración available in the Madrid Region and with the greates proven experience in accredited calibration (see scopes at http://www.enac.es).

• INTA has participated actively and continuosly in the training of students that upon leaving the Institute have joined the laboratories in the private sector in the Madrid Region, helping them to comete and offer a qualtity service to industry, satisfying the expectations.

• As a highly technological member of the Madrid Laboratory Network, it offers a service ofr quality and technical competence with impartiality to the greatest number of industrial clients in diverse sectors.

• Has the required technical level to satisfy the requirements of all the laboratories in the Madrid Region in the quantities and ranges for which it is accredited.

• Has proven experience in the types of instrumentation in general use in industry.


Robert Benyon

The process…The process…

• Oct. 2005 Idea of SPI arises from the increased QA requirements and lack of providers in calibration. Suggested as interesting activity for IV PRICIT.

• 2006-2008 Internal project PDS06001 developed in INTA with financial contribution from IV PRICIT.

• 2008-2010 ENAC Accreditation process


Robert Benyon

How was the accreditation process?How was the accreditation process?

• Jul. 2008 Meeting with ENAC to launch the idea of accreditation of INTA as Intercomparison Service Provider

• Oct. 2008 Initial visit by ENAC

• Nov. 2008 Internal audit of INTA-SPI by external consultant

• Dec. 2008 Initial ENAC assessment. Result: 7NC y 10OBS

• Jun. 2009 Corrective Action Plan prepared and submitted

• Jul. 2009 C.A. 27/09 agreement 27: extraordinary assessment.

• Nov. 2009 Extraordinary assessment. Result: 3 NC y 8 OBS

• Jan. 2010 Corrective Action Plan prepared and submitted

• Mar. 2010 ISO 17043:2010 comes into force

• May. 2010 C.A. 20/10 agreement 67: ACREDITATION


Robert Benyon

Scope of the serviceScope of the service

Present: • Scope limited to comparisons where INTA MCC is Pilot

Laboratory.

Future: • Extend Scope to other services as required by

laboratories.


Robert Benyon

Recognition of technical competence

Recognition of technical competence

• The Spanish Accreditation Body, ENAC, has granted Instituto Nacional de Técnica Aeroespacial (INTA), accreditation as an interlaboratory comparison provider in calibration.

• This accreditation recognizes the technical competence of SPI (Intercomparison Service Provider) of INTA, for the organization of interlaboratory comparisons in calibration, for the measurement quantitiese: radio frequency, electricity, pressure, mass, temperature, flow, viscosity and density.

3 / PPI 006

See current scope: http://www.enac.esISO

17043:2010


Robert Benyon

AcknowledgementsAcknowledgements

• LABORATORY: CMT: Provider of proficiency testing within laboratories of the Madrid Region Network- Intercomparisons.

• CODE: IT0517 IV Regional Plan of Scientific Research

and Techical Innovation

(IV PRICIT)2005-2008

Metrology Laboratories Workshop - Rabat, Centre National pour la Recherche Scientifique et Technique...

Documents

Transcript of Metrology Laboratories Workshop - Rabat, Centre National pour la Recherche Scientifique et Technique...