NATAUSE OF PROFICIENCY TESTING

IN ACCREDITATION

Selection of program s

Ideally each NATA accredited laboratoryshould participate in proficiency tests ineach major area of testing or calibrationwhen they apply for accreditation and thenagain at appropriate intervals.

NATA program s

NATA conducts PT for calibration andtesting:

Calibration - primarily Measurement Audits

Testing - Interlaboratory Comparisons

Scope of program s

NATA conducts on average

30 interlaboratory programs (testing) peryear

60 Measurement Audits

approximately 1500 participants

All accredited fields are covered except:Forensic ScienceVeterinary ScienceMedicalInspection

Program s com pleted since June 2004

No.# Program Field

454 Metal Alloys/14 (Aluminium) Chemical455 Food/20 (Cheese) Chemical456 National Residue Survey/21 Chemical457 Soils/4 (WA, SA & NT) CMT458 Waters/74 (Total Recoverable Oil & Grease) Chemical459 Pathogens in Food/11 Biological

Program s underw ay

Program Field

CFR (ongoing) ChemicalNational Asbestos Program/23 ChemicalWaters/75 (Phthalate Esters) ChemicalWaters/76 (Mercury, Arsenic, Selenium) ChemicalWaters/77 (Chlorinated Phenoxy Acid Herbicides) ChemicalCoal/20 ChemicalNitrofurans in Honey ChemicalPaint/7 (Gloss Tiles) ChemicalCryptosporidium & Giardia/14 BiologicalLegionella/29 BiologicalWaters (Bio)/24 BiologicalCarcass Hygiene/10 BiologicalRockwell & Vickers Hardness MechanicalMagnetic Particle Inspection NDTRoad Lanterns Optics & RadiometryAggregates/1 (NSW & ACT) CMTNuclear Gauge Calibrators CMT/PDM

New m easurem ent audits underw ay

Artefact Field

Multimeter HP3458A ElectricalHP Power Sensors Models 8481A and 8478B, AttenuatorHP8491C 3dB

Electrical

Comark C9008 temperature indicator HTMPRT 0 - 250°C HTMThermocouple Type 'K' HTMTesto model 610 Hygrometer HTMMass Set Box C PDMPressure Transducer 50 Mpa + Indicator Model 8142 PDMMicrometer External 11-12 inch PDMPressure Balance - Pneumatic (-100 kPa to 3500 kPa) PDMManometer Digital 0-130 kPa (abs) PDM5.7 mm, 8.9 mm, 100 mm setting ring gauges PDMPressure Transducer 50 Mpa + Indicator Model 8142 PDMLoad Cell 50 kN HBM & Toledo Indicator 8124 PDM

NATA Proficiency Testing Policy

NATA considers that the primary function ofproficiency testing is to assess laboratoriesability to competently perform tests and/ormeasurements for which NATA accreditationis held or sought.

Participation

NATA accredited and applicant laboratoriesare normally required to participate in allNATA proficiency testing activity where theprogram or measurement audit offered relatesdirectly to a testing or measurement areacovered by the scope of the laboratory’sscope of accreditation.

Exemptions may be sought from a particularNATA proficiency testing activity, butsubsequent refusal to participate may resultin partial or total suspension of thelaboratory’s scope of accreditation.

In some cases, NATA laboratories may holdmembership with other organisations whichrequire participation in their own programs.

Accredited and applicant laboratoriesshould also participate in other externalproficiency testing programs, particularlywhen they cover tests for whichaccreditation is held or sought.

If the external program has been accreditedto the requirements of ILAC-G13:2000, thensatisfactory participation in this programwill be considered to have satisfied theNATA participation requirements.

PT Policy Perform ance

In all cases prompt feedback on performanceis provided to participating accredited andapplicant laboratories.

If a laboratory’s performance is deemedinadequate, NATA will advise the laboratoryof its poor performance, offer advice whereappropriate and then seek comment on theinvestigative and corrective action taken.

NATA reviews corrective responses andeither:

(a) accept that the problems have beenresolved and require no further action;

(b) take further action where applicable such as:

- providing further proficiency testing- undertaking a partial or full reassessment of the

laboratory- suspending all or part of the laboratory’s scope of

accreditation- cancelling all or part of the laboratory’s scope of

accreditation

Performance in NATA proficiency activityand any (non-NATA) proficiency testingprograms is reviewed during on-siteassessments.

PT Policy Confidentiality

As with NATA assessment activities all informationsupplied by a laboratory as part of a proficiencytesting program are treated as confidential.

This information is made available to relevantassessors, proficiency testing program technicaladvisers, NATA Accreditation Advisory Committeemembers and international evaluators from otheraccreditation bodies.

All have signed confidentiality agreements.

PT Policy Participation fees

NATA charges participation fees which arenotified prior to commencement of theprogram.

PT Procedures - Testing & Calibration

NATA organise programs that best addressthe needs of members and be in Australia’snational interest.

NATA program selection generally reflectrequests from NATA Accreditation AdvisoryCommittees and Technical Groups andoccasionally from industry and governmentauthorities.

NATA has referenced manuals which providefull details of:

the aim, design and conduct of NATA’s proficiency testing programs

in-house procedures and standard documents

general policy on PT participation

NATA Measurement Audits are conductedprior to gaining accreditation (in eachtechnical unit) before the on-site assessmentto confirm the least uncertainties ofmeasurement being sought for accreditationwhen laboratories request significantextensions or variations to their scope ofaccreditation (e.g. improving estimates ofMU, addition of new sub-class of testing)

When requesting additional or significantextensions to signatory approvals

at least once every four years (minimum)

Corrective actions

CALIBRATION PROGRAMS

For laboratories with significant problems,NATA has the following options:

calculation and transcription checkinform the laboratory that they have a problemat certain points and ask them to check theircalculations and final data.

uncertainties checkask the laboratory to submit their uncertaintycalculations and work sheets for review bythe technical adviser.

retestwithout telling the laboratory the referencevalues, ask them to retest. They may beinformed that their results were higher or lowerthan the reference value by significantly morethan their accredited uncertainty. Their retestresults will indicate whether the problem isreproducible. The laboratory will usuallyinvestigate by using different methods, differentreference equipment, different operators.

partial reassessmentinvolving a technical assessor with specificexperience in the problem area who willwitness a retest and investigate theproblems in related areas.

suspensionfor problems that cannot be resolved quicklythe laboratory is sent a letter informing themthat they cannot issue calibration certificatesfor the relevant measurements until theproblem is satisfactorily resolved.

adjusting the laboratory’s accredited bestmeasurement capabilitywhere En numbers may be marginally >1 or<-1 and the source of the problem is notapparent after investigation, then theiraccredited uncertainty may be increaseduntil the laboratory can prove that theproblem has been overcome.

measurement auditafter follow-up the laboratory usually sendsa submission advising that they haveovercome the problem. If there is any doubta further measurement audit should bearranged to ensure that it has beenovercome.

In addition to overcoming the problem, NATAconsiders if the laboratory has:

reviewed work done for their clients that may have also been adversely affected by the problem discovered by the proficiency test.

taken adequate steps to prevent recurrence of theproblem, e.g. changes to test methods, more regular cross-checks on its reference equipment,implementation of a better checking system, training of operators, etc.

TESTING PROGRAMSIn relation to laboratories which report extremeresults, NATA has documented procedures to:

have the laboratory investigate and comment onits performance within an agreed time-frame;

where necessary, have the laboratory undertakeany subsequent appropriate proficiency test whichmay be available, to confirm that any correctiveactions taken by the laboratory are effective;

where necessary, reschedule the on-siteevaluation of the laboratory where appropriatetechnical assessors confirm that correctiveactions are effective; and

where necessary, supply spare samples forretesting to confirm effective corrective action.

Whenever possible assistance is providedfor laboratories investigating extremeresults, for example, technical adviser(s)may be able to provide advice on thepossible sources of error.

In some programs NATA advise participatinglaboratories of the outcomes of unsatisfactoryperformance in a proficiency testing programwhich include:

temporary suspension of accreditation for relevant tests subject to poor performancein consecutive scheduled programs (subjectto corrective action or improved performancein subsequent program rounds).

Normally, the options selected by NATA willdepend on the history of performance of thelaboratory over time and from the mostrecent on-site assessment.