Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not...

30
Copyright © 2015 BSI. All rights reserved. Unannounced Audits – Experience To Date Vicky Medley – Head of QMS, Medical Devices February 2015

Transcript of Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not...

Page 1: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved.

Unannounced Audits – Experience To Date

Vicky Medley – Head of QMS, Medical Devices February 2015

Page 2: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 2 Copyright © 2015 BSI. All rights reserved.

1. BSI Implementation 2. BSI Experience To Date 3. Feedback and Q & A

Page 3: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 3

Background & Requirements - See Webinars BSI Website

Page 4: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 4

http://medicaldevices.bsigroup.com/en-GB/our-services/Unannounced-audits-from-BSI/

• Commission Recommendation • E-Updates • Webinar Details & Recordings • Frequently Asked Questions

BSI Resources

Page 5: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 5

Presented by

• on behalf of Paul Sim

•Regulatory Affairs Manager

•Vicky Medley

•Head of QMS

JH

• on behalf of Suzie Halliday

•Head of Notified Body (UK)

• on behalf of Gert Bos

•Head of Notified Body (Germany)

Presenter
Presentation Notes
Reference for BSI webinars also on behalf of Head of our German NB 0535 - Gert Bos For the benefit of the 0535 clients processes and procedures between 0086 and 0535 are aligned as far as possible
Page 6: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 6

BSI Implementation

Page 7: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 7

Who? • Commission Recommendation specifies at least two assessors

• BSI Assessment Team One QMS Assessor (Client Manager) One Product Technical Specialist

• In advance briefing preparation by the Scheme Manager • Often not the regular assessor(s)

Presenter
Presentation Notes
Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc. One (Product) Technical Specialist; in few cases could be a logistics or finance specialist if expertise is relevant to the audit focus e.g. to track qualities of goods ordered, paid, used, shipped, etc. So more quality checks and accounting for example.
Page 8: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 8

Legal Manufacturer?

YES if all or some manufacturing , design or test activities performed onsite for all or some products

Critical Subcontractor or Crucial Supplier?

YES, for virtual manufacturers

Where?

Presenter
Presentation Notes
Many manufacturers will be in between these two.
Page 9: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 9

Where? “…if this is likely to ensure more efficient control… in particular if the

main part of the design development, manufacturing, testing or another crucial process is located with the subcontractor or supplier.”

Critical Subcontractor E.g. Manufacturer of finished devices,

key sub-assembly or significant components. Regulatory responsibility and / or activities essential for ensuring

compliance with legal requirements. Design or software development,

sterilisation, sterile packaging.

Crucial Supplier E.g. Critical raw materials such as

silicone gel component for an implant, animal tissue for use in heart valve.

Proprietary items.

Presenter
Presentation Notes
More extensive listing than those on the certificate, could be considered in needing a visit, but not anticipated to visit all unless a specific need or concern. More work to be done on this.
Page 10: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 10

How is the determination made?

Information Collection & Review

Information collated from manufacturer via Scheme Manager Form completed – please ensure updates notified (IT Portal for future) Scheme Manager reviews & compiles plan

BSI Plan Finalized

In most cases one Unannounced Audit to one manufacturer (or their CS/CS) in one 2 or 3 year period In some cases there may need to be more than one location visited

Visit Scheduled

Audit assigned to a QMS Assessor & Product Technical Specialist

Presenter
Presentation Notes
For our German Notified Body 0535 this information will be collected shortly. All manufacturers will get dedicated communication, including new matching terms and conditions.
Page 11: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 11

What information should we have on file?

• Facility Details Access details: Hours of operation, contact names & phone numbers, PPE / Health & Safety requirements, language skills on site, shutdown periods etc.

• Critical Subcontractors & Crucial

Suppliers (CS/CS) Details of device types, activities performed & frequency + all above

Presenter
Presentation Notes
Crucial for BSI customers the form for collation of this critical information is now completed and returned.
Page 12: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 12

Minimum frequency in number of years for

an unannounced visit Classification

Is / Im IVD self test

IIa IIb III / AIMD IVD List A

Normal conditions 3 yr 3 yr 3 yr 2 yr

If the device bears high risk 2 yr 2 yr 1 yr 1 yr

Devices that are often non-compliant 2 yr 2 yr 1 yr 1 yr

Specific reasons for suspicion 2 yr 2 yr 1 yr 1 yr

How often? Per Commission Recommendation & NB Code of Conduct

Version 3.2 – 22 July 2014

Presenter
Presentation Notes
More visits if history of non-compliance or specific reasons for suspicion – as frequently as is considered to be required. Device compliance, system compliance / performance (e.g. if major NCRs) .
Page 13: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 13

For how long?

• Most Manufacturers - Including small & medium sized facilities - One day by two auditors

• Very Large Manufacturers - Several hundred employees + - Four man-days (or more in extreme cases). Likely two assessors for two

days - Or an increase in frequency of visits

Presenter
Presentation Notes
BSI Commercial Team finalized prices. Costs are based on QMS Assessor + Technical Specialist + 1 day overall administration, planning and reporting and review time for all involved. We are exploring options for spreading the payment cost post assessment. For example over 2 or 3 years.
Page 14: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 14

What happens on the day?

• Arrival BSI Assessors present an introduction / overview letter referencing the objective, EC Certificate(s), location to be assessed, date and assessment team

• Identification The letter contains a link to the BSI website which contains names and photos of all assessors authorized to conduct Unannounced Audits for BSI

Page 15: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 15

What happens on the day?

BSI Assessors arrive onsite and present identification (letter and weblink)

Request to speak to allocated contact or the most senior person on site

Explanation of visit within brief opening meeting

Audit team progress swiftly to manufacturing area Assessment team work together to audit all elements specified in the Commission Recommendation and identify areas / processes for further audit as part of the visit

Brief closing meeting, with details of findings where possible Report will be provided within approximately one week Follow up of any non-conformities through normal audit processes

Presenter
Presentation Notes
Visit with no advance warning. Full co-operation is expected and if not provided would be considered a refusal by the NB. Potential consequence of refusals or unavailability. Will be subject to internal review to determine need for follow-up / action. Always covered by BSI T&Cs although these have now been reissued to clarify (complete for 0086, being done for 0535). Potential to lead to certification suspension or cancellation or reduction of scope.
Page 16: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 16

What happens on the day for a CS/CS?

BSI Assessors arrive onsite and present identification (letter and weblink)

Request to speak to allocated contact or the most senior person on site

Explanation of visit within brief opening meeting

Audit team progress swiftly to manufacturing area Assessment team work together to audit all elements specified in the Commission Recommendation and identify areas / processes for further audit as part of the visit

Brief closing meeting, with details of findings where possible Report will be provided within approximately one week Follow up of any non-conformities through normal audit processes

Brief closing meeting, with permission / phone attendance of Legal Manufacturer & details of findings where possible Report provided to Legal Manufacturer within approx one week Follow up of non-conformities via normal audit processes (at any location)

Presenter
Presentation Notes
Visit with no advance warning. Full co-operation is expected and if not provided would be considered a refusal by the NB. Potential consequence of refusals or unavailability. Will be subject to internal review to determine need for follow-up / action. Always covered by BSI T&Cs although these have now been reissued to clarify (complete for 0086, being done for 0535). Potential to lead to certification suspension or cancellation or reduction of scope.
Page 17: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 17

What happens on the day if…?

• No manufacturing or other processes ongoing? • Review applicable evidence? E.g. Recent activity, warehouse stock, physical areas

used, i.e. manufacturing, design, records etc and associated documentation • If CS/CS (& within limits of confidentiality) review similar activities/processes/areas • Assessment team judgement to a recommendation on audit validity

• Audit team is refused or denied access • Assessors complete report providing full details of situation encountered • Directly inform BSI Scheme Manager (& BSI notify Legal Manufacturer if CS/CS) • Note – any refusal or non co-operation will lead to review & follow-up action • Potential escalation to certificate scope reduction, suspension or cancellation

Page 18: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 18

BSI Experience to Date

Page 19: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 19

Quick Poll

Have you received an Unannounced Audit yet?

• Yes (at legal manufacturer, subcontractor or supplier site)

• No (not yet)

Page 20: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 20

March 2014 BSI trial period Several Unannounced Audits conducted as trials across a range of companies and devices

April 2014 BSI live with routine Unannounced Audits (per European Competent Authorities expectations) Small volume conducted

May – June 2014

Global roll-out of internal training (5 events and 140 people) Finalized practises, polices and procedures

July 2014 –> Full global roll out and ramp up, with significant volume of routine Unannounced Audits across remainder of 2014 + Continuous internal review, policy finalization and refinement

Timelines

Presenter
Presentation Notes
Initial trial phase visits not charged and did not count towards the unannounced audit programme, however findings did count and followed up. For 2014, BSI now at normal level of routine unannounced visits with up to 300 hundred this year. Will continue to 2015 and 2016. All BSI manufacturers targeted to have one visit to them or CS/CS by end 2016
Page 21: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 21

What did we learn? • So far all were ready, including small manufacturers

• Some surprise (from auditees) at:-

• The assessment team working together • No detailed assessment agenda • Different focus to normal visits. i.e. more on product, less on

supporting QMS processes (No routine coverage of Management Review, Internal Audit, CAPA etc)

• Having a visit so soon!

• Feedback indicated a more positive experience than expected!

Presenter
Presentation Notes
Mainly to legal manufacturers, sites in same organization so far (i.e. few CS/CS)
Page 22: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 22

What did we learn? Key Points

• A very few manufacturers are still to return requested critical information to BSI to enable effective planning

• Audits have been conducted to locations which would

not have been visited had the information been available (e.g. move ongoing, a planned site closure)

• Lack of returned information does not mean no Unannounced Audit. Lack of response could trigger EC certificate suspension or cancellation

Page 23: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 23

What did we learn? Key Points

• Unusual situations encountered • Manufacture site moving or moved • Re-modellers in facility • Audit from a national regulator ongoing • CE Certificate about to be cancelled

• Our procedures & training emphasise the importance of

“speedy” access to manufacturing • Please help… no long factory tours or routing, cups of

coffee (can be later), network passwords, navigation / access issues

Page 24: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 24

What happened on the day? • Assessment Agenda - BSI Assessors have detailed briefing but no fixed assessment

agenda - Following arrival and overview meeting generally swift progress to

manufacturing and / or final product areas

• Typical Timings - Morning spent in product areas, then working lunch - Afternoon finish production etc, then more office-based,

documentation audit trails link to Technical Files & Dossiers - End of day wrap-up / brief closing meeting

Page 25: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 25

1. Studied the requirement? 2. Factored additional costs into budgets? 3. Implemented processes and procedures for

receiving visits? 4. Responded to requests from your NB? 5. Reviewed (or are reviewing) critical

subcontractors & crucial suppliers contracts? 6. Communicated awareness across all staff and

trained appropriate staff? 7. Practised? 8. Had one?! Did you conduct a post-audit review to

learn from the experience?

Are you ready? Have you?

Presenter
Presentation Notes
Practice - internal audit on readiness and or mock/audit. Unannounced Visits on your CS/CS?
Page 26: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 26

On the day 1. Ensure guide(s) assigned 2. Be aware of requirement & assist the auditors, e.g.

get to manufacturing as soon as possible 3. Let the assessment team know of any concerns or

issues (e.g. no CE devices in production that day, fire alarm planned)

4. Think ahead – remember likely need access to Technical Files / Design Dossiers for devices

5. Feel free to ask questions (will they break for lunch, approximate time to wrap-up etc)

6. Conduct (& share?) internal post audit review on any learnings – ready for next time?!

Page 27: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 27

Thank you Names: Vicky Medley Paul Sim

Titles: Head of QMS Regulatory Affairs Manager

Address: Medical Devices

BSI, Kitemark Court, Davy Avenue, Knowlhill, Milton Keynes, MK5 8PP, United Kingdom

Links:

LinkedIn:

http://medicaldevices.bsigroup.com/

Please Join our New Global Medical Device LinkedIn Group

http://www.linkedin.com/groups/BSI-Global-Medical-Devices

Page 28: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 28 Copyright © 2015 BSI. All rights reserved.

Questions?

Page 29: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩
Page 30: Unannounced Audits – Experience To Date · Emphasize that typically not regular assessor, but not always, depending on geography, competency requirement etc.\爀屲One \⠀倀爀漀摜ഀ甀挀琀尩

Copyright © 2015 BSI. All rights reserved. 30

Panel Questions