The General Competencies: An Update from the ACGME

Susan R. Swing, PhDDirector of Research

Patricia M. Surdyk, PhDSenior Project Manager

Accreditation Council for Graduate Medical Education

Association of Anesthesiology Program DirectorsSociety of Academic Anesthesiology Chairs

November 9, 2003

The ACGME Outcome Project

EMPHASIZE:

• Competency-based learning and improved assessment of resident performance

• Competencies and outcomes in accreditation

IMPROVE:

• Preparation of physicians

• Patient care

Improvement

Main Entry: im·prove Pronunciation: im-'prüvFunction: verbInflected Form(s): im·proved; im·prov·ingEtymology: Anglo-French emprouer to invest profitably, from Old French en- + prou advantage, from Late Latin prode -- more at

to enhance in value or quality : make better

Outcome Project Timeline

Phase 1 (July 2001-June 2002) Taking stock Getting started

Phase 2 (July 2002-June 2006) Providing learning opportunities Improving assessment Using outcome data within the institution and

program

Spread of the Competencies

Organizations adopting the competencies or

related domains: American Board of Medical Specialties Accreditation Council for Continuing Medical

Education Council of Medical Specialty Societies American Osteopathic Association National Center for Health Care Leadership Institute of Medicine

Health Professions Education: A Bridge to Quality

In its third report, the Institute of Medicine recommends that:

“All health professionals should be educated

to deliver patient-centered care as members of an interdisciplinary team,

emphasizing evidence-based practice,

quality improvement approaches,

and informatics.”

Project Principle

We tend to improve that which we measure. Summative assessment

High-stakes decisions Undertaken at end of training

Formative assessment Ongoing Developmental

Anesthesiology Profile

55 programs reviewed by the RRC using the PIF Addendum (1485 programs reporting as of May 13, 2003)

Self-reports indicate: 99% provide learning opportunities in all competencies 85% engage in efforts to improve learning opportunities

and/or assessment in all competencies 84% use an additional assessment tool other than an “end-of-

rotation ratings” to assess the competencies 79% assess resident performance in every rotation

Anesthesiology Profile (cont’d)

Reports indicate (cont’d): 67% use at least one other type of evaluator to

assess Interpersonal and Communication Skills 66% use at least one other type of evaluator to

assess Professionalism 91% report using scoring/rating criteria 55% train faculty to use rating criteria 90% use assessment data to provide oral or written

feedback to residents for all competencies

Anesthesiology Profile (cont’d)

Patient Care (28 improvements reported) A web-based evaluation system has been

implemented to regularly evaluate resident competency in patient care. Every interaction from preoperative patient evaluation, planning the treatment plan, intraoperative management and postoperative care is evaluated by attending physician. The resident is able to view his performance as rated by the attending physician immediately…

Anesthesiology Profile (cont’d)

Patient Care (cont’d) …This immediate feedback allows the residents to

discuss and improve his performance, if necessary, with the attending physician. The program director by reviewing these evaluation reports on a regular basis is able to identify deficiencies early and implement remedial measures. Results are also discussed with clinical competence committee on a semi-annual basis or sooner if needed.

Anesthesiology Profile (cont’d)

Medical Knowledge (22 improvements reported) Every year each first and second year resident is

given a “mock” oral examination. The evaluation team consists of a faculty member and a third-year resident. A stem cell question is given, which outlines a patient, medical history, and proposed surgical procedure. The examinee is expected to perform a history, choose an anesthetic plan, and manage the patient preoperatively, intraoperatively and postoperatively…

Anesthesiology Profile (cont’d)

Medical Knowledge (cont’d) …Selected topics dealing with any issue of

anesthesiology or medicine, may be addressed. Since a third-year resident has the opportunity to function as an examiner, additional practice opportunity is achieved. At the end of the mock oral examination, the examinee is appraised of his/her performance, with areas of improvement/weakness identified and promulgated.

Anesthesiology Profile (cont’d)

Interpersonal and Communication Skills (13 improvements reported)

In an attempt to teach both Professionalism and Interpersonal/Communication Skills, we discuss occasional patient complaint letters and analyze what could have been done differently in the initial encounter, as well as how one should reply to the letter in order to assuage the patient’s disappointment or anger. Additionally, we present cases involving conflicts with colleagues and then formulate prevention and resolution strategies.

Anesthesiology Profile (cont’d)

Practice-based Learning and Improvement (16 improvements reported)

We have instituted monthly Problem-based Learning Discussions which are written to address many of the competencies, including knowledge, patient care, interpersonal and communication skills; but with each case, residents are supplied with current journal articles, are asked to prepare a management and treatment plan, and encouraged to investigate and evaluate their practice both individually and as a group.

Anesthesiology Profile (cont’d)

Professionalism (7 improvements reported)

Regularly during our Chairman’s Meeting sessions, we discuss essays, poems, short stories, and books that emphasize the special bond between the physician and patient. Our reference materials include the “Careers in Anesthesiology” series published by the Wood Library-Museum of Anesthesiology and co-edited by Drs. K. McGoldrick, D. Caton, and the late B. Raymond Fink, as well as “A Life in Medicine,” co-edited by Dr. Robert Coles and Randy Testa, and “A Piece of My Mind, edited by Roxanne K. Young.

Anesthesiology Profile (cont’d)

Systems-based Practice (7 improvements reported)

CA3 residents receive an in-depth introduction to the system of surgical services during the OR Management rotation and Practice Management lecture series. Through first-hand experience in the anesthesia scheduling and daily management of a very busy inpatient operating room,…

Anesthesiology Profile (cont’d)

Systems-based Practice (cont’d)

…residents gain an appreciation for resource and personnel allocation decisions and the implications of those decisions to quality of care, patient flow through the hospital and the practices of other health care providers. Residents must continually reevaluate the resources and personnel available to them and utilize those resources to efficiently address both planned and emergent situations.

Resources

www.acgme.org

www.acgme.org/outcome/

/RSVP

/RSVP

/FORUM

Still to Come…

Abstracts from ACGME/ABMS joint conference, Fostering Professionalism: Challenges and Opportunities

Instructional Methods Toolbox (mid 2004)

Presentations from ACGME/IHI joint conference, Professionalism and Practice-based Learning and Improvement (early 2004)

ACGME Annual Educational Conference, March 3-5, 2004