PEDIATRICS MILESTONES ASSESSMENT COLLABORATIVE (PMAC) UPDATE – FALL 2015 APPD MEETING
Patricia Hicks, MD, MHPE PMAC Director
TIMELINE
2009 ACGME
Milestones
2010 Pediatrics
Milestones Working Group
2011 Pediatrics
Milestones Assessment Pilot NBME and APPD
(begins)
2012 Pediatrics
Milestones Pilot (ends)
2013 Pediatrics
Milestones Assessment
Collaborative PMAC
(begins)
2014 PMAC Module 1 Data Collection I
2015 PMAC Module 1
Data Collection II
PMAC GOALS
Build an Assessment System Feasible Workplace-based Reports that serve a number of purposes
Flexible Responsive to needs of programs Builds on APPD’s community Scholarship and leadership opportunities
KEY AREAS FOR DECISIONS AND FEEDBACK When can I trust a trainee to be an intern on the
inpatient team? When is an intern ready to be left without their
supervisory resident? When is a resident ready to supervise others?
Procedural competence Consultation Handovers EBM QI
Refine the question Select content (mapping content to PM’s) Design items: context and role based Refine items Instrument development; report design Data collection Feedback/ evaluation Revision of items/instruments/technology
INSIDE LOOK AT THE PROCESS
Beatrice Boateng Kim Boland Ann Burke Carol Carraccio Alan Chin Kathleen Donnelly Kim Gifford Su-Ting Li
Sara Multerer Amanda Osta Sue Poynter Dan Schumacher Julia Shelburne Teri Turner Anna Weiss
CONTENT EXPERTS
Institution: Contact Person: Boston Combined Residency Program Dan Schumacher, Ariel Winn
Children's Hospital of Philadelphia Anna Weiss, Rebecca Tenney-Soeiro, Jeanine Ronan
University of Illionis-Chicago Amanda Osta, Katie Mena, Jennifer Vu University of Michigan Pediatric Residency Program Hilary Haftel University of Louisville Kimberly Boland, Sara Multerer UCLA Alan Chin, Jessica Lloyd University of Chicago Pediatric Training Program Nicola Orlov Cincinnati Children's Sue Poynter Dartmouth - Hitchcock Medical Center Kim Giffords, Samantha House University of Utah Bruce Herman, Jaime Bruse
DATA COLLECTION I SITES & LEADS
Single URL for SCO-Rounds and MSF Authentication with password, context (name of
rotation) and date range of rotation Once authentication is complete:
The system knows who you are… Your role (role-based instruments you can see) What learners you are eligible to assess
The system will tell you how many instruments of that type have been completed – by you and by all (that rotation)
A LOOK AT THE INSTRUMENTS:
FEEDBACK REPORT
Dates (rotation or 6 month summative) Context(s) Competency – numeric score (single month or
summative) Competency – associated narrative comments Global score (based on the question)
Next data collection beginning on October 1, 2015 We would love to have your program involved!!!!
Want to explore? Contact:
Alan Schwartz- email [email protected] Erin Ernst – email [email protected] Patty Hicks – email [email protected]
LOOK FOR A INFORMATIONAL WEBINAR COMING SOON!!!
MODULE 1, DATA COLLECTION II
APPD LEARN IS… Educational research network focused on
Pediatrics education (An AHRQ-registered PBRN)
130+ participating programs Enterprise-quality data repository Longitudinal identifier codes for learners to permit
studies over time and across projects Open to your program!
Characteristics of Clinical Competency Committee (CCC) Member Milestone Level Assignments and Recommended Advancement Decisions PI: Dan Schumacher, MD, MEd (Cincinnati)
Scholarly activity during residency: A national study of pediatric residents and program directors PI: Erika Abramson, MD (Cornell)
MEMBER-INITIATED STUDIES ONGOING
Pediatrics Milestones Assessment Collaborative (PMAC) - Module 1 (DC2) Collaborators: ABP, NBME
Assessing the Association between Entrustable Professional Activities (EPAs), Competencies, and Milestones in the Pediatric Subspecialties Collaborators: CoPS, ABP
How trainees perform on general pediatric EPAs using a rating scale of level of supervision leading up to entrustment Collaborators: ABP
Education in Pediatrics Across the Curriculum (EPAC) data stewardship Collaborators: AAMC, UCSF, U Colorado, U Minnesota, U Utah
COLLABORATIVE STUDIES
Join us! Keep in touch with us: http://learn.appd.org Details on how to propose new studies Information about training opportunities How to obtain access to archived data
Email us at: [email protected]
APPD LEARN: CONNECTIONS
To deliver a nationally recognized program that provides pediatric
residency and fellowship educators the knowledge and
skills to become leaders in graduate medical education.
New call for applications - Winter 2016
Structure
• 10 month program • 3 educational
conferences • Peer group activities
and support • Mentored
educational project • Certificate of
completion
Curriculum
• Organizational Leadership
• Competency-based Curriculum Development
• Faculty Development
• Residency & Fellowship Program Administration
• Scholarship and Career Development
How to Apply • New call for applications Winter • Member of APPD • ≥3 years of educational leadership experience
• PD, FD, APD, AFD • LEAD year not overlap with 1st year in new role • Department support • Commitment to attend all meetings and complete
assignments and project
•Cohort 1 18 members •Cohort 2 17 members •Cohort 3 15 members •Cohort 4 16 members
Cohorts
•Multiple members in APPD leadership roles, e.g., Fellowship Director’s Committee, Program Planning Committee, SIG Leaders
•Multiple posters, workshops at APPD, PAS and other meetings •Multiple articles published
Accomplishments
•Susan Bostwick, MD New York Presbyterian – Weill Cornell •Hilary Haftel, MD, MHPE University of Michigan •Grace Caputo, MD, MPH Phoenix Children’s Hospital •Su-Ting Li, MD, MPH University of California-Davis •John Frohna, MD, MPH University of Wisconsin •Richard Shugerman, MD University of Seattle •Linda Waggoner-Fountain, MD, MEd University of Virginia
Council
Call for New Council Members •Went out September 2015 •Application Due October 2015 •New Council Member announced
November 2015
APPD UPDATES VIEW FROM THE APPD PAGES
BOB VINCI, MD
Member Driven – Mission Focused Fall Meeting 2015
VIEW FROM THE APPD PAGES FALL MEETING 2015
ACADEMIC PEDIATRICS – APA Journal “VIEW” is a monthly section in the Journal
Brief report (2000 words) that highlights the work you are doing in curriculum development, assessments, educational leadership, etc.
Goal is dissemination of your work Journal now going to 8 editions per year
Willingness to work with you to take an idea, outline, draft and move it towards publication
VIEW FROM THE APPD PAGES FALL MEETING 2015
Recent Publications: APPD LEAD – Franklin Trimm Competency Based Assessments – Jake Robson Resident Vaccine Project – Jen Shepard Fellows College – Judith Campbell
Think about: Innovation in your program/region Approaches to curriculum development APPD LEAD APA Educational Scholars Program
APPD Website had links to: APPD Spring Abstracts Collection of Previous APPD “VIEWS”
SHARE WAREHOUSE EDITORIAL TEAM
Alan Chin, MD Robert Lee, MD Sydney Primis, MD
Platform Redesign
Michele Miner, MD Ashweena Gonuguntla, MD Brad Olson, MD Tara McKinley
Editorial
Ann Burke, MD Javier Gonzales Del Rey, MD Matt McCrae
Consultation
Abhay Dandekar, MD Redesign Project Leader
Purpose: To redesign the APPD Share Warehouse
Objective: Define what is present Refine what is needed Apply resources and team talent/effort to produce a
Share Warehouse version that is a practical, user-friendly, member-driven resource and a signature of our collaborative APPD innovation
SHARE WAREHOUSE EDITORIAL TEAM
Our progress (Spring 2015- present) Monthly conference calls (April, May, July, August) to:
Initiate the redesign process by refining our vision and our deliverable product
New preliminary version with homepage and submission updates live now!
Updated searching/browsing function projected for October 15, 2015 roll out!
SHARE WAREHOUSE EDITORIAL TEAM
Next Steps: Details on “go-live” and communication to membership Member driven contribution and input Member driven editorial process (ongoing and formalized in
Spring 2016) Collaboration and member/user-driven design for ongoing
improvement
SHARE WAREHOUSE EDITORIAL TEAM
MISSION STATEMENT
VISION
The Association of Pediatric Program Directors serves pediatric programs by leading the advancement of education to ensure the health and well-being of children.
Exemplary pediatric education
Leadership Innovation Collaboration Scholarship Engagement
VALUES
GOALS Development of Programs and Members – Foster program
development through supporting members in their professional development, academic advancement, career satisfaction and administrative activity.
Organizational Excellence - Maintain a dynamic organization with efficient and effective leadership that is responsive to its members.
Leadership and Collaboration – Advance graduate medical
education through engagement and collaboration.
Research and Scholarship – Optimize the quality of future general and subspecialty pediatricians through participation in rigorous research, application, then broad dissemination of best practices in graduate medical education.
Top Related