Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection...
Transcript of Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection...
![Page 1: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/1.jpg)
Resident SelectionSharing experiences from using selection science to find the best
surgical trainees
Brian J. Dunkin, MD, FACS
TSDA General Session
![Page 2: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/2.jpg)
Disclosure
• Not a selection scientist
![Page 3: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/3.jpg)
Disclosure
• I found someone with whom to collaborate!
Aimee Gardner, PhD
Assistant Dean of Evaluation & Research
School of Health Professions
Associate Professor, Health Professions & Surgery
Baylor College of Medicine
Houston, Texas
![Page 4: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/4.jpg)
Disclosure
• Ownership interest in SurgWise
![Page 5: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/5.jpg)
Let me tell you a story …
![Page 6: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/6.jpg)
Typical file
• USMLE
• ABSITE
• MIS Case Numbers
• Unstructured letters of recommendation
• Unstructured personal statements
• Unstructured CV
![Page 7: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/7.jpg)
Assessment Tools
![Page 8: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/8.jpg)
USMLE / ABSITE / GRADES
![Page 9: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/9.jpg)
Assessment Tools
![Page 10: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/10.jpg)
We do lots of interviews
![Page 11: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/11.jpg)
Assessment Tools
![Page 12: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/12.jpg)
How could we do this better?
![Page 13: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/13.jpg)
Job Analysis
![Page 14: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/14.jpg)
Job Requirements Competencies
![Page 15: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/15.jpg)
Competencies Assessments
![Page 16: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/16.jpg)
Situational Judgment Tests (SJTs)
![Page 17: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/17.jpg)
Personality Profile
• Agreeableness
• Extraversion
• Emotional Stability
• Openness to new experiences
• Conscientiousness
Gardner AK, Dunkin BJ. JAMA Surgery 2017
![Page 18: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/18.jpg)
Course Topic Delivery Method
DidacticsCase-based
Review
Small Group
DiscussionRole Play
Other Active
Learning
Strategies
Part I: Background
Structured Interview Basics x x
Question Development x x
Biases in Interviews x x
Part II: Asking Questions
Getting Complete Responses x x
Types of Interviewing Questions x x
Unacceptable & Illegal Questions x x x x
Taking Notes x x
Part III: Assessment
Assigning Ratings x x x x
Motivational Fit x x
Integrating Data x x
Part IV: Putting it All Together
Interview Day Basics x
Review x x
![Page 19: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/19.jpg)
Technical Skills
• Fast-paced program
• High complexity
• Time-compressed environment
![Page 20: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/20.jpg)
Gardner AK, Dunkin BJ. Annals of Surgery 2018
![Page 21: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/21.jpg)
Could Fit But …
Great Fit
Not A Good Fit
![Page 22: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/22.jpg)
Gardner AK, Dunkin BJ. Annals of Surgery 2018
![Page 23: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/23.jpg)
Structured Interviews Skills Testing
![Page 24: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/24.jpg)
Information on MIS Candidates for Ranking
• SJT• 26 questions
• 130 unique data points
• Personality profile
• 9 competencies interviews
• 3 competencies group
• Technical skills
![Page 25: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/25.jpg)
Results
![Page 26: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/26.jpg)
Gardner AK, Dunkin BJ. Annals of Surgery 2018
![Page 27: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/27.jpg)
Gardner AK, Dunkin BJ. Annals of Surgery 2018
![Page 28: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/28.jpg)
Gardner AK, Dunkin BJ. Annals of Surgery 2018
![Page 29: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/29.jpg)
55 applicants invited to take
online assessment
50 (91%) completed
42 minutes
![Page 30: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/30.jpg)
80%improved
agreement among
interviewers
45%increase in
knowledge of how to conduct
structured interviews
45%higher in how to avoid illegal
questions
![Page 31: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/31.jpg)
Over 50% less interviews
![Page 32: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/32.jpg)
Success!
![Page 33: Resident Selection · 2019-10-08 · Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General](https://reader034.fdocuments.in/reader034/viewer/2022042110/5e8ae24943e7a50f6a536eeb/html5/thumbnails/33.jpg)
Competency-based SelectionAimee K. Gardner, PhD