USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd...
Transcript of USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd...
![Page 1: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/1.jpg)
QUESTION BASED LEARNING WITH SELF-DIRECTED LEARNING LOOPS Tao T. Le, MD, MHSFounder and CEO, MedIQ Learning/USMLE-RxAssociate Clinical ProfessorChief, Section of Allergy and ImmunologyDepartment of MedicineUniversity of Louisville
![Page 2: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/2.jpg)
Disclosures• Founder and CEO, MedIQLearning/USMLE-Rx
• Author, McGraw-Hill Education
![Page 3: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/3.jpg)
AcknowledgmentsUSMLE-Rx• John Collins• Art Guepe• Emma Underdown
Vanderbilt School of Medicine• Toufeeq Ahmed• Pedro Texeira
University of Pittsburgh Medical Center• Andrew Bilderback
![Page 4: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/4.jpg)
United States Medical Licensing Examination (USMLE)•3 step exam for US medical licensure
•Sponsored by NBME and FSMB•Competency-based exam
www.usmle.org
![Page 5: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/5.jpg)
USMLE Step 1• Typically taken after 2nd/3rd year• Preclinical focus• 40K+ examinees and rising• Residency application screening tool
www.usmle.org
![Page 6: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/6.jpg)
USMLE-Rx Qmax• A leading competency-based self-assessment tool for USMLE preparation
• Question-based learning (QBL) – Case-based question followed by detailed explanations
• Interlinked with First Aid for the USMLE Step 1, First Aid Flash Facts (Anki-style flashcards), PubMed, and Wikipedia
www.usmle.org
![Page 7: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/7.jpg)
www.usmle-rx.com
![Page 8: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/8.jpg)
www.usmle-rx.com
![Page 9: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/9.jpg)
USMLE-Rx Qmax Usage
0
5
10
15
20
25
2013 2014 2015
Millio
ns
![Page 10: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/10.jpg)
34
![Page 11: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/11.jpg)
150K+ Opportunity to train
better learners?
![Page 12: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/12.jpg)
Building the Master Learner• Self-determination theory• Cognitive load theory• Situated cognition• Self-directed learning
Acad Med. 2013;88:1635-1645
![Page 13: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/13.jpg)
Self directed learning• Learner takes responsibility for learning• Requires external resources• Social activity
• Teachers – guided reflection, self-assessments, learning plans
• Peers – peer assisted learning, community, peer support
Educ Psychol Rev. 1998;10:251-296
![Page 14: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/14.jpg)
Liaison Committee on Medical Education 6.3 Self-Directed and Life-Long Learning
The faculty of a medical school ensure that the medical curriculum includes self-directed learning experiences and time for independent study to allow medical students to develop the skills of lifelong learning. Self-directed learning involves medical students’ self-assessment of learning needs; independent identification, analysis, and synthesis of relevant information; and appraisal of the credibility of information sources.
![Page 15: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/15.jpg)
Learning LoopUSMLE-Rx
Qmax
Identifies needs
Seeks external resources
Reflects & self-assesses
![Page 16: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/16.jpg)
www.usmle-rx.com
![Page 17: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/17.jpg)
www.usmle-rx.com
![Page 18: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/18.jpg)
www.usmle-rx.com
![Page 19: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/19.jpg)
Learning Loop Analysis• Aims – characterize learning loop adoption and
associated factors• Statistical plan
• User event data for April 2016 captured by Mixpanel• Exploratory/descriptive data analysis• Bi/multivariate analysis• Statistical analysis performed in STATA 13.1
![Page 20: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/20.jpg)
Descriptive Statistics• 3159 users reviewed 696K Step 1 Qmax questions• 1028 users engaged in 5105 learning loops• = 7 loops/1000 reviewed questions
![Page 21: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/21.jpg)
Bivariate AnalysisFactor OR (95% CI) P-valueIncorrect answer 1.7 (1.5-1.9) <0.001Foreign-born IMG (vs US MD) 2.9 (1.9-4.4) <0.001More difficult questions 1.4 (1.3-1.6) <0.001Lower performing student 1.9 (1.4-2.5) <0.001Fewer questions done 1.2 (1.0-1.5) 0.071
![Page 22: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/22.jpg)
Bivariate Analysis Subject Areas OR (95% CI) P-valueBehavioral science 0.6 (0.5-0.8) 0.001Biochemistry 1.3 (1.1-1.6) 0.010Epidemiology 0.4 (0.3-0.6) <0.001Pharmacology 0.8 (0.7-1.0) 0.019
![Page 23: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/23.jpg)
Multivariate AnalysisFactor OR (95% CI) P-valueIncorrect answer 1.5 (1.3-1.6) <0.001Foreign-born IMG (vs US MD) 2.5 (1.6-3.8) <0.001More difficult questions 1.3 (1.2-1.4) <0.001Fewer questions done 1.2 (1.0-1.5) 0.097Lower performing student 1.6 (1.2-2.1) 0.001Behavioral science 0.6 (0.5-0.8) <0.001Biochemistry 1.2 (1.0-1.5) 0.045Epidemiology 0.4 (0.3-0.6) <0.001Genetics 0.7 (0.6-1.0) 0.022Pharmacology 0.8 (0.7-1.0) 0.015
![Page 24: USMLE-Rx Medbiq 2016 Learning Loops Clean · $fnqrzohgjphqwv 860/( 5[ -rkq &roolqv $uw *xhsh (ppd 8qghugrzq 9dqghuelow 6fkrro ri 0hglflqh 7rxihht $kphg 3hgur 7h[hlud 8qlyhuvlw\ ri](https://reader031.fdocuments.in/reader031/viewer/2022022601/5b4fa9a27f8b9a5a6f8cd815/html5/thumbnails/24.jpg)
Conclusions• Students appear to readily engage in learning loops when
presented with the opportunity• Factors predicting increased learning loop engagement
include:• Question being incorrectly answered• Increased question difficulty• Student reviewing fewer questions• Student being a lower performer• Student being a foreign-born IMG• Certain subject categories