NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director...
-
Upload
loreen-beasley -
Category
Documents
-
view
214 -
download
0
Transcript of NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director...
![Page 1: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/1.jpg)
NMC Online ConferenceDecember 2005
Assessing Learning in a MORPG
Patricia Youngblood, PhD Director of Evaluation, SUMMIT(Stanford University Medical Media & Information Technology)
Phillip M. Harter, MDResidency Program DirectorDivision of Emergency Medicine Stanford University School of Medicine
![Page 2: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/2.jpg)
NMC Online ConferenceDecember 2005
Comparison of the Virtual ED & HPSHuman Patient
Simulator
Virtual ED (Emergency Department)
![Page 3: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/3.jpg)
NMC Online ConferenceDecember 2005
Virtual ED (Emergency Department)
![Page 4: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/4.jpg)
NMC Online ConferenceDecember 2005
Debriefing with instructor
Student being assessed
Standardized team member
![Page 5: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/5.jpg)
NMC Online ConferenceDecember 2005
Study Design: Pretest/Posttest
30 medical students & interns
Virtual ED Simulator (n=16)pretest case 4 training cases posttest case
Human Patient Simulator “HPS” (n=14)pretest case 4 training cases posttest case
Is there a significant difference in performance between the two student
groups?
![Page 6: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/6.jpg)
NMC Online ConferenceDecember 2005
EMCRM Rating Scale of Team Performance (1-5)
• Knowledge of the environment• Anticipation of & planning for potential problems• Assumption of leadership role• Communication with other team members• Distribution of workload/delegation of responsibility• Attention allocation• Utilization of information• Utilization of resources• Recognition of limitations/call for help early enough• Professional behavior/interpersonal skills• Overall team leadership skills (1= not acceptable; 5=excellent)
![Page 7: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/7.jpg)
NMC Online ConferenceDecember 2005
4. Communication with other Team Members
1 2 3 4 5
Average performance (3): Communicates clearly with all team members; speaks clearly, calls team members by name, can be heard easily
Below Average (1-2): Cannot be heard easily, doesn’t identify to whom he is speaking, talks ‘down’ to other members, does not close the communication loop
Above Average (4-5): Closes the communication loop, thinks/talks out loud so other members can follow his problem solving approach
Guidelines for Scoring Team Leadership in the Virtual ED
![Page 8: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/8.jpg)
Comparison of Pre & Post Mean ScoresM
ea
n S
co
res
0.00
10.00
20.00
30.00
40.00
50.00
HPS Group
Pretest Sum Scores Posttest Sum Scores Pretest Sum Scores Posttest Sum Scores
Virtual ED Group
![Page 9: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/9.jpg)
NMC Online ConferenceDecember 2005
Results Summary
• Users’ performance rating scores improved between pretest case and posttest case with both the MORPG and the Human Patient Simulator;
• Analysis of performance data shows no statistically significant differences between the two treatment groups;
• Reliability of the EMCRM rating scale was high (Cronbach’s alpha = .96);
• Users liked both types of simulation training.
![Page 10: NMC Online Conference December 2005 Assessing Learning in a MORPG Patricia Youngblood, PhD Director of Evaluation, SUMMIT (Stanford University Medical.](https://reader034.fdocuments.in/reader034/viewer/2022051517/5697bf861a28abf838c88079/html5/thumbnails/10.jpg)
NMC Online ConferenceDecember 2005
The Stanford Research Team