Roland - Evaluating Education
-
Upload
oliflower -
Category
Health & Medicine
-
view
889 -
download
0
description
Transcript of Roland - Evaluating Education
![Page 1: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/1.jpg)
Evaluating
Education
![Page 2: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/2.jpg)
This talk may save
Your life
![Page 3: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/3.jpg)
This talk may save
you strifeYour life
![Page 4: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/4.jpg)
Evaluating
Educationbit.ly/evalref
![Page 5: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/5.jpg)
![Page 6: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/6.jpg)
Education is rarely described as an intervention
![Page 7: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/7.jpg)
![Page 8: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/8.jpg)
Reaction
![Page 9: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/9.jpg)
Reaction
Learning
![Page 10: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/10.jpg)
Reaction
Learning
Behaviour
![Page 11: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/11.jpg)
Reaction
Learning
Behaviour
Results
![Page 12: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/12.jpg)
![Page 13: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/13.jpg)
bit.ly/evalref
![Page 14: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/14.jpg)
![Page 15: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/15.jpg)
Did a specific outcome occur?
![Page 16: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/16.jpg)
What were the outcomes of this intervention?
![Page 17: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/17.jpg)
![Page 18: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/18.jpg)
Statistical Conclusion Validity
Internal Validity
Construct Validity
External Validity
The four criterion of methodological quality according to Shadish, Cook and Campbell
bit.ly/mededvalidity
![Page 19: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/19.jpg)
Time
Change)
Intervention
![Page 20: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/20.jpg)
Time
Change
Intervention
Population
Population
Population
![Page 21: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/21.jpg)
Population(e.g Under or
Postgraduates)
• Sample Size• Power Calculation• Criterion for
Statistical Significance Used
Tim
Change)
Intervention
Statistical Conclusion Validity is the extent to whether the statistical analysis can correctly identify a change if it is present
Population• Was there a risk of a
type II error?
Population• Were all outcomes
correctly powered?
Population
![Page 22: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/22.jpg)
Time (Which can be hours e,g pre and post test or up to years)
Change (Which can be measured in a variety of ways)
Intervention
Internal Validity is the extent to which the intervention can reliably be ascribed to have effected the change
Population
Population
Population
bit.ly/mededvalidity
![Page 23: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/23.jpg)
Threats to Internal Validity are best analysed by considering an intervention
and control group
• HistoryAnother event happens at
the same time as the intervention
• SelectionThere are pre-existing differences
between the groups• Regression to the Mean
Extreme pre-test baseline performance may mean change happens by chance (e.g. unusually good or bad at outset)
• MaturationThere is already a pre-existing trend for
change
• InstrumentationThere are changes in the methods of measurement
(e.g data collectors become more experienced)
• TestingPre-testing changes the performance of
participants (e.g. promotes information seeking)
• Differential AttritionDrop out from the study is not equal
between groups
Intervention GroupControl Group
![Page 24: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/24.jpg)
Time (Which can be hours e,g pre and post test or up to years)
Change Y (Which can be measured in a variety of ways)
Intervention A Population
Construct Validity relates to the association between the concept you are investigating and the measures you use to test it
![Page 25: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/25.jpg)
Time (Which can be hours e,g pre and post test or up to years)
Change (Which can be measured in a variety of ways)
Intervention Population A
External Validity is the extent to which the intervention is reliable in different populations (this may in terms of participants, settings, times etc)
![Page 26: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/26.jpg)
Time (Which can be hours e,g pre and post test or up to years)
Change (Which can be measured in a variety of ways)
Intervention
Population B
![Page 27: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/27.jpg)
Statistical Conclusion Validity
Internal Validity
Construct Validity
External Validity
![Page 28: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/28.jpg)
InteractionInteraction
![Page 29: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/29.jpg)
InteractionInteraction
Inte
rfac
eIn
terf
ace
![Page 30: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/30.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)Inte
rfac
eIn
terf
ace
![Page 31: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/31.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)
Ideation
Ideation
Inte
rfac
eIn
terf
ace
![Page 32: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/32.jpg)
![Page 33: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/33.jpg)
![Page 34: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/34.jpg)
![Page 35: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/35.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)
Ideation
Integration
i) Knowledgeii) Behaviour
Ideation
Integration
i) Knowledgeii) Behaviour
Inte
rfac
eIn
terf
ace
![Page 36: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/36.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)
Ideation
Integration
i) Knowledgeii) Behaviour
Ideation
Integration
i) Knowledgeii) Behaviour
Impl
emen
tatio
nIm
plem
enta
tion
Inte
rfac
eIn
terf
ace
![Page 37: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/37.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)
Ideation
Integration
i) Knowledgeii) Behaviour
Ideation
Integration
i) Knowledgeii) Behaviour
Impl
emen
tatio
nIm
plem
enta
tion
Inte
rfac
eIn
terf
ace
Impr
ovem
ent
Impr
ovem
ent
![Page 38: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/38.jpg)
InteractionInteraction
Instruction
(The educational
Intervention)
Ideation
Integration
i) Knowledgeii) Behaviour
Ideation
Integration
i) Knowledgeii) Behaviour
Impl
emen
tatio
nIm
plem
enta
tion
Inte
rfac
eIn
terf
ace
Impr
ovem
ent
Impr
ovem
ent
The 7I’s Framework
![Page 39: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/39.jpg)
Thanks
SMACCProf. Tim Coats + Dr. David MathesonDr. Ffion DaviesStaff/Patients at Leicester Royal Infirmary
![Page 40: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/40.jpg)
@damian_roland
![Page 41: Roland - Evaluating Education](https://reader035.fdocuments.in/reader035/viewer/2022062702/554ae6a6b4c9056a798b53ed/html5/thumbnails/41.jpg)
Education is rarely described as an intervention