new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new...
Transcript of new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new...
![Page 1: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/1.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastricht
new directions in assessment
new directions in assessment
new directions in assessment
Lambert Schuwirth
![Page 2: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/2.jpg)
Universiteit Maastrichtnew directions in assessment
overview
some basics about assessment
from traits to competenciesfrom traits to competencies
programmes of assessment
![Page 3: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/3.jpg)
Universiteit Maastrichtnew directions in assessment
basic introduction
what is essential?what is essential?
the good doctor
![Page 4: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/4.jpg)
Universiteit Maastrichtnew directions in assessment
what is a good doctor?
reflective persongood attitude
good practicefinancial expert
know’s much
skills
reflective person
good team worker
communicates well
good attitude
has life experience
good manager
empathic person
good problem-solver
![Page 5: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/5.jpg)
Universiteit Maastrichtnew directions in assessment
simple isn’t it?
pass competent
test
fail incompetent
![Page 6: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/6.jpg)
Universiteit Maastrichtnew directions in assessment
simple, it isn’t
competent incompetent
pass
fail
![Page 7: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/7.jpg)
Universiteit Maastrichtnew directions in assessment
two major problems
assessment is often measurement of
competence rather than of performance����
no extrinsic standards for criterion validity exist����
![Page 8: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/8.jpg)
Universiteit Maastrichtnew directions in assessment
what do we have?
intrinsic standardsintrinsic standards
![Page 9: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/9.jpg)
Universiteit Maastrichtnew directions in assessment
U = R V E C A× × × ×
R = reliability
intrinsic standards
R = reliability
V = validity
E = educational impact
C = costs
A = acceptance
![Page 10: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/10.jpg)
Universiteit Maastricht
reliability
new directions in assessment
0% 100%58%48% 68%
![Page 11: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/11.jpg)
Universiteit Maastricht
reliability: sampling error
new directions in assessment
![Page 12: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/12.jpg)
Universiteit Maastricht
reliability: measurement error
new directions in assessment
![Page 13: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/13.jpg)
Universiteit Maastricht
reliability: considerations
new directions in assessment
cut-off score
A B
C D
![Page 14: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/14.jpg)
Universiteit Maastrichtnew directions in assessment
validity
test goaltest content
practice demands
![Page 15: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/15.jpg)
Universiteit Maastrichtnew directions in assessment
validity: indirect validity
an examination is a psychological test and
should be validated accordingly:should be validated accordingly:
- correlations- differences in mean scores- factor analyses
![Page 16: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/16.jpg)
Universiteit Maastrichtnew directions in assessment
validity: direct validity
an examination is a set of discipline relevant
assignments and must be validated as such:assignments and must be validated as such:
- blueprinting- item construction- quality control
![Page 17: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/17.jpg)
Universiteit Maastrichtnew directions in assessment
educational impact
curriculum assessment
content
teacher student
content
format
scheduling
regulatory structure
![Page 18: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/18.jpg)
Universiteit Maastrichtnew directions in assessment
costs
- assessment is important, but
- assessment is expensive, and
- high quality assessment is very expensive
![Page 19: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/19.jpg)
Universiteit Maastrichtnew directions in assessment
acceptance
- political issues
- support within the faculty
- responsibility towards society
![Page 20: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/20.jpg)
Universiteit Maastrichtnew directions in assessment
U = Rw Vw Ew C
w
Aw× × × ×
R = reliability
intrinsic standards
R = reliability
V = validity
E = educational impact
C = costs
A = acceptance
w = weight
![Page 21: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/21.jpg)
Universiteit Maastrichtnew directions in assessment
importance
choices
100 %
R V E C A
0 %
aspect
![Page 22: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/22.jpg)
Universiteit Maastrichtnew directions in assessment
importance
choices: commerical institute
100 %
R V E C A
0 %
aspect
![Page 23: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/23.jpg)
Universiteit Maastricht
belang
choices: educational situation
100 %
new directions in assessment
B V E K A
0 %
aspect
![Page 24: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/24.jpg)
Universiteit Maastrichtnew directions in assessment
overview
some basics about assessment
from traits to competenciesfrom traits to competencies
programmes of assessment
![Page 25: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/25.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
- Mini-CEX
three new instruments….
![Page 26: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/26.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
![Page 27: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/27.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
- Mini-CEX
- Multi-source feedback / 360°feedback
three new instruments….
- Multi-source feedback / 360°feedback
![Page 28: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/28.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
![Page 29: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/29.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
- Mini-CEX
- Multi-source feedback / 360°feedback
three new instruments….
- Multi-source feedback / 360°feedback
- Portfolio
![Page 30: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/30.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
Patient Management Problems
OSCEs
on top of many old ones
Modified essay Questions
Computer-based testing
Extended-Matching Items
![Page 31: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/31.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
three new stars in the sky
![Page 32: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/32.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
new methods � new hypes?
or not
![Page 33: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/33.jpg)
old model of medical competence
Universiteit Maastricht
knowledge skills problem
solving
attitudes
new directions in assessment
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
![Page 34: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/34.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications
traits are stable and generic characteristics
![Page 35: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/35.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
1 2 3 4
A 1 1 1 1 4
5 6 7 8
1 1 1 1 4
B
C
.5 .5 .5 .5
0 0 0 0
2
0
.5 .5 .5 .5
0 0 0 0
2
0
![Page 36: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/36.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
1 2 3 4
A 0 .5 .5 0 1
5 6 7 8
1 0 .5 1 2
B
C
1 .5 0 1
1 1 .5 1
2.5
3.5
1 .5 0 0
1 .5 0 0
2
1.5
![Page 37: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/37.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications
traits are stable and generic characteristics
individual items in themselves are meaningless
![Page 38: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/38.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
Ms. Smit is 72 years old. She has angina.
Several times her blood pressure is taken and
found to be 170/100 mmHg.Which antihypertensive drug is most indicated Which antihypertensive drug is most indicated
for her??
a captopril.
b chloorthalidon.
c metoprolol.
![Page 39: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/39.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
Mr. Johnson, 35 years old, consults his GP with
complaints of chest pain. Without further information
about Mr. Johnson the most likely origin of his chest pain is:chest pain is:
a the chest wall;
b the lungs;
c the myocardium;
d the esophagus.
![Page 40: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/40.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
resuscitation station in an OSCE
![Page 41: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/41.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
communication station in an OSCE
![Page 42: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/42.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications
traits are stable and generic characteristics
individual items in themselves are meaningless
sum scores determine what the test measures
statistics are based on elimination of information
![Page 43: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/43.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
1
2
3
a
c
b
b
c
a
0
1
0
100%
failed3
4
5
6
b
a
a
e
a
a
b
e
0
1
0
1
50%
0%
failed
![Page 44: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/44.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications
traits are stable and generic characteristics
individual items in themselves are meaningless
one single best instrument for each trait
sum scores determine what the test measures
statistics are based on elimination of information
![Page 45: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/45.jpg)
old model of medical competence
Universiteit Maastricht
knowledge skills problem
solving
attitudes
new directions in assessment
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
![Page 46: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/46.jpg)
typical approach
Universiteit Maastrichtnew directions in assessment
MCQs: factual knowledge
OEQs: understanding, reasoningOEQs: understanding, reasoning
OSCEs: skills
SPs: performance
Portfolios: reflection/professionalism
![Page 47: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/47.jpg)
but what then?
Universiteit Maastrichtnew directions in assessment
but what then?
![Page 48: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/48.jpg)
Universiteit Maastricht
does
Miller's pyramid
new directions in assessment
knows
knows how
shows how
![Page 49: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/49.jpg)
Universiteit Maastricht
competencies
new directions in assessment
competencies are simple or more complex tasks a successful candidate must be able to handle, and during which s/he uses at the to handle, and during which s/he uses at the
right time the correct and relevant knowledge, skills, attitudes and meta-cognitions to
manage the case successfully.
![Page 50: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/50.jpg)
Universiteit Maastricht
roles of competency domains
new directions in assessment
roles:
1 medical expert2 scientist3 worker in the health care system4 person
![Page 51: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/51.jpg)
Universiteit Maastrichtnew directions in assessment
overview
some basics about assessment
from traits to competenciesfrom traits to competencies
programmes of assessment
![Page 52: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/52.jpg)
old model of medical competence
Universiteit Maastricht
medical
expert
scientist worker in
the HCS
person
new directions in assessment
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
instrument
![Page 53: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/53.jpg)
Universiteit Maastrichtnew directions in assessment
1 role – 1 instrument?
instruments
A B C D
med expert
scientistroles
worker in HCS
person.
![Page 54: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/54.jpg)
Universiteit Maastrichtnew directions in assessment
multi-modal assessment
A B C D
information sources
roles
med expert
scientist
worker in HCS
person.
![Page 55: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/55.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications
competencies are not stable characteristics
individual items are in themselves meaningful
sampling is more important than objectivity
judgement/feedback on the basis of rich information
a variety of instruments is needed for judgement
![Page 56: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/56.jpg)
Universiteit Maastricht
traditional approach: testing as screening
new directions in assessment
competent incompetent
passes
fails
![Page 57: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/57.jpg)
Universiteit Maastricht
modern approaches: assessment like patient care
new directions in assessment
progress
reportlab values
pathology
I.C.C.report
lab values
radiodiag-
nostics.
I.C.C.
![Page 58: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/58.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
what is the difference?
information rich judgements right until the end
goal is management: sampling and student learning
requires flexible education and training
not just a mere totaling of the results
final judgement is expert judgement
![Page 59: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/59.jpg)
How to do this?
Universiteit Maastrichtnew directions in assessment
How to do this?
![Page 60: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/60.jpg)
clinical practice
Universiteit Maastrichtnew directions in assessment
flexible individualised
combination of quantitative and qualitativecombination of quantitative and qualitative
objective and subjective ‘measurements’
individualised norm
trustworthy/open/ transparant
![Page 61: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/61.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
central document: patient chart
lab values
history and physical
imaging, pathology, etc.
follow up notes:
diagnostic decisions
therapeutic decisions prognostic decisions
![Page 62: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/62.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
central document: portfolio
formal subjective assessment results
formal objective assessment results
informal feedback
reflections/ minutes:
diagnostic
therapeutic prognostic
![Page 63: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/63.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
implications for the research agenda
design criteria for assessment programmes
how to combine information from various sources
how to scaffold human judgement
safe procedures
probabilistic psychometrics
![Page 64: new directions in assessment2010+new... · 2016. 2. 5. · Universiteit Maastricht competencies new directions in assessment competencies are simple or more complex tasks a successful](https://reader036.fdocuments.in/reader036/viewer/2022071515/6136bb4d0ad5d206764835b5/html5/thumbnails/64.jpg)
Universiteit MaastrichtUniversiteit MaastrichtUniversiteit MaastrichtUniversiteit Maastrichtnew directions in assessment
Thank youThank you