7/27/2019 Session 5ee
1/42
Principles of Assessment and Evaluation
CHARACTERISTICS
OF A GOOD ASSESSMENT
Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
7/27/2019 Session 5ee
2/42
Principles of Assessment and Evaluation
Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
Validity & Validity Types
Reliability & Reliability Types
7/27/2019 Session 5ee
3/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity
reliability
characteristics of a good assessment
7/27/2019 Session 5ee
4/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
Lets have a look
at thedefinitions
7/27/2019 Session 5ee
5/42
7/27/2019 Session 5ee
6/42
7/27/2019 Session 5ee
7/42
7/27/2019 Session 5ee
8/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
Hmm arentyou supposed to
have thedefinition with
you?
7/27/2019 Session 5ee
9/42
7/27/2019 Session 5ee
10/42
7/27/2019 Session 5ee
11/42
7/27/2019 Session 5ee
12/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity
Validity is the interpretation of theinformation that the test generates.
It refers to the accuracy of theinterpretation.
7/27/2019 Session 5ee
13/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity
For example, a driving test must include acompetency-based assessment whichrequires the candidates to drive a vehicle
in a real setting.
7/27/2019 Session 5ee
14/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
Can you think of examples of valid or invalid measures for test?
QUESTION
7/27/2019 Session 5ee
15/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity of assessment
Validity of any assessment is dependentupon the purpose of the assessment andthe way in which evidence is interpreted
and used by the key stakeholders.
7/27/2019 Session 5ee
16/42
7/27/2019 Session 5ee
17/42
7/27/2019 Session 5ee
18/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
face validity
content validity
construct validity
validity types
criterion validity
consequential validity
7/27/2019 Session 5ee
19/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
face validity
At surface level, the assessmenttranslates sufficiently the content and
construct being assessed.
7/27/2019 Session 5ee
20/42
7/27/2019 Session 5ee
21/42
7/27/2019 Session 5ee
22/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
construct validity
It refers to the degree to which theinferences can legitimately be made.
Applicable when there is no obvious
body of content or when there are noexisting criteria.
7/27/2019 Session 5ee
23/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
construct validity
The extent a variable is abstract ratherthan concrete, we speak of it as being a
construct .
Such a variable is literally a construct inthat it is something put together from
their own imaginations.
Numally, J.C. (1978) Psychometric Theory
7/27/2019 Session 5ee
24/42
7/27/2019 Session 5ee
25/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
criterion validity
two types of criterion validity:
predictive validity
concurrent validity
7/27/2019 Session 5ee
26/42
7/27/2019 Session 5ee
27/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
concurrent
Occurs when the criterion measures areobtained at the same time as the test scores.
The ability of a measure to indicate anindividuals present standing on the criterion
variable.
criterion validity
7/27/2019 Session 5ee
28/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
reliability
7/27/2019 Session 5ee
29/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
reliability
Reliability is the ability to controlbackground noise.
7/27/2019 Session 5ee
30/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
inter-rater (across assessors)
intra-rater (within assessor)
parallel forms (across tasks)
reliability types
split halves (within task)
internal consistency (within task)
7/27/2019 Session 5ee
31/42
P i i l fA d E l i
7/27/2019 Session 5ee
32/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
intra-rater reliability
Consistency of assessment outcomesacross time and location, and using the
same assessment task administered bythe same assessor.
P i i l fA d E l i
7/27/2019 Session 5ee
33/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
parallel forms reliability
Assessing two different assessments withthe purpose of obtaining consistent
results.
P i i l fA t d E l ti
7/27/2019 Session 5ee
34/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
internal consistency reliability
Concerned with how well the items ortasks act together to elicit a consistent
type of response.
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
35/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
The method used to collect the evidence
will impact on reliability .The way in which the assessor uses and
interprets the evidence collected willimpact on validity .
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
36/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity or reliability?
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
37/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity or reliability?
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
38/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
validity or reliability?
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
39/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
Practicality
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
40/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
In addition to validity and reliability,considerations must also be given to the
aspect of practicality.
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
41/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
practicality
Considerations given to theoperationalization of an assessment (i.e.
cost, stake, worth) which may also affectdecisions on validity and reliability.
PrinciplesofAssessment and Evaluation
7/27/2019 Session 5ee
42/42
Principles of Assessment and Evaluation
CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission
session five
end of session five
Top Related