Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
-
Upload
cyberspaced-educator -
Category
Documents
-
view
588 -
download
0
description
Transcript of Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
SASTA Psychology Summer Conference
Assessment Report 2009
January 2010
2
Introductions Cliff Rothenberg
SASTA Board Member Geoff Slater (short-answer)
Curriculum Leaders Group, SACE Board of SA
Psychology Study Guide Co-Editor, SASTA
Penny Spencer (extended-response) Curriculum Leaders Group, SACE Board
of SA
3
Advice Assessment report
read, digest, and pass to students Like schools data (moderation)
from SACE Board coordinator School Assessment Information report
analyse both statistical and final moderation of your class v total cohort
Moderation Feedback Advice (green) seek advice if movement has been great
Apply to join a marking or moderation panel
4
Assessment Processes
Teams (increases the reliability, validity, and fairness of the outcomes) Setting Vetting Marking 3 (remarks) Final Central Moderation
Expression of interest: advertisements
5
Assessment Modes
Assessment Components Examination (sets the standard) Assignment
Statistically moderated Collaborative Investigation
Central moderation Individual Investigation
Central moderation
6
Examination Specifications
Learning Outcomes 1, 4, 5, and 61 knowledge and understanding4 informed decision making5 application of knowledge6 analysis of behaviour
Rules of thumb 1/3, 1/3, 1/3 mean 60%
7
Specifications
Criteria for judging performance knowledge (40) analysis (25) application (25) evaluation (20) communication (10)Total 120
8
TOPIC
Criteria 1 2 3 4 5 6Ethics
Levels
knowledge
analysis
application
evaluation
communication
Total 120
9
Examination 2009
10
Examination 2008
11
Historical Data
Year Enrolment Mean %
2004 597 61.3
2005 1242 59.6
2006 1740 59.2
2007 1996 55.5
2008 2096 58.4
2009 2851 51.2
12
Research Tools Like schools data Standard deviation, question
means Question facility indices Scaling transformations Moderation reports Score distribution Decile analysis
13
Q1: Focus groups are a QUALITATIVE investigation design Question mean: 62.2%
14
Q2: One disadvantage of EXPERIMENTAL investigation design
Question mean: 62.5%
15
Q4: Describe DELPHI TECHNIQUEQuestion mean: 36.5%
16
Q5: Describe CONTENT ANALYSISQuestion mean: 29.3% (lowest mean for the exam)
17
Q7: One LIMITATION OF SAMPLE (zoo baboons)
Question mean: 84.6%(highest mean for the exam)
18
Q24: EXTENDED RESPONSE 1(Social Cognition –ALCOHOL CAMPAIGNS
and SOCIAL COMPARISON)Question mean: 52.5% (Exam mean 51.2%)
19
Q25: EXTENDED RESPONSE 2(Altered States and Healthy Minds –
STRESS and RESILIENCE IN YEAR 12)Question mean: 52.2% (Exam mean
51.2%)
20
Statistical Moderation Effects
21
Used this data to….
School Assessment Report
22
Moderation Impact
YEARPractical & Social
Relevance Course Work Exam
2000 84 84 68 59 59
2001 83 83 67 65 65
2002 83 82 65 63 63
2003 83 82 65 56 56
2004 82 82 64 58 58
2005 82 82 64 57 57
2006 80 79 65 62 62
…generate this!
After moderation After stat. mod
23
Advice
Assessment report read, digest, and pass to students
Like schools data (moderation) from SACE coordinator
School Assessment Information report analyse both statistical and final moderation
of your class v total cohort Moderation Feedback Advice (green)
seek advice if movement has been great
24