SASTA Psychology Summer Conference

Assessment Report 2009

January 2010

2

Introductions Cliff Rothenberg

SASTA Board Member Geoff Slater (short-answer)

Curriculum Leaders Group, SACE Board of SA

Psychology Study Guide Co-Editor, SASTA

Penny Spencer (extended-response) Curriculum Leaders Group, SACE Board

of SA

3

Advice Assessment report

read, digest, and pass to students Like schools data (moderation)

from SACE Board coordinator School Assessment Information report

analyse both statistical and final moderation of your class v total cohort

Moderation Feedback Advice (green) seek advice if movement has been great

Apply to join a marking or moderation panel

4

Assessment Processes

Teams (increases the reliability, validity, and fairness of the outcomes) Setting Vetting Marking 3 (remarks) Final Central Moderation

Expression of interest: advertisements

5

Assessment Modes

Assessment Components Examination (sets the standard) Assignment

Statistically moderated Collaborative Investigation

Central moderation Individual Investigation

Central moderation

6

Examination Specifications

Learning Outcomes 1, 4, 5, and 61 knowledge and understanding4 informed decision making5 application of knowledge6 analysis of behaviour

Rules of thumb 1/3, 1/3, 1/3 mean 60%

7

Specifications

Criteria for judging performance knowledge (40) analysis (25) application (25) evaluation (20) communication (10)Total 120

8

TOPIC

Criteria 1 2 3 4 5 6Ethics

Levels

knowledge

analysis

application

evaluation

communication

Total 120

9

Examination 2009

10

Examination 2008

11

Historical Data

Year Enrolment Mean %

2004 597 61.3

2005 1242 59.6

2006 1740 59.2

2007 1996 55.5

2008 2096 58.4

2009 2851 51.2

12

Research Tools Like schools data Standard deviation, question

means Question facility indices Scaling transformations Moderation reports Score distribution Decile analysis

13

Q1: Focus groups are a QUALITATIVE investigation design Question mean: 62.2%

14

Q2: One disadvantage of EXPERIMENTAL investigation design

Question mean: 62.5%

15

Q4: Describe DELPHI TECHNIQUEQuestion mean: 36.5%

16

Q5: Describe CONTENT ANALYSISQuestion mean: 29.3% (lowest mean for the exam)

17

Q7: One LIMITATION OF SAMPLE (zoo baboons)

Question mean: 84.6%(highest mean for the exam)

18

Q24: EXTENDED RESPONSE 1(Social Cognition –ALCOHOL CAMPAIGNS

and SOCIAL COMPARISON)Question mean: 52.5% (Exam mean 51.2%)

19

Q25: EXTENDED RESPONSE 2(Altered States and Healthy Minds –

STRESS and RESILIENCE IN YEAR 12)Question mean: 52.2% (Exam mean

51.2%)

20

Statistical Moderation Effects

21

Used this data to….

School Assessment Report

22

Moderation Impact

YEARPractical & Social

Relevance Course Work Exam

2000 84 84 68 59 59

2001 83 83 67 65 65

2002 83 82 65 63 63

2003 83 82 65 56 56

2004 82 82 64 58 58

2005 82 82 64 57 57

2006 80 79 65 62 62

…generate this!

After moderation After stat. mod

23

Advice

Assessment report read, digest, and pass to students

Like schools data (moderation) from SACE coordinator

School Assessment Information report analyse both statistical and final moderation

of your class v total cohort Moderation Feedback Advice (green)

seek advice if movement has been great

24