ERGA 2014: Scaffolding research skill development and assessment across the honours year

Said Al-Sarawi, School of EEE, The University of Adelaide

Science & Engineering

Competent

Communicate

Define, formulate and Sol.

Sys. Approach to Design

Team player

Function effectively

Leadermanager

Social & cultural

Enviorn. reasonability

Sust. Design & Develop.

Ethical Respon.

Life-long learning

Engineer

Learning Skills

Problem Solving Skills

Research Skills

Staff Commitment

Curriculum Design

Communication Skills

Relevant Assessment

Flexible Learning

Graduating an

Engineer

Educational Strategies

Skills for Life-long learning

Technology

Beacon of

Enlightenment

New breed of Graduates

Employment landscape

New breed of Graduates

External forces

Student number

AQF

Why Research Skills

Explicit Problem

Solving skills

Explicit list of skills

Curriculum Requirements

Flexible teaching

Flexible learning

Good Communication skills

Strong emphasis on reasoning, thinking &

knowledge

Autonomy development

History of RSD in EEE

•RSD Case Study - 1s

t

Cohort Honours Project Supervision and Assessment

2006

•RSD Case Study – 1st Cohort of Master Assessment

2007

•RSD School wide Honours capstone Assessment

2009

•Positive outcomes were identified

•Annual tweaking is required

•Good level of backing/support is needed

2010

•Initiated Program Level RSD

•Medical Science began mirroring EEE RSD Honour Assessment

2012

•Proposed 7 Majors with RSD embedded at program level

2013

•School Approved these Majors

2014

•Awaiting University approval

2015

Example of RSD Rubric - Honours

Table 1: Final Year Project Assessment Matrix of final performance - Only the first two facets are shown. Also note that the columns’ heading has been replaced grade.

Research Process Specific Attribute

F P C D HD

Fails to satisfy the minimum requirements

Satisfies the minimum

requirements

Demonstrates a high level of

understanding and presentation and a degree of originality and

insight

A very high standard of work

which demonstrates

originality and insight

Outstanding or exceptional work

in terms of understanding,

interpretation and presentation

A. Students embark on inquiry* and so

determine a need for knowledge /

understanding (10%)

Objectives stated

Unclear or inappropriate

Clear but lacks focus

Clear and focused Clear, focused and innovative

Clear, focused, innovative, open

inquiry Context of

project: background and relevant works

Not described/surve

yed/ analysis

Minimally described/surveye

d/ analysis

Satisfactorily described/surveyed. Some analysis

Informative, well-researched &

analyzed

Comprehensive, extensively re-

searched & analyzed

B. Students find/generate

needed information / data / ideas using

appropriate approach / method (20%)

Technical challenges

Vaguely specified

Clearly identified Clearly identified and explained

Clearly identified, explained in

context

Clearly identified, explained in context and

justified References and

citations Minimal use of

or inappropriate

sources

Few appropriate sources

Several appropriate

sources

Numerous appropriate

sources

Numerous appropriate and

wide range of sources

Example of RSD Rubric - Masters

Some Responders’ feedback

How relevant are research skills in your current work?

“very relevant. My work involves a lot of research and finding information from different …,”

“I think they're fairly relevant and they have a broad spectrum to do with facets,”

“Quite relevant. I need it for being able to analyse … the gap…”

RSD for Honours: Issues and LessonsSignificant investment in effort for School staff

Especially “core” personnel e.g. course coordinators, champion

Transition arrangements must be communicated to students and staff members alike

Staff training on assessment principles would particularly be useful

New for many students Increases quantity, and subsequently, the demand for feedback

Interpretation issues for descriptions

Acceptance issues can arise Among staff members: considered a waste of time

Inhomogeneous application across the course

Impact with regards to workload, supervision, feedback, … etc

Evaluation should be integrated

Embedded throughout the year

Student interviews? Other reflections?

Utilise RSD Community Lots of resources and support exist, always worth having a look.