NSS 2013

Strategic Meeting of Senate

11 September 2013

Dr Veena O’Halloran

Director of Student Experience and Enhancement Services

Presentation

• What the NSS survey is telling us• Themes• How we compare with the sector • Discussion on means of addressing issues

Strategic theme:“Outstanding teaching and student experience”

What we want to achieve:- •An outstanding and distinctive student experience•Personalised student support•Satisfied, skilled and successful graduates

Are we achieving these objectives?

NSS 2013 tells us we are not.

Positive feedback

42%

26%

5%4%5%

5%9%

4%

Staff

Course content & structure

Assessment & feedback

Organisation and man-agement

Facilities and Resources

General positive comments

Personal and professional development

Environment

Negative feedback

20%

22%

20%

31%

7%

1%

StaffCourse contentAssessment & FeedbackCourse Organisation & AdministrationFacilities and ResourcesGeneral Negatives

Positive vs Negative feedback

42%

26%

5%

4%

5%

5%

9%4%

Positive

Staff

Course content & structure

Assessment & feedback

Organisation and man-agement

Facilities and Resources

General positive comments

Personal and professional development

Environment

20%

22%

20%

31%

7%

1%

Negative

Negative Themes

• Organisation and Management– General organisation of courses– Organisation of the timetable– Clashes– Communication of changes

• Course Content- Workload

• Assessment and Feedback– Inadequate– Late

• Some Staff- Unsupportive and unhelpful

Not new:Outcomes over recent years

2009 2010 2011 2012 201355

60

65

70

75

80

85

90

95

Organisation & ManagementAssessment & FeedbackAcademic SupportTeaching on my courseLearning ResourcesPersonal DevelopmentOverall Satisfaction

Teaching on my course

Bath (U

niversi

ty of)

Glasgo

w (Unive

rsity

of)

Surre

y (Unive

rsity

of)

Sheffi

eld (U

niversi

ty of)

Imperi

al Colleg

e London

Southam

pton (Unive

rsity

of)

Aston Unive

rsity

Heriot-W

att Unive

rsity

Lough

borough Unive

rsity

Manch

ester

(Unive

rsity

of)

Warwick

(Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Brunel Unive

rsity

80

82

84

86

88

90

92

94

12 benchmarking institutions

St Andrew

s (Unive

rsity

of)

Glasgo

w (Unive

rsity

of)

Aberdee

n (Unive

rsity

of)

Dundee (U

niversi

ty of)

Queen M

argare

t Unive

rsity

Edinburgh

Stirli

ng (Unive

rsity

of)

Universi

ty of th

e High

lands a

nd Islan

ds

Edinburgh

Napier

Universi

ty

Heriot-W

att Unive

rsity

Royal C

onserva

toire

of Sco

tland

Strath

clyde (

Universi

ty of)

Universi

ty of A

bertay

Dundee

Edinburgh

(Unive

rsity

of)

Robert Gord

on Universi

ty

Glasgo

w Caledonian

Universi

ty

Universi

ty of th

e West

of Sco

tland

Glasgo

w School o

f Art

76

78

80

82

84

86

88

90

92

94

96

Scottish institutions

Institute

of Educati

on

East A

nglia (U

niversi

ty of)

Goldsmith

s, Unive

rsity

of London

Lancas

ter Unive

rsity

Royal Hollo

way, Unive

rsity

of London

Essex

(Unive

rsity

of)

Leices

ter (U

niversi

ty of)

School o

f Orie

ntal an

d African

Studies

Birkbeck

College

Susse

x (Unive

rsity

of)

Lough

borough Unive

rsity

Strath

clyde (

Universi

ty of)

80828486889092949698

100

1994 group

Assessment & feedback

Institute

of Educati

on

Essex

(Unive

rsity

of)

East A

nglia (U

niversi

ty of)

Lough

borough Unive

rsity

Leices

ter (U

niversi

ty of)

Royal Hollo

way, Unive

rsity

of London

Birkbeck

College

Lancas

ter Unive

rsity

Goldsmith

s, Unive

rsity

of London

School o

f Orie

ntal an

d African

Studies

Susse

x (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

50556065707580859095

1994 group

Heriot-W

att Unive

rsity

Aston Unive

rsity

Bath (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Brunel Unive

rsity

Lough

borough Unive

rsity

Sheffi

eld (U

niversi

ty of)

Glasgo

w (Unive

rsity

of)

Manch

ester

(Unive

rsity

of)

Southam

pton (Unive

rsity

of)

Imperi

al Colleg

e London

Warwick

(Unive

rsity

of)

Strath

clyde (

Universi

ty of)

404550556065707580

12 benchmarking institutions

Universi

ty of th

e High

lands a

nd Islan

ds

St Andrew

s (Unive

rsity

of)

Heriot-W

att Unive

rsity

Robert Gord

on Universi

ty

Edinburgh

Napier

Universi

ty

Glasgo

w School o

f Art

Glasgo

w (Unive

rsity

of)

Stirli

ng (Unive

rsity

of)

Dundee (U

niversi

ty of)

Universi

ty of th

e West

of Sco

tland

Aberdee

n (Unive

rsity

of)

Glasgo

w Caledonian

Universi

ty

Queen M

argare

t Unive

rsity

Edinburgh

Strath

clyde (

Universi

ty of)

Universi

ty of A

bertay

Dundee

Royal C

onserva

toire

of Sco

tland

Edinburgh

(Unive

rsity

of) 40

45

50

55

60

65

70

75

80

85

Scottish institutions

Academic support

St Andrew

s (Unive

rsity

of)

Heriot-W

att Unive

rsity

Universi

ty of A

bertay

Dundee

Universi

ty of th

e High

lands a

nd Islan

ds

Dundee (U

niversi

ty of)

Royal C

onserva

toire

of Sco

tland

Glasgo

w (Unive

rsity

of)

Robert Gord

on Universi

ty

Queen M

argare

t Unive

rsity

Edinburgh

Strath

clyde (

Universi

ty of)

Aberdee

n (Unive

rsity

of)

Edinburgh

Napier

Universi

ty

Glasgo

w Caledonian

Universi

ty

Universi

ty of th

e West

of Sco

tland

Stirli

ng (Unive

rsity

of)

Glasgo

w School o

f Art

Edinburgh

(Unive

rsity

of) 65

70

75

80

85

90

Scottish institutions

Institute

of Educati

on

East A

nglia (U

niversi

ty of)

Essex

(Unive

rsity

of)

Leices

ter (U

niversi

ty of)

Lough

borough Unive

rsity

Susse

x (Unive

rsity

of)

Goldsmith

s, Unive

rsity

of London

Lancas

ter Unive

rsity

Royal Hollo

way, Unive

rsity

of London

Strath

clyde (

Universi

ty of)

School o

f Orie

ntal an

d African

Studies

Birkbeck

College

50556065707580859095

1994 group

Bath (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Aston Unive

rsity

Brunel Unive

rsity

Heriot-W

att Unive

rsity

Sheffi

eld (U

niversi

ty of)

Lough

borough Unive

rsity

Glasgo

w (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Imperi

al Colleg

e London

Manch

ester

(Unive

rsity

of)

Southam

pton (Unive

rsity

of)

Warwick

(Unive

rsity

of) 74

76

78

80

82

84

86

88

12 benchmarking institutions

Organisation & managementBath

(Unive

rsity

of)

Aston Unive

rsity

Lough

borough Unive

rsity

Sheffi

eld (U

niversi

ty of)

Heriot-W

att Unive

rsity

Southam

pton (Unive

rsity

of)

Surre

y (Unive

rsity

of)

Brunel Unive

rsity

Imperi

al Colleg

e London

Warwick

(Unive

rsity

of)

Manch

ester

(Unive

rsity

of)

Glasgo

w (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

50556065707580859095

12 benchmarking institutions

St Andrew

s (Unive

rsity

of)

Heriot-W

att Unive

rsity

Aberdee

n (Unive

rsity

of)

Glasgo

w (Unive

rsity

of)

Stirli

ng (Unive

rsity

of)

Edinburgh

(Unive

rsity

of)

Robert Gord

on Universi

ty

Universi

ty of th

e West

of Sco

tland

Universi

ty of A

bertay

Dundee

Dundee (U

niversi

ty of)

Edinburgh

Napier

Universi

ty

Glasgo

w Caledonian

Universi

ty

Queen M

argare

t Unive

rsity

Edinburgh

Strath

clyde (

Universi

ty of)

Universi

ty of th

e High

lands a

nd Islan

ds

Glasgo

w School o

f Art

Royal C

onserva

toire

of Sco

tland

50

55

60

65

70

75

80

85

90

Scottish institutions

Institute

of Educati

on

Essex

(Unive

rsity

of)

East A

nglia (U

niversi

ty of)

Lough

borough Unive

rsity

Royal Hollo

way, Unive

rsity

of London

Lancas

ter Unive

rsity

Susse

x (Unive

rsity

of)

Leices

ter (U

niversi

ty of)

Goldsmith

s, Unive

rsity

of London

Birkbeck

College

School o

f Orie

ntal an

d African

Studies

Strath

clyde (

Universi

ty of)

50556065707580859095

100

1994 group

Learning resources

East A

nglia (U

niversi

ty of)

Institute

of Educati

on

Leices

ter (U

niversi

ty of)

Strath

clyde (

Universi

ty of)

Lough

borough Unive

rsity

Lancas

ter Unive

rsity

Susse

x (Unive

rsity

of)

School o

f Orie

ntal an

d African

Studies

Essex

(Unive

rsity

of)

Goldsmith

s, Unive

rsity

of London

Royal Hollo

way, Unive

rsity

of London

Birkbeck

College

7274767880828486889092

1994 group

Imperi

al Colleg

e London

Bath (U

niversi

ty of)

Brunel Unive

rsity

Sheffi

eld (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Glasgo

w (Unive

rsity

of)

Manch

ester

(Unive

rsity

of)

Southam

pton (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Lough

borough Unive

rsity

Warwick

(Unive

rsity

of)

Aston Unive

rsity

Heriot-W

att Unive

rsity

808284868890929496

12 benchmarking institutions

Royal C

onserva

toire

of Sco

tland

Aberdee

n (Unive

rsity

of)

Glasgo

w (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Dundee (U

niversi

ty of)

Edinburgh

Napier

Universi

ty

Edinburgh

(Unive

rsity

of)

Glasgo

w School o

f Art

Robert Gord

on Universi

ty

Glasgo

w Caledonian

Universi

ty

Heriot-W

att Unive

rsity

Queen M

argare

t Unive

rsity

Edinburgh

St Andrew

s (Unive

rsity

of)

Stirli

ng (Unive

rsity

of)

Universi

ty of A

bertay

Dundee

Universi

ty of th

e West

of Sco

tland

Universi

ty of th

e High

lands a

nd Islan

ds 70

75

80

85

90

95

Scottish institutions

Personal development

Dundee (U

niversi

ty of)

Robert Gord

on Universi

ty

Royal C

onserva

toire

of Sco

tland

Glasgo

w (Unive

rsity

of)

Heriot-W

att Unive

rsity

St Andrew

s (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Queen M

argare

t Unive

rsity

Edinburgh

Universi

ty of th

e High

lands a

nd Islan

ds

Glasgo

w Caledonian

Universi

ty

Glasgo

w School o

f Art

Aberdee

n (Unive

rsity

of)

Edinburgh

Napier

Universi

ty

Stirli

ng (Unive

rsity

of)

Universi

ty of th

e West

of Sco

tland

Universi

ty of A

bertay

Dundee

Edinburgh

(Unive

rsity

of) 70

72

74

76

78

80

82

84

86

88

Scottish institutions

East A

nglia (U

niversi

ty of)

Strath

clyde (

Universi

ty of)

Essex

(Unive

rsity

of)

Lancas

ter Unive

rsity

Leices

ter (U

niversi

ty of)

Institute

of Educati

on

Lough

borough Unive

rsity

Susse

x (Unive

rsity

of)

Goldsmith

s, Unive

rsity

of London

Royal Hollo

way, Unive

rsity

of London

Birkbeck

College

School o

f Orie

ntal an

d African

Studies

65

70

75

80

85

90

95

1994 group

Bath (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Aston Unive

rsity

Glasgo

w (Unive

rsity

of)

Heriot-W

att Unive

rsity

Strath

clyde (

Universi

ty of)

Imperi

al Colleg

e London

Sheffi

eld (U

niversi

ty of)

Brunel Unive

rsity

Lough

borough Unive

rsity

Southam

pton (Unive

rsity

of)

Warwick

(Unive

rsity

of)

Manch

ester

(Unive

rsity

of) 76

78

80

82

84

86

88

90

12 benchmarking institutions

Overall satisfaction

Bath (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Aston Unive

rsity

Heriot-W

att Unive

rsity

Sheffi

eld (U

niversi

ty of)

Glasgo

w (Unive

rsity

of)

Lough

borough Unive

rsity

Southam

pton (Unive

rsity

of)

Brunel Unive

rsity

Imperi

al Colleg

e London

Strath

clyde (

Universi

ty of)

Warwick

(Unive

rsity

of)

Manch

ester

(Unive

rsity

of) 808284868890929496

12 benchmarking institutions

St Andrew

s (Unive

rsity

of)

Heriot-W

att Unive

rsity

Glasgo

w (Unive

rsity

of)

Dundee (U

niversi

ty of)

Aberdee

n (Unive

rsity

of)

Robert Gord

on Universi

ty

Stirli

ng (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Edinburgh

Napier

Universi

ty

Glasgo

w Caledonian

Universi

ty

Royal C

onserva

toire

of Sco

tland

Universi

ty of A

bertay

Dundee

Universi

ty of th

e High

lands a

nd Islan

ds

Universi

ty of th

e West

of Sco

tland

Queen M

argare

t Unive

rsity

Edinburgh

Edinburgh

(Unive

rsity

of)

Glasgo

w School o

f Art

70

75

80

85

90

95

Scottish institutions

Institute

of Educati

on

East A

nglia (U

niversi

ty of)

Essex

(Unive

rsity

of)

Lancas

ter Unive

rsity

Leices

ter (U

niversi

ty of)

Royal Hollo

way, Unive

rsity

of London

Susse

x (Unive

rsity

of)

Goldsmith

s, Unive

rsity

of London

Lough

borough Unive

rsity

School o

f Orie

ntal an

d African

Studies

Birkbeck

College

Strath

clyde (

Universi

ty of)

80828486889092949698

1994 group

Students’ Union

Lough

borough Unive

rsity

East A

nglia (U

niversi

ty of)

Leices

ter (U

niversi

ty of)

Essex

(Unive

rsity

of)

Strath

clyde (

Universi

ty of)

School o

f Orie

ntal an

d African

Studies

Lancas

ter Unive

rsity

Susse

x (Unive

rsity

of)

Goldsmith

s, Unive

rsity

of London

Birkbeck

College

Royal Hollo

way, Unive

rsity

of London

Institute

of Educati

on50

55

60

65

70

75

80

85

90

1994 group

Sheffi

eld (U

niversi

ty of)

Lough

borough Unive

rsity

Bath (U

niversi

ty of)

Surre

y (Unive

rsity

of)

Brunel Unive

rsity

Imperi

al Colleg

e London

Glasgo

w (Unive

rsity

of)

Warwick

(Unive

rsity

of)

Southam

pton (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Manch

ester

(Unive

rsity

of)

Heriot-W

att Unive

rsity

Aston Unive

rsity

50556065707580859095

100

12 benchmarking institutions

Dundee (U

niversi

ty of)

Glasgo

w (Unive

rsity

of)

Glasgo

w School o

f Art

St Andrew

s (Unive

rsity

of)

Strath

clyde (

Universi

ty of)

Universi

ty of A

bertay

Dundee

Robert Gord

on Universi

ty

Heriot-W

att Unive

rsity

Royal C

onserva

toire

of Sco

tland

Aberdee

n (Unive

rsity

of)

Universi

ty of th

e West

of Sco

tland

Glasgo

w Caledonian

Universi

ty

Edinburgh

(Unive

rsity

of)

Stirli

ng (Unive

rsity

of)

Edinburgh

Napier

Universi

ty

Universi

ty of th

e High

lands a

nd Islan

ds

Queen M

argare

t Unive

rsity

Edinburgh

40

45

50

55

60

65

70

75

80

85

Scottish institutions

What do we need to address?

•Culture•Leadership, roles and responsibilities •Communication – what, when and how?•Consistency across depts./schools, across each and between faculties•Transparency through monitoring

Strategic FocusAlready in hand:

Assessment and Feedback Champion, Dr Lizann Bonnar:

a) New institutional Assessment & Feedback policy (Target: Nov Senate);

b) Wider scoping of Assessment and Feedback issues - Consistency of practice: institution-wide agreed turnaround time for feedback on assessmentsUniversity-wide staff network for assessment and feedback focus.

Quality Assurance and performance monitoring:

c) QAC – best practice, policy, consistency of practice and turnaround times implementationd) Departments/schools to report to QAC on how they are performing against thesee) HR Policies; and role recognition; ADR; CPE framework

EEF Project: “Engaging Students in Delivering High Quality, Consistent, University Wide Student Assessment and Feedback”

f) Liaison with 30 staff and 300 studentsg) Identifying key departmental contacts to carry work forwardh) Common set of guidelines for staff and students

Myplace development & support:a) Scope use of Myplace to implement consistent and more effective use of tools for assessment and

feedback;

b) Scoping Gradebook development; Assessment Schedule tool (for cross class comparison).

Communications strategy:c) Service Level Agreement on different types of communication;d) Technologies in use to support communication (Myplace, Pegasus, mPegagus, Twitter, Text, local tech) and

identify consistent approaches for different types of communication.c) Communication through MyPlace and pop-ups on mobile devices

LEF Workshops and Events:e) External sector-wide viewpoint; f) Sharing good practice; g) Research; h) Learning from others; i) Staff development – eg Masterclasses

And being scoped . . .

Some thoughts for department/schools:for discussion

Communications• Involve students and their reps in solving issues • Assign a go-to student and staff member• Ensure communication-loop is closed• Provide immediate explanation when arrangements for courses/classes change

Assessment and feedback• Achieve common understanding between staff and students on what feedback

means and involves• Ensure all students receive some form of feedback relatively early in a class to

enable them to improve• Ensure students know when to expect feedback and that agreed deadlines are met• Agree university-wide turnaround time for feedback • Give particular attention to feedback on semester 1 exams

Student support• Hold 1-to-1 meetings with final year students at a best time to facilitate

improvement in their performance• Provide targeted support for underperforming students

Some thoughts for department/schools:for discussion

• Sharing and implementing good practice

• Learn from external peers – e.g. through research; role as External Examiners at other HEIs; Externals from elsewhere coming here

• Address staff behavioural issues of lack of engagement (collective and individual)

Discussion