Beyond benchmarking of e-learning in higher education

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Footprints

W:www.lu.se,

www.oulu.fi

E:Ebba.Ossiannilsson@ced.lu.se

E:Ebba.Ossiannilsson@oulu.fi

FB:Ebba Ossiannilsson

T:@EbbaOssian

Phone: +4670995448

S:http://www.slideshare.net/EbbaOssiann

Ebba OssiannilssonLund University, SE and Department Industrial Engineering and ManagementOulu University, FI

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Outline

• Benchmarking• The benchmarking projects• Working method• Excellence and quality criteria

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

PERSONALISATION

Wheeler, 3 May 010, UNESCO

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Learning in focus

Interpret

Search hReview

Network

Filter

Reflect

Create

Some rights reserved by vanhookc

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benchmarking is a self-improvement tool allowing organisations to compare themselves with others regarding some aspects of performance, with a view to finding ways to improve current performance. Benchmarking deals with changes for quality enhancement but also with identification and implementation of areas of development. Benchmarking is a process that enables comparison of inputs, processes or outputs between institutions or within a single institution over time (UNESCO 2010)

Benchmarking is … a process operating within an organization [sic] with the objective of intentionally changing an existing state of affairs into a superior state of affairs. (Moriarty, 2008, p. 30).

…the ´locus´ of benchmarking lies between the current and desirable states of affairs and contributes to the transformation processes that realise these improvements. (Moriarty and Smallman, 2009, p. 484)

Some definitions

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Self evaluation for quality enhancement

benchmark-careers.com

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Determine what to benchmark

Form a benchmarking

team

Identify benchmarking

partners

Collect and analyse

benchmarking information

Take action

Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 2(3): 208-219.

The Benhmarking process

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benchmarking projects

• Study A EADTU, E-xcellence+

(5 out of 13 HEI , appr 175)

• Study B ESMU, Benchmarking eLearning exercise 2009 (6 cases with narratives)

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

EADTU E-xcellence+

• A manual on quality assurance in e-learning covering the 33 benchmarks, with related indicators to the benchmarks, guidance for improvement and references to excellence performance.

• Assessors notes to provide a more detailed account of the issues and the approaches.

• The online tools; the Quick Scan and the Full Assessment.

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Services

Management

Products

Strategic managementProducts; Curriculum design, Course design, Course deliverySupport; Student and staff support

EADTU Benchmarks and indicators

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

htt

p:/

/ww

w.e

adtu

.nl/

e-xc

elle

nce

lab

el

The Excellence project by the European Association of Distance Teaching Universities, EADTU

Services

Management

Products

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

http://www.esmu.be/projects/94-benchmarking-elearning.html

Benchmarking e-learning in European universities

…exercise on e-learning launched in the spring of 2009…initiated by the University of Southern Denmark (SDU) and gathering a group of nine European universities. April 2009 - December 2009.…co-organised by ESMU and European Association of Distance Teaching Universities (EADTU; www.eadtu.nl), combined ESMU’s collaborative benchmarking approach (benchmarking through a comparative exercise of good practices between universities) and EADTU’s more individually-oriented approach. EADTU’s E-xcellence online tool, consisting of a set of 33 e-learning benchmarks, was used as a starting point to the benchmarking exercise

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Method

• Multiple case study strategy (Yin 2003)• Mixed method approach (Creswell & Clarke 2007)

• Study A (5 out of 13 institutions, appr. 175)

Study B (six case studie)

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Respondents E-excellence+ e-learning benchmarking exercise

Α Alpha xΒ Beta xΓ Gamma xΔ Delta xΕ Epsilon x Ζ Zeta x x

Respondents involved in the benchmarking projects, EADTU E-xcellence+ and the ESMU e-learning benchmarking exercise. Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 3(2):208 .

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benefitsself-assess institution

better understand the process

measure and compare

discover new ideas,

obtain data to support decision-making

set targets for improvement

strengthen institutional identity

enhance reputation

respond to national performance indicators and benchmarks

set new standards for the sector

van Vught et al., (2008). A practical guide. Benchmarking in European HE. ESMU

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

ConclusionLong term

Short term

Individual Organisation

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Internal processes and involvement

Quality enhancement

Management and commitment.

Collaboration and networking

Cultural issues.

Attitudes

Added values

The concept of rhizome

Critical Reflection

The concept of becoming

Passion

Dedication

CourageCommitment

Involvement

Ubiquitous learning

(Deleuze & Guattari 1987)

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Rhizome perspectives• S

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Teambuilding

Dialogue

Transparency

Policy statement

Quality improvement and quality assurance

Some key findings on the use of EADTU benchmarking

QuickScan tool. Ossiannilsson (2011).

Benchmarking for quality enhancement

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Limitations

Who is involved?

Time?

Benchmarks?

Interpretations?

Language?

Commitment?

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Conclusions

• On values and impact of benchmarking eL

Impr

ovem

ents

Impr

ovem

ents

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Bild: Wikimedia Commons, Push the button, CC BY SA

The door isopen …

What next?

Terima kasih!