Icde ossiannlisson bm_oct2011

24
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE Beyond benchmarking of e-learning in higher education

description

ICDE 24th World Conference, Bali, Indonesia 2-5 October 2011Presentation on Benchmarking e-learning in higher education

Transcript of Icde ossiannlisson bm_oct2011

Page 1: Icde ossiannlisson bm_oct2011

Beyond benchmarking of e-learning in higher education

Page 2: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Footprints

W:www.lu.se,

www.oulu.fi

E:[email protected]

E:[email protected]

FB:Ebba Ossiannilsson

T:@EbbaOssian

Phone: +4670995448

S:http://www.slideshare.net/EbbaOssiann

Ebba OssiannilssonLund University, SE and Department Industrial Engineering and ManagementOulu University, FI

Page 3: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Outline

• Benchmarking• The benchmarking projects• Working method• Excellence and quality criteria

Page 4: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Page 5: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

PERSONALISATION

Wheeler, 3 May 010, UNESCO

Page 6: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Learning in focus

Interpret

Search hReview

Network

Filter

Reflect

Create

Some rights reserved by vanhookc

Page 7: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benchmarking is a self-improvement tool allowing organisations to compare themselves with others regarding some aspects of performance, with a view to finding ways to improve current performance. Benchmarking deals with changes for quality enhancement but also with identification and implementation of areas of development. Benchmarking is a process that enables comparison of inputs, processes or outputs between institutions or within a single institution over time (UNESCO 2010)

Benchmarking is … a process operating within an organization [sic] with the objective of intentionally changing an existing state of affairs into a superior state of affairs. (Moriarty, 2008, p. 30).

…the ´locus´ of benchmarking lies between the current and desirable states of affairs and contributes to the transformation processes that realise these improvements. (Moriarty and Smallman, 2009, p. 484)

Some definitions

Page 8: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Self evaluation for quality enhancement

benchmark-careers.com

Page 9: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Determine what to benchmark

Form a benchmarking

team

Identify benchmarking

partners

Collect and analyse

benchmarking information

Take action

Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 2(3): 208-219.

The Benhmarking process

Page 10: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benchmarking projects

• Study A EADTU, E-xcellence+

(5 out of 13 HEI , appr 175)

• Study B ESMU, Benchmarking eLearning exercise 2009 (6 cases with narratives)

Page 11: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

EADTU E-xcellence+

• A manual on quality assurance in e-learning covering the 33 benchmarks, with related indicators to the benchmarks, guidance for improvement and references to excellence performance.

• Assessors notes to provide a more detailed account of the issues and the approaches.

• The online tools; the Quick Scan and the Full Assessment.

Page 12: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Services

Management

Products

Strategic managementProducts; Curriculum design, Course design, Course deliverySupport; Student and staff support

EADTU Benchmarks and indicators

Page 13: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

htt

p:/

/ww

w.e

adtu

.nl/

e-xc

elle

nce

lab

el

The Excellence project by the European Association of Distance Teaching Universities, EADTU

Services

Management

Products

Page 14: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

http://www.esmu.be/projects/94-benchmarking-elearning.html

Benchmarking e-learning in European universities

…exercise on e-learning launched in the spring of 2009…initiated by the University of Southern Denmark (SDU) and gathering a group of nine European universities. April 2009 - December 2009.…co-organised by ESMU and European Association of Distance Teaching Universities (EADTU; www.eadtu.nl), combined ESMU’s collaborative benchmarking approach (benchmarking through a comparative exercise of good practices between universities) and EADTU’s more individually-oriented approach. EADTU’s E-xcellence online tool, consisting of a set of 33 e-learning benchmarks, was used as a starting point to the benchmarking exercise

Page 15: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Method

• Multiple case study strategy (Yin 2003)• Mixed method approach (Creswell & Clarke 2007)

• Study A (5 out of 13 institutions, appr. 175)

Study B (six case studie)

Page 16: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Respondents E-excellence+ e-learning benchmarking exercise

Α Alpha xΒ Beta xΓ Gamma xΔ Delta xΕ Epsilon x Ζ Zeta x x

Respondents involved in the benchmarking projects, EADTU E-xcellence+ and the ESMU e-learning benchmarking exercise. Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 3(2):208 .

Page 17: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Benefitsself-assess institution

better understand the process

measure and compare

discover new ideas,

obtain data to support decision-making

set targets for improvement

strengthen institutional identity

enhance reputation

respond to national performance indicators and benchmarks

set new standards for the sector

van Vught et al., (2008). A practical guide. Benchmarking in European HE. ESMU

Page 18: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

ConclusionLong term

Short term

Individual Organisation

Page 19: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Internal processes and involvement

Quality enhancement

Management and commitment.

Collaboration and networking

Cultural issues.

Attitudes

Added values

The concept of rhizome

Critical Reflection

The concept of becoming

Passion

Dedication

CourageCommitment

Involvement

Ubiquitous learning

(Deleuze & Guattari 1987)

Page 20: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Rhizome perspectives• S

Page 21: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Teambuilding

Dialogue

Transparency

Policy statement

Quality improvement and quality assurance

Some key findings on the use of EADTU benchmarking

QuickScan tool. Ossiannilsson (2011).

Benchmarking for quality enhancement

Page 22: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Limitations

Who is involved?

Time?

Benchmarks?

Interpretations?

Language?

Commitment?

Page 23: Icde ossiannlisson bm_oct2011

Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE

Conclusions

• On values and impact of benchmarking eL

Impr

ovem

ents

Impr

ovem

ents