www.efquel.org

Learning from PeersAn introduction to peer-review

Anthony F. Camilleri 5th ICT Innovations Conference 201314th September 2013 – Ohrid, Macedonia

www.efquel.org

What‘s in a Name?

Audit Expert-Review

Objective Subjective

Precise standards Broad guidelines

Verifies account of client Interprets account of client

Requires detailed knowledge of administrative procedures

Requires detailed knowledge of the subject area concerned

standards-basedreview

www.efquel.org

Who is a peer?

• an expert in the field• an expert in what field?• e-learning!• what is e-learning?

www.efquel.org

Features of an Expert-Peer

experience in course design and delivery

familiar with best-practice

comparative perspective

sense of missionnatural communicator

www.efquel.org

A reviewer is a communicator

University

AgencyReview Team

www.efquel.org

Inter-subjectivity

• different subjective perceptions, taken from different viewpoints, give an objective view of reality

• the quality basis of an external review• requires consensus

consensus is not a diplomatic nicetybut an essential pre-requisite of quality

www.efquel.org

Learning from

self-assessment

www.efquel.org

There is no such thingas objective quality

www.efquel.org

How to learn from self-assessment1. Read the quality standard2. Understand the quality standard3. Ask Questions4. DO NOT fill it in5. Discuss it – with all stakeholders in the institution

a. How do we meet the standard?b. What can we do better?c. Does it apply in all areas?

6. Discuss it some more – do some implementation7. Have you internalised standard?8. Now fill in the questionnaire

www.efquel.org

A look at the Quality Cycle

• Do• Check

• Plan• Act

アクション

計画

実行チェック

CHECK should be read as STUDYin English Check implies ‚to hold back‘(Deming, 1980)

www.efquel.org

A Need to Prioritise

• Do• Check

• Plan• Act

アクション

計画

実行チェック

www.efquel.org

Be Honest

„Most Quality Managers are Magicians“

Look Here

don‘t look here!

www.efquel.org

What will self-assessment produce• A time to think, communicate and strategize• A better understanding of institutional

processes• An overview of where we are and hopefully

where we need to go

• A report

www.efquel.org

Learning from

peer-review

www.efquel.org

TheShow-Off

ThePolitician

TheGrumpy

TheBored

Don’t be one of these people….

www.efquel.org

How to approach a peer-review

• Understand the purpose of the review

• Understand your role in the review– Your impressions– Of your part in the instituion

• Be candid and informative• Don’t try to hide things (you’ll be

caught)

www.efquel.org

Main result of peer-review

an external evaluation of your institutional quality

(procedures)

a report

a certificate

www.efquel.org

Run the cycle again

• Do• Check

• Plan• Act

アクション

計画

実行チェック

www.efquel.org

Remember

NO process is without errors

There is ALWAYS room for improvement

www.efquel.org

What to do with the report

1. Read the report2. Understand the report3. Ask Questions4. Discuss it – with all stakeholders in the institution

a. What did we miss in our Self-Assessment?b. Have our assumptions been confirmed or refuted?c. How can we do it better

5. Discuss it some more – do some implementation6. Have you internalised the recommendations?7. Now start the cycle again.

www.efquel.org

EFQUEL’s e-Quality Services

E-Quality Review ServicesExpert Reviews

ECBCheck E-Quality Label Certification for Short Courses and Training Programmes

E-Quality Label for Programmes Certification for Academic Programmes

UNIQUe E-Quality Label Certification for Institutions and Institutes

www.efquel.org

THANK-YOUfor your attention

Feedback is welcome!

Released under a Creative Commons Attribution ShareAlike 3.0 Belgium License

You are free:• to Share — to copy, distribute and

transmit the work• to Remix — to adapt the work

Under the following conditions:Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

13th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLOwww.efquel.org

„Learning from Peers: An introduction to peer review“

Anthony F. Camillerianthony@camilleri.comhttp://www.slideshare.net/anthonycamilleri/