EQNet Implementation Experience in Lithuania Dr. Eugenijus Kurilovas, Virginija Bireniene, ITC MoE...

eQNet Implementation Experience in

Lithuania

Dr. Eugenijus Kurilovas, Virginija Bireniene, ITC MoE Lithuania EdRene / eQNet, Lisbon, 07-05-2012

MCDA approach:

1. LOs should be evaluated against a number of the quality criteria. These criteria are often conflicting. Some LOs could be of excellent quality against the particular criteria, and poor – against the other ones, and vice versa.

2. Evaluation of the LOs quality is a typical case where Multiple Criteria Decision Analysis (MCDA) methods should be applied.

3. Evaluation is a process by which people make judgements about value and worth.

4. Quality evaluation is a systematic examination of the extent to which an entity (part, product, service or organisation) is capable of meeting specified requirements.

5. Expert evaluation is referred here as multiple criteria evaluation of learning software aimed at the selection of the best alternative based on score-ranking results.

Principles of creating a comprehensive coherent model

The following principles of identification of quality criteria are relevant to all MCDA approaches:

1. Value relevance2. Understandability3. Measurability4. Non-redundancy5. Judgmental independence6. Balancing completeness and

conciseness7. Operationality8. Simplicity versus complexity


LOs reusability:

• Various approaches to LOs attempt to meet two common objectives:

• to reduce the overall costs of LOs, and • to obtain better LOs.

• LOs reusability is one of the main features achieving the high LOs effectiveness and efficiency level. The need for reusability of LOs has at least three elements:

1. Interoperability: LO is interoperable and can be used in different platforms.

2. Flexibility in terms of pedagogic situations: LO can fit into a variety of pedagogic situations.

3. Modifiability to suit a particular teacher’s or student’s needs: LO can be made more appropriate to a pedagogic situation by modifying it to suit a particular teacher’s or student’s needs.

• Reusability of LOs (or their ability to “travel well” between different contexts and education systems) is considered as a part of the overall quality of LOs. This means that any high quality LO has some reusability level (or potential to “travel well”), but this does not mean that any reusable LO is quality one.


TNF method for evaluating the quality of LOs

11

m

iia 0ia

.

m

iii XfaXf

1

)()(

Experts’ additive utility function


.

Triangular Fuzzy Numbers


.

Triangular Fuzzy Numbers

Excellent / extremely valuable, essential0.850

Good / very valuable0.675

Fair / valuable0.500

Poor / marginally valuable0.325

Bad / not valuable0.150

Ratings Weights

If an expert evaluator establishes a weight of the criteria i in a form of a linguistic variable, we can convert it into the triangular fuzzy number.

If we have t experts we can calculate it using the experts’ average:


.

Weights of the quality criteria

t

k

ik

ij mt

m1

1

m

s

sf

ij

i

m

ma

1

• Mixed Numbers http://celebrate.ls.no/english/animations/mathematics/tilblanda/index.html

• Practice with Tangents and Circles http://regentsprep.org/Regents/math/geometry/GP14/PracCircleTangents.htm

• How to Construct a Tangent to a Circle http://www.mathopenref.com/consttangent.html

Evaluation example

.

LOs from LRE:

http://www.mathopenref.com/consttangent.html

http://www.mathopenref.com/consttangent.html

Evaluation example

.

Ratings (values) of the LOs quality criteria

850,0

850,0

850,0

675,0

850,0

850,0

500,0675,0500,0

675,0500,0675,0

850,0675,0850,0

675,0850,0675,0

675,0325,0675,0

675,0675,0500,0

500,0675,0850,0

850,0850,0675,0

)(Xf i

Evaluation example

.

Weights of the LOs quality criteria

114,0450,7

850,0

1

9,7,5,1

9,7,5,1

m

s

sf

f

m

ma

091,0450,7

675,0

1

10,8,6,4,3,2

10,8,6,4,3,2

m

s

sf

f

m

ma

091,0114,0091,0114,0091,0114,0091,0091,0091,0114,0ra

Evaluation example

.

Evaluation results

7163,06804,07122,0)( jr Xfa

LO quality and reusability evaluation method proposed is applicable for the aims of eQNet project in order to make a list of qualitative LOs and to select LOs suitable to apply in different education systems in different European countries.

Current works

.

1. Creation of reusable LOs metadata in Lithuanian to enrich Lithuanian LOs metadata repository http://lom.emokykla.lt

2. Public tender to establish comprehensive and coherent quality criteria set to evaluate textbooks and LOs organised by Education Development Centre.

Thank you for your attention !!!

Dr. Eugenijus Kurilovas, Virginija Bireniene, ITC MoE Lithuania

[email protected]

[email protected]

EQNet Implementation Experience in Lithuania Dr. Eugenijus Kurilovas, Virginija Bireniene, ITC MoE...

Documents

Transcript of EQNet Implementation Experience in Lithuania Dr. Eugenijus Kurilovas, Virginija Bireniene, ITC MoE...