Quantiative Analysis of Learning Object Repositories

33
Quantiative Analysis of Learning Object Repositories Xavier Ochoa, ESPOL, Ecuador Erik Duval, KULeuven, Belgium 2008

description

Presentation at ED-Media 2008 Measure several characteristics of Learning Object Repositories: Size, Growth, Contribution Base and Reuse

Transcript of Quantiative Analysis of Learning Object Repositories

Page 1: Quantiative Analysis of Learning Object Repositories

Quantiative Analysis of Learning Object Repositories

Xavier Ochoa, ESPOL, Ecuador

Erik Duval, KULeuven, Belgium

2008

Page 2: Quantiative Analysis of Learning Object Repositories

Thanks for being here

Page 3: Quantiative Analysis of Learning Object Repositories

Slides at...

http://www.slideshare.net/xaoch

Page 4: Quantiative Analysis of Learning Object Repositories

Agenda

• What we currently (don’t) know

• Quantitative Studies and Implications– Size– Growth– Contribution– Reuse

• Conclusions

Page 5: Quantiative Analysis of Learning Object Repositories

Learning Object Economy

Market Makers

Producers Consumers

Policy Makers

Market

Page 6: Quantiative Analysis of Learning Object Repositories

Learning Object Economy

Market Makers

Producers Consumers

Policy Makers

LOR(Market)

Page 7: Quantiative Analysis of Learning Object Repositories

Learning Object Economy

Market Makers

Producers Consumers

Policy Makers

LOR(Market)

LOR(Market)

Page 8: Quantiative Analysis of Learning Object Repositories

How many objects are published?

How do they grow?

Which percentage is reused?

How much does a user publish?

Does the granularity affect reuse?

Page 9: Quantiative Analysis of Learning Object Repositories

Quantitative Analysis

• What we measured (example)– Repositories (ARIADNE)– Referatories (MERLOT)– OpenCourseWare (MIT OCW)– Learning Management Systems (Moodle)– Institutional Repositories (Georgia Tech)

Page 10: Quantiative Analysis of Learning Object Repositories

Repository Size

• Power Law – unequal distribution

Page 11: Quantiative Analysis of Learning Object Repositories

Repository Size

Repository Referatory OCW LMS IR

Page 12: Quantiative Analysis of Learning Object Repositories

Repository Size - Implications

• Interoperability is necessary

• LMS / OCW are as big as LOR(P/F)

• A course uses around 10 to 50 LOs

Page 13: Quantiative Analysis of Learning Object Repositories

Growth in Objects

• Growth is Linear (Bi-phase linear)

Page 14: Quantiative Analysis of Learning Object Repositories

Growth in Objects - Implications

• Our current strategy is not working!

• All repositories go through 2 phases:– Initial, slow growth (1-3 first years)– Mature, faster growth

• OCW and LMS grow 1 course per day!

Page 15: Quantiative Analysis of Learning Object Repositories

Growth in Contributors

• Some are Exponential !

Page 16: Quantiative Analysis of Learning Object Repositories

Growth in Contributors – Impl.

• We are not retaining our contributors

• LMS and OCW seem to attract more contributors

• There is a hope!

Page 17: Quantiative Analysis of Learning Object Repositories

Objects per Contributor

• Heavy-tailed distributions (no bell curve)

LORP - LORFLotka

“fat-tail”

Page 18: Quantiative Analysis of Learning Object Repositories

Objects per Contributor

• Heavy-tailed distributions (no bell curve)

OCW - LMSWeibull

“fat-belly”

Page 19: Quantiative Analysis of Learning Object Repositories

Objects per Contributor

• Heavy-tailed distributions (no bell curve)

IRExtreme Lotka

“light-head”

Page 20: Quantiative Analysis of Learning Object Repositories

Objects per Contributor – Impl.

There is no such thing as an “average user”

Page 21: Quantiative Analysis of Learning Object Repositories

Low

Middle

High

Page 22: Quantiative Analysis of Learning Object Repositories

Engagement is the key

Page 23: Quantiative Analysis of Learning Object Repositories

Enagement is the key

LMSs are the best type of Repository!!!

LMSs are the best type of Repository!!!

Page 24: Quantiative Analysis of Learning Object Repositories

Percentage of Reuse

• 3 LO collections of different granularity:– Components in Slides in ARIADNE– Modules in Connexions– Courses at ESPOL

• Compared with:– Images in Wikipedia articles– Software Libraries in Freshmeat– Web APIs in Mashups

Page 25: Quantiative Analysis of Learning Object Repositories

Percentage of Reuse

20% of Learning Objects in a collection

are reused at least once

Page 26: Quantiative Analysis of Learning Object Repositories

Percentage of Reuse

20% of Learning Objects in a collection

are reused at least once

NO MATTER THEIR GRANULARITY!

We have to re-think the Reuse Paradox

Page 27: Quantiative Analysis of Learning Object Repositories

Reuses per Object

• Log-Normal (also heavy-tailed)

Page 28: Quantiative Analysis of Learning Object Repositories

Reuses per Object – Impl.

Reuse seems to be the result of a chain of successful events

Page 29: Quantiative Analysis of Learning Object Repositories

Reuse vs. Popularity

Page 30: Quantiative Analysis of Learning Object Repositories

What’s Next

• Apply to other Learning Object “Markets”

• Continue analysis of reuse

• Other aspects: creation, updating, use...

Page 31: Quantiative Analysis of Learning Object Repositories

Conclusions

• We can gain a lot of knowledge with some simple measurements

• This knowledge benefits – Market Makers– Policy Makers

• We call this “Learnometrics”

• Only way to know if we are moving forward

Page 32: Quantiative Analysis of Learning Object Repositories

MESURE(and let us help / let us know)

Real, Real Conclusion