Metadata quality criteria

Metadata quality criteria

WHY metadata for MY resources? Palavitsinis N., Ebner H., Manouselis N.

WHY metadata for MY resources? 2

WHY assess quality?

• Bad metadata “Invisible” resources

• Bad metadata Less “cool” things to do with metadata (explain)

• Bad metadata Mess…

10/6/2010

http://portal.organic-edunet.eu/

10/6/2010

Description: 566 words!!!


Metadata Quality Review

• In Organic.Edunet, mainly based on Bruce & Hillman’s framework we’ve chosen some criteria to assess metadata quality

• Produced a grid to review metadata records– Using 5 point scales– Using Yes/No questions– Using free text field for comments

10/6/2010


Selected Criteria (1/2)

• Completeness– Number of elements provided by the annotator,

compared to the total number of elements in AP• Appropriateness– Are the metadata values provided appropriate for

the targeted use?

10/6/2010


Selected Criteria (2/2)

• Accuracy– Do the values correspond to what is annotated?– Do they reflect the actual resource?

• Consistency– Are the values provided consistent with the

standard or the AP used?

10/6/2010

8WHY metadata for MY resources?

Interactive session

metadata quality criteria & interface design

10/6/2010


Setting up

• Divide <total number of participants> with 3

• Create X groups of three• Each group must have only one laptop open• Roles– One person to handle the laptop – One person to keep notes (will be collected)– One person to report back to the plenary

10/6/2010


1st Step

• Which two metadata elements would NOT be useful for describing context specific resources?

• Report back by identifying:– The context – field of interest (as a group)– One element – WHY this is not useful

10/6/2010

Time in groups: 5’ Reporting back: 1’ per group


Getting all laptops involved

• Please open your laptops

• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources

10/6/2010

http://whymetadata.jimdo.com/

WHY metadata for MY resources? 1210/6/2010

RG

Hi! I am Bruce & Hillman’s “Repository Genie” &

I am here to grant you 3 wishes!

I can make your Learning Object Repository score 100% in only

3 of the criteria presented!

The rest I will leave on the annotators hands…

Choose wisely!!!


• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources

• Read the criteria and what they actually mean

• Use the questionnaire to “wish” for 3 of them– Reveal one wish in the end!

10/6/2010

2nd StepTime on your own: 5 minsReporting back: 5 seconds per person!

http://whymetadata.jimdo.com/


3rd Step

• Imagine you have a big amount of resources. How would you like to manage them? – Traditional folder structure (Confolio)– Tag-based folders (Google Docs, Flickr)– Search-based folders (Thunderbird)

10/6/2010

Time in groups: 5’

Reporting back: plenary & individually (on paper)


Questions to consider

• Is metadata quality linked to context?

• Do metadata quality criteria apply to all cases?

• Can the interface design ensure “high-quality” metadata?

10/6/2010


Thank you

• For the patience• For your time• For really participating & contributing• One last thing to let us know how we did…– http://whymetadata.jimdo.com– Find Workshop/Questionnaire

10/6/2010

http://whymetadata.jimdo.com/jtel-2010/workshop/questionnaire/

17WHY metadata for MY resources?

End of sessionPost Workshop Exercise

Develop a personalized metadata evaluation framework Evaluate at least 10 LOsProvide a 5 page description (per LO) of your findingsDeadline: Friday 6 pm (there is enough time if you don't go swimming)

10/6/2010

Metadata quality criteria

Education

Transcript of Metadata quality criteria