Metadata quality criteria
WHY metadata for MY resources? Palavitsinis N., Ebner H., Manouselis N.
WHY metadata for MY resources? 2
WHY assess quality?
• Bad metadata “Invisible” resources
• Bad metadata Less “cool” things to do with metadata (explain)
• Bad metadata Mess…
10/6/2010
10/6/2010
Description: 566 words!!!
WHY metadata for MY resources? 4
Metadata Quality Review
• In Organic.Edunet, mainly based on Bruce & Hillman’s framework we’ve chosen some criteria to assess metadata quality
• Produced a grid to review metadata records– Using 5 point scales– Using Yes/No questions– Using free text field for comments
10/6/2010
WHY metadata for MY resources? 6
Selected Criteria (1/2)
• Completeness– Number of elements provided by the annotator,
compared to the total number of elements in AP• Appropriateness– Are the metadata values provided appropriate for
the targeted use?
10/6/2010
WHY metadata for MY resources? 7
Selected Criteria (2/2)
• Accuracy– Do the values correspond to what is annotated?– Do they reflect the actual resource?
• Consistency– Are the values provided consistent with the
standard or the AP used?
10/6/2010
8WHY metadata for MY resources?
Interactive session
metadata quality criteria & interface design
10/6/2010
WHY metadata for MY resources? 9
Setting up
• Divide <total number of participants> with 3
• Create X groups of three• Each group must have only one laptop open• Roles– One person to handle the laptop – One person to keep notes (will be collected)– One person to report back to the plenary
10/6/2010
WHY metadata for MY resources? 10
1st Step
• Which two metadata elements would NOT be useful for describing context specific resources?
• Report back by identifying:– The context – field of interest (as a group)– One element – WHY this is not useful
10/6/2010
Time in groups: 5’ Reporting back: 1’ per group
WHY metadata for MY resources? 11
Getting all laptops involved
• Please open your laptops
• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources
10/6/2010
WHY metadata for MY resources? 1210/6/2010
RG
Hi! I am Bruce & Hillman’s “Repository Genie” &
I am here to grant you 3 wishes!
I can make your Learning Object Repository score 100% in only
3 of the criteria presented!
The rest I will leave on the annotators hands…
Choose wisely!!!
WHY metadata for MY resources? 13
• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources
• Read the criteria and what they actually mean
• Use the questionnaire to “wish” for 3 of them– Reveal one wish in the end!
10/6/2010
2nd StepTime on your own: 5 minsReporting back: 5 seconds per person!
WHY metadata for MY resources? 14
3rd Step
• Imagine you have a big amount of resources. How would you like to manage them? – Traditional folder structure (Confolio)– Tag-based folders (Google Docs, Flickr)– Search-based folders (Thunderbird)
10/6/2010
Time in groups: 5’
Reporting back: plenary & individually (on paper)
WHY metadata for MY resources? 15
Questions to consider
• Is metadata quality linked to context?
• Do metadata quality criteria apply to all cases?
• Can the interface design ensure “high-quality” metadata?
10/6/2010
WHY metadata for MY resources? 16
Thank you
• For the patience• For your time• For really participating & contributing• One last thing to let us know how we did…– http://whymetadata.jimdo.com– Find Workshop/Questionnaire
10/6/2010
17WHY metadata for MY resources?
End of sessionPost Workshop Exercise
Develop a personalized metadata evaluation framework Evaluate at least 10 LOsProvide a 5 page description (per LO) of your findingsDeadline: Friday 6 pm (there is enough time if you don't go swimming)
10/6/2010
Top Related