OCWC Global 2014 - A Framework for Publicly Sharing Dynamic Metrics on OER Platform
-
Upload
openmichigan -
Category
Data & Analytics
-
view
577 -
download
0
description
Transcript of OCWC Global 2014 - A Framework for Publicly Sharing Dynamic Metrics on OER Platform
A Framework to Integrate Public, Dynamic Metrics into an OER Platform
Jaclyn Zetta Cohen, Kathleen Ludewig Omollo, Dave Malicke{jczetta, kludewig, dmalicke}@umich.edu
Open.Michigan Initiative, University of MichiganDownload slides: [shortlink]
OCWC Global, April 2014
All content in this presentation unless otherwise noted is © 2014 Regents of the University of Michigan and licensed under a CC-BY license. http://creativecommons.org/licenses/by/4.0
key points● we (the Open.Michigan Initiative team) did user
research and took several different types of data into account when thinking about how to share our usage data, and this is making the work we do better
● we discovered that sharing metrics dynamically at a specific, individual level is valuable to many
notable background● we publish OER on our website● we have a Google Analytics account that’s
accessible only to those who are granted account access
● we work with community members to publish OER
the dynamic metrics and analytics project
...was initiated with a goal of
publicly sharing Open.Michigan usage data,
identifying interesting patterns in OER use,
updating displays of that data dynamically.
metrics and analyticsmetrics are raw data
analytics are meaningful patterns
metrics come first
corollary questions, Iwhat context is important? (a lot)
what questions do we want to answer? (many)
can metrics help answer those questions? (yes, we think so)
corollary questions, II● how to share usage data? how do we
organize it?
● what does “use” mean for us?
● how can we share metrics in a sustainable and useful way?
how do we organize OER?Hierarchical system, Drupal-based(https://open.umich.edu/wiki/OERbit)
how do we organize OER?A hierarchy of units, courses, resources...
Image source: Open.Michigan Initiative medical collection, open.umich.edu/education/med, CC-BY http://creativecommons.org/licenses/cc-by/4.0
cont.
Image source: Open.Michigan M2 Cardiovascular, http://open.umich.edu/education/med/m2/cardio, http://creativecommons.org/licenses/by-nc-sa/3.0/
repository/referratorywe host and help publish OER (open.umich.edu)
we provide links to third-party platforms and services which host relevant OER (youtube.com, slideshare.com, amara.org)
how do we measure content use?Google Analytics, third-party-platform analytics interfaces, access to APIs...
Image source: Google Analytics, charts
technical architecture
… informs information architecture.
(e.g. Our hierarchical site structure allowed us to easily answer some individual questions with the first phrase release of this project.)
project: first phase
Image source: Open.Michigan M2 Cardiovascular, http://open.umich.edu/education/med/m2/cardio, http://creativecommons.org/licenses/by-nc-sa/3.0/
user research → ● changes in action/use over time ● visual clarity● ease of access● availability of totals (lifetime numbers)● evidence of reach● evidence of use
user research →
there is
qualitatively measurable value in providing individual metrics
in clear ways
project: second phaseCurrently in development,a dashboard to share raw metrics for individual courses.
Image source: Open.Michigan dashboard, in progress.© Regents of the University of Michigan, CC-BY 4.0.
we know we want to compare views and downloads over time
conclusions● tech architecture informs information architecture
● metrics can be used to justify costs of OER production, and serve to strengthen relationships
● user research may lead to ‘better’ analytics
● more to come!
future endeavors● more data sharing: SlideShare, Amara.org
● continual development of visuals, user research
● movement toward increased analytics
comments? questions?email: [email protected]: @jczetta, @open_michigan
learn more: http://openmi.ch/dynmetricsread the paper (to be published): http://openpraxis.org
thanks!to all who provided assistance with and support for this project, especially:
Kevin Coffman, Pieter Kleymeer, Susan Topol, Trisha Paul, Bob Riddle, Stephanie Dascola, Margaret Ann Murphy, Emily Puckett Rodgers, Pierre Clement, Michael Hess, Karen Kost; all interviewees and Open.Michigan Initiative collaborators