xAPI Making Sense of Industry and Practice
-
Upload
aaron-silvers -
Category
Business
-
view
2.159 -
download
2
Transcript of xAPI Making Sense of Industry and Practice
xAPI: Making Sense of Industry & Practice
November 17, 2015 Megan Bowe & Aaron E. Silvers
How do I work with xAPI?
Competencies & Mindsets
Systems Thinking Integration Facilitation
A Maker Mindset Assume you have permission to tinker
Make, maintain and grow useful connections
Surface goals big & inviting enough to motivate action
Be The Change Interrogate perceived boundary conditions
Identify new paradigms supported by both sides of
double-binds
Inspire others, modeling how to navigate through shifting
paradigms
“Yes. And..” Augment rather than change discrete systems
Seek connections and overlaps that add value beyond the
immediate contextHelp others avoid negation
Who puts xAPI solutions together?
Technology Partners Vendors, consultants, tool providers, etc.
Your Team Stakeholders, team members, customers.
How xAPI solutions happen…
• Use a tool that is built with xAPI, natively, from the ground-up ( “Native” )
• Leverage an existing data source that is modified, extended or translated into xAPI ( “Modified” )
• Build Your Own ( “BYO” )
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your Team
Balancing wants, needs
and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your Team
Balancing wants, needs
and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for technology partners
If there’s support for xAPI from the ground-up…
• What activities are designed?
Common Needs
Social Custom mobile applications Play existing courses Create new courses
Track/report progressOff-the-shelf applications
integrationTesting Competency management
See the learner’s journey See content usage Work activities Sensors
Simulations Recruitment Compliance activity Reporting
Questions for technology partners
If there’s support for xAPI from the ground-up…
• What activities are designed?
• How are activities tracked?
“Recipes”• Communities of Practice • Controlled Vocabularies • Domain Profiles
Questions for technology partners
If there’s support for xAPI from the ground-up…
• What activities are designed?
• How are activities tracked?
• What data points are in each statement?
Someone Did SomethingActor Verb Object
Context Result
Questions for technology partners
If there’s support for xAPI from the ground-up…
• What activities are designed?
• How are activities tracked?
• What data points are in each statement?
• How do I input or change endpoint credentials?
Prompt Hack Fixed
You’ll have a prompt to input one or multiple LRS endpoint credentials.
As an example, while there’s a default configuration, there’s JavaScript or other code as an interface that can be amended with knowledge of how the technology works.
The technology is in a published or executable-only state (a .exe file, a .swf file — something server side) that makes it difficult if not impossible to change.
Questions for technology partners
If there’s support for xAPI from the ground-up…
• What activities are designed?
• How are activities tracked?
• What data points are in each statement?
• How do I input or change endpoint credentials?
• How does it rely on the LMS or other software applications?
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your Team
Balancing wants, needs
and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for your team
If considering a tool built with xAPI from the ground-up…
• Is what’s baked-in going to be enough?
• Does the right data align across tools?
• If not… can we support our own unbiased reporting, knowing the caveats?
Data Alignment Example
Storyline Lectora
Uses a fixed vocabulary to describe a limited set of interactions with
xAPI
Allows for freedom of expression to describe any interaction (or
operation) with an open vocabulary for xAPI.
Data Alignment Example
Storyline Lectora
“Mark experienced Slide 19.”“Mark read the contents of Slide 19
for 20 seconds.”
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to
xAPI
Whatever You Want
Your TeamBalancing wants,
needs and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for technology partnersIf there’s support for APIs or other data sources that can translate to xAPI…
• What APIs does the technology offer?
• Of these…Can we capture the right activities?
Twitter maps easily, but…
• Should we use hashtags forfor context?
• Is location important? • Do we need to track every
tweet?
Questions for technology partnersIf there’s support for APIs or other data sources that can translate to xAPI…
• What APIs does the technology offer?
• Of these…Can we capture the right activities?
• What data will fill in the gaps in information we need?
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your TeamBalancing wants,
needs and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for your teamIf considering a tool built for APIs or other data sources that can translate to xAPI…
• Can we get enough from this/these APIs?
• How much value will we get from this system?
• What resources will we have…
• to do custom API development?
• to keep up our code with the different specs, ongoing?
• to build the translation layer?
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your TeamBalancing wants,
needs and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for technology partners
If your technology partner will build whatever you want…
• What learning experience are you designing?
• What interactions are needed to support the learning experience design?
Native Modified BYO
Technology Partners
xAPI from ground-up
APIs or other data sources
that can translate to xAPI
Whatever You Want
Your TeamBalancing wants,
needs and sustainability
Creating & maintaining middleware
Practices, Resourcing &
Scaling
Questions for your teamIf you can build whatever you want…
• What learning experience are you designing?
• What interactions are needed to support the learning experience design?
• What interactions are needed but don’t evidence or disprove the learning experience?
• What recipes exist?
• What is the data model and information architecture it should conform with?
• What is our ability to support this at scale?
How do I vet technology partners for xAPI projects?
When considering technology partners…
• Consider the know-how and investment of those who contribute to the actual spec(example: https://github.com/adlnet/xAPI-Spec/graphs/contributors)
When considering technology partners…
• Consider the know-how and investment of those who contribute to the actual spec(example: https://github.com/adlnet/xAPI-Spec/graphs/contributors)
• Consider those who can demonstrate xAPI interoperability(example: http://tincanapi.com/2015/04/16/tale-three-lrss/)
When considering technology partners…
• Consider the know-how and investment of those who contribute to the actual spec(example: https://github.com/adlnet/xAPI-Spec/graphs/contributors)
• Consider those who can demonstrate xAPI interoperability(example: http://tincanapi.com/2015/04/16/tale-three-lrss/)
• Consider those who stay current with the spec(example: http://tincanapi.com/2015/04/16/tale-three-lrss/)
When considering technology partners…
• Consider the know-how and investment of those who contribute to the actual spec(example: https://github.com/adlnet/xAPI-Spec/graphs/contributors)
• Consider those who can demonstrate xAPI interoperability (example: http://tincanapi.com/2015/04/16/tale-three-lrss/)
• Consider those who stay current with the spec(example: https://github.com/aaronesilvers/IEEE/blob/master/2014_State_of_xAPI_Tools_Survey_Responses.csv)
• Consider those who won’t lock you into one size fits all(example: http://connectionsforum.com/case-studies/)
This seems like a lot… right?
Today's Adoption ChallengesFor many, xAPI is really hard. Today, instructional designers, business analysts, data scientists, engineers and front-end developers must do a lot of manual labor to work with xAPI.
There are conformance quality concerns. There are lots of products that claim to support xAPI, but how they use xAPI varies. Some vendors build their support for xAPI in ways that are different from what other vendors do, let alone different from the spirit and/or conformance with the spec. This impacts data interoperability.
xAPI must scale across verticals. xAPI has applications beyond just learning & development. To truly be useful to the whole enterprise, it needs to be easier for businesses, vendors and consultants alike to identify products that use xAPI the same way, and it needs to be easier for everyone to follow best practices.
How hard is xAPI for Activity Providers?
• Conflicting vocabulary
• Profiles/CoPs/Recipes inconsistency
• Manual processes
• Content use cases are favored
Who's really using xAPI as specified?
• Most differences among the major LRSs are easily resolved, but there are many products claiming to be “xAPI Compliant” which may not support xAPI the way you’d expect, clouding xAPI’s value proposition.
• Some Activity Providers (read: authoring tools) take liberties with valid-looking, but completely unusable, identifiers for verbs and activities — this is invisible to folks who use the tools but it makes poor quality data.
Who's on the fence about using xAPI?
• In the US
• Industrial/Manufacturing
• IT and Business Intelligence
• Energy and High Stakes Compliance
Who's on the fence about using xAPI?
• Outside the US
• Medical
• Financial
• Government
• Military
How do we address all that?
The Data Interoperability Standards Consortium (DISC)
Starting in 2016, DISC will address...
Vocabulary Profiles Partnerships Certification Stewardship
• Federated registry and associated APIs, freely available for individuals; fee-based for products
• Maintained and managed
• Schema to validate profiles
• Recognize and document community-of-practice activities, normalizing profiles by domain (vs global approaches)
• Relationships with stakeholder groups wanting to leverage xAPI in their own specs
• Supporting interests beyond just US DoD
• Identifies software and hardware that conforms to requirements of the xAPI specification
• Guarantees xAPI’s value proposition
• Supports xAPI’s relevancy to market needs
• Provides resources and vehicles to support xAPI adoption
RENEW YEARLYCERTIFICATION
Concept: CertificationAPPLICATIONIMPLEMENTINDUSTRY KNOWLEDGE
Vendor is interested in offering a product or service using xAPI.
Vendor makes contact with DISC with request for information.
Vendor develops xAPI functionality in their product or service.
Vendor applies for certification testing of their product or service.
Vendor successfully earns a digital badge certifying product authentically.
Vendor renews certification annually to keep current with any changes to xAPI.
Workstreams
INFORMATION CERTIFICATION SPECIFICATION COMMUNICATION
Federated Registry
Index of Certified Products
Maintaining Requirements
Third-Party Testing
ProgramMaintenance
Strategic Evolution
Communities of Practice
Working Groups
March 2017 January 2017 June 2016 January 2017 January 2016 April 2016 January 2016 January 2016
Supporting Vendors Informing Customers Delivering Market Relevance Engaging Contributors
Summary: Year One Deliverables
• Certification
• Requirements
• Licensing
• 3rd Party Testing Program
• Design and Development Tools
• Security Guidelines
So… what’s my roadmap to begin working with xAPI?
1) Describe the Dream
• What outcomes happen as a result?
• How are people learning or working?
• What problems are solved?
• How far out is this future?
• What might change beyond this?
Know Your Roles and Goals• Who are you responsible for helping within your organization?
• What do they need help with?
• What and/or how do you help them?
• What do you want to be better?
• What do you want to learn about what is currently happening?
• What do you want to do differently?
2) Define Gaps Between Today and the Ideal
• What capabilities exist vs. what capabilities are needed?
• What do people “do” vs. what they “need to do?”
• How do today’s business requirements match with business goals for the ideal?
Sort Out Your StatementsPretend you’re interviewing a SME for something you want to support…
1. What do they do first?
2. Second?
3. Etc…
• What do they do when they get stuck?
• How do they get unstuck?
• How does this activity play out when done well? (what does good look like?)
• How does this play out when mediocre or subpar?
3) Sketch It• What are the workflows?
• How do existing tools support the workflows?
• What new tools are needed?
• How does this model fit with stakeholder expectations?
• What are the critical paths and how are they prioritized?
• How can this model be simplified/scaled/phased?
• What dependencies are inherent? What dependencies are external?
Gather Your Resources
• What tools do you have access to?
• Who is available, and with what skills?
• Which systems do you have control of?
• Which require approval to make changes?
4) Put a Plan Together
• What is the technical approach?
• How will the system(s) and/or service(s) architecture work?
• What do the interfaces look like?
• How will success be defined?
• What is the project plan?
Prioritize
• Of the the projects you could do, what will positively impact business objectives most?
• Of the projects you could do, what will positively impact organizational culture and internal needs?
5) Reach Out
http://makingbetter.us/