1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a...

Final Master Presentation

Department of Computing Science

Authoring of Adaptive e-content for a Commercial Environment

Adapting for Adaptivity

14/8/2006

Adapting for AdaptivityAuthoring of Adaptive e-content for a Commercial Environment

Angelo [email protected]





14/8/2006

Supervisors

Commission members

Dr. A.I. Cristea (TU/e)

Ing. E. Heuvelman (Turpin Vision)

Prof. Dr. P.M.E. De Bra (TU/e)

Dr. J. Broekstra (TU/e)





14/8/2006

Outline

1. Goal and Motivation2. Problem description3. Environment4. Theory and Systems5. Content-e/LAOS6. Demo7. Evaluation8. Conclusions





14/8/2006

Goal and Motivation

• Goal: a LAOS based Adaptive Hypermedia System (AHS) authoring tool that will see commercial use

• MOT is the only simple generic tool available, but not very user-friendly

• Turpin Vision wants to add adaptive capabilities to Content-e





14/8/2006

Problem description

• Adapt Content-e so it can be used to author LAOS layers

• Playable in AHA! (at the least)• Author existing MOT courses• Challenges: LAOS untested in

commercial environment; model conflicts with normal Turpin Vision approach





14/8/2006

Environment

• Turpin Vision is a SME (15 empl.)• Informal atmosphere• Clients: schools and publishers• Development primarily client-

demand driven• No clear picture of adaptivity; no

client-demand for adaptivity (yet)





14/8/2006

What is adaptivity?

• An adaptive system can adapt itself to a user automatically at runtime

• Transparent if done well• Applications: recommender

systems, online education, games• Different from adaptable!• Adaptive hypermedia system





14/8/2006

What is adaptivity?

USERMODEL

ADAPTATIONENGINE

DOMAINMODEL

INTERFACEDomain model: describes the domain (the ‘subject matter’)User model: describes the user (e.g. knowledge of the domain)Adaptation engine: changes user model and view on domain, depending on user model and user actions, according to adaptation rules





14/8/2006

‘Adaptive’ is not always really adaptiveCLIX

“How adaptive is CLIX?”“CLIX enables adaptation to a particular look and feel…”

(CLIX is actually adaptable)





14/8/2006

‘Adaptive’ is not always really adaptiveLearning Design

Claims adaptivity because a ‘live’ teacher can interact with users

(All humans are adaptive: this does not make the system adaptive)





14/8/2006

‘Adaptive’ is not always really adaptiveBlackboard

Adaptive release feature unlocks (releases) content based on certain criteria

(Actually pre-adaptation: learning paths are set beforehand and do not change)





14/8/2006

‘Adaptive’ is not always really adaptiveWebCT

“WebCT has incorporated adaptive technology into its products to comply with the US Rehabilitation Act”

(Not even close: talking about accessibility adjustments for the disabled)





14/8/2006

Adaptivity is not always recognized• Kobsa’s experiment: fake

recommender system• Side effect: users ‘fell for it’• Like a placebo, the illusion of

personalization seems to be sufficient

• Conversely, real adaptivity is not always noticed!





14/8/2006

Environment: a ‘good’ system

• Academic: study, novelty• Stability or visual appeal not essential• Demonstrations often purely

theoretical

• Commercial: profit• Stability and visual appeal essential• Technology must be proven in

practice• Confidence





14/8/2006

Environment: authoring complexity• Linear: content and structure• Hypermedia: hyperspace• Adaptive hypermedia: knowledge

space, adaptation process (e.g. labeling)

• Not everything must be done by one person, still complex





14/8/2006

Environment: ‘selling’ AHS

• Graphical user interface, visual themes and metaphors

• Simplify authoring task (automation, presets)

• Facilitate transition between linear and adaptive (conversion, standards)

• Convincing demonstrations• Evaluations and user studies.





14/8/2006

Existing Theory and Systems

• LAOS / LAG• MOT• CAF• AHA!• Content-e





14/8/2006

LAOS, MOT and AHA!

USERMODEL

ADAPTATIONENGINE

GOAL MODEL

INTERFACE

PRESENTA-TION MODEL

ADAPTATION MODEL

DOMAIN MODEL

•authoring framework

•Conceptual view of an AHS

•More parts

•Resulting AHS do not necessarily look like this

LAOS: Layered WWW Adaptive AHS Authoring Model and their corresponding Algebraic OperatorS





14/8/2006

LAOS, MOT and AHA!

GM

AM

UM

DM

PM

Domain Model: concepts and relations

Goal Model: filters, reorders, annotates

Adaptation Model: adaptation rules

User Model: overlay, free variables

Presentation Model: visibility, style, display settings





14/8/2006

LAOS, MOT and AHA!

GM

AM

UM

DM

PM

MOT CAF

(xml)

MOT: My Online Teacher

CAF: Common Adaptivity Format

• XML based

• Only DM and GM (so far)





14/8/2006





14/8/2006

LAOS, MOT and AHA!

GM

AM

UM

DM

PM

MOT

Any text editor

CAF

(xml)

LAG

(txt)

LAG strategies

condition-action rules

programming language

Layers of Adaptation Granularity





14/8/2006

LAOS, MOT and AHA!

Converter

GM

AM

UM

DM

PM

MOT

Any text editor

CAF

(xml)

LAG

(txt)

AHA! course

Adaptive Hypermedia Architecture





14/8/2006

Content-e

Import modules

Paragraph editor

XMLeditor

Database

PDF

Interactive Reader

Custom

...

Word

Publishing modules

HTML

Custom

...

Word





14/8/2006

Content-e/LAOS

• Turpin Vision desired an extension to their Content-e tool

• New sub-goals:• At least replicate MOT functionality• Improve user interface significantly• Extend MOT functionality based on

LAOS• Evaluate result





14/8/2006

Content-e/LAOS: Initial solution

Converter

GM

AM

UM

DM

PM

Content-e

CAF

(xml)

LAG

(txt)

AHA! course





14/8/2006

Content-e/LAOS: Actual Solution

Converter

GM

AM

UM

DM

PM

Content-e

Any text editor

CAF

(xml)

LAG

(txt)

AHA! course





14/8/2006

Content-e/LAOS in more detail

• .ASP / JavaScript• Collection of add-ons:

• 2 ‘XML paragraphs’ (concept, goal model)

• 1 import module (from CAF)• 1 publish module (to CAF)





14/8/2006

Content-e/LAOS: changes

Import modules

Paragraph editor

XMLeditor

Database

PDF

Interactive Reader

Custom

CAF

Word

Publishing modules

HTML

Custom

CAF

Word





14/8/2006

Content-e/LAOS: XML editor

XHTML form

XML (paragraph)

Form event handlers

DOM objectForm XSL

XML (template)

Preview XSL

Preview

Input Pane Preview Pane

Event handlers

change, save or preview

new edit save

previewchangeor init





14/8/2006





14/8/2006

Content-e/LAOS: Publication to CAF• Concepts and goal models are

represented with XML already• Compose into single XML structure

(use XML Writer)• Transform Content-e

representation to actual CAF elements





14/8/2006

Content-e/LAOS: Import from CAF• Transform CAF to Content-e XML• Insert content (obtain id’s)• Postprocess: insert id’s into

references• Update content• Problem: existing code did not

function inside transaction





14/8/2006

Demo





14/8/2006

Evaluation: setup

• MOT vs Content-e/LAOS comparison• ‘Politehnica’ university, Bucharest• 1 week theory• Exam: 63 -> 43 students in 7 groups• 1 week project• System Usability Scale (SUS) and

custom questionnaires





14/8/2006

Evaluation: results

• MOT: more stable• Content-e/LAOS: more appealing• “if it had less bugs I would use

Content-e/LAOS”

• MOT: functional (SUS)• C-e/LAOS: overall impression

(specific questionnaire)





14/8/2006

SUS comparison

0

1

2

3

4

5use frequently

complex

easy

need support

well integrated

inconsistency

learn quickly

cumbersome

confident to use

need to learn a lot to use

MOT

Ce/LAOS





14/8/2006

Which system would students choose?

0

5

10

15

20

25

MOT No preference C-e/LAOS

# S

tud

ents

DM authoring

GM authoring

overall





14/8/2006

Evaluation

• Opinion not influenced by acquired skill with systems

• Opinion probably influenced by problems during project (book labels, server reinstall)

• Longer exposure to Content-e/LAOS might lead to better evaluation





14/8/2006

Conclusions: goals

• MOT functionality almost completely replicated

• Extensions: typed DM attributes, relation authoring, CAF import

• UI improvements: single-screen concept authoring, click and drag GM authoring





14/8/2006

Conclusions: other results

• Improvements to Content-e• Tree component• Transactions• ASP data limit

• Course material (Gipf, Sun-Tzu)• Practical evaluation• Two papers (AH’06, ICALT’06)





14/8/2006

Recommendations

• Content-e needs to be more stable• More tests and evaluations• Extensions to the system

• Graph author• Default adaptation and user models• Real “student view”• Adaptation model XML paragraph?• “Player”





14/8/2006

Any questions?

http://www.stack.nl/~angelo/studie/thesis/

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a...

Documents

Transcript of 1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a...