The Aphasia Project
description
Transcript of The Aphasia Project
![Page 1: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/1.jpg)
The Aphasia The Aphasia ProjectProjectDesigning Technology For and Designing Technology For and
With People who have AphasiaWith People who have Aphasia
Maria Klawe, Maria Klawe, Sonya Nikolova, Jordan Boyd-Sonya Nikolova, Jordan Boyd-GraberGraber
Princeton UniversityPrinceton University
Marilyn Tremaine, Rutgers UniversityMarilyn Tremaine, Rutgers University
Joanna McGrenere, Joanna McGrenere, Peter Graf, Barbara Purves,Peter Graf, Barbara Purves,Karyn Moffatt, Meghan Allen Karyn Moffatt, Meghan Allen University of British ColumbiaUniversity of British Columbia
![Page 2: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/2.jpg)
OutlineOutline
What is Aphasia?What is Aphasia? Problems with existing solutionsProblems with existing solutions The evolution of ESI plannerThe evolution of ESI planner Broader impactsBroader impacts
![Page 3: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/3.jpg)
Aphasia is a loss of words – not intelligence
Acquired language Acquired language disorderdisorder Caused by brain Caused by brain
damage (e.g. damage (e.g. stroke, trauma, etc.)stroke, trauma, etc.)
Impairment of Impairment of communication communication abilitiesabilities
Relative sparing of Relative sparing of other cognitive other cognitive abilitiesabilities
What is Aphasia?What is Aphasia?
![Page 4: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/4.jpg)
Impact of AphasiaImpact of Aphasia
More common than Parkinson’s More common than Parkinson’s diseasedisease
Withdrawal from societyWithdrawal from society
![Page 5: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/5.jpg)
Problems with existing Problems with existing solutionssolutions
Limited to communication; lack Limited to communication; lack of higher level applicationsof higher level applications
Communication too slow for Communication too slow for most aphasicsmost aphasics
Stigma of relying on laptops in Stigma of relying on laptops in publicpublic
Poor user-interface of Poor user-interface of handheldshandhelds Buttons too smallButtons too small Confusing navigationConfusing navigation Poor organization of multi-media Poor organization of multi-media
datadata
![Page 6: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/6.jpg)
The Aphasia ProjectThe Aphasia Project
Goal: understand how individuals with Goal: understand how individuals with aphasia communicate and seek aphasia communicate and seek opportunities where technology can better opportunities where technology can better support individuals in their daily lifesupport individuals in their daily life
Interdisciplinary project: computer Interdisciplinary project: computer science, psychology, speech language science, psychology, speech language pathologypathology
Multi-site: UBC, Princeton, aphasia Multi-site: UBC, Princeton, aphasia centers, centers,
![Page 7: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/7.jpg)
Types of SubprojectsTypes of Subprojects
I: Participatory design of application I: Participatory design of application prototypesprototypes
Daily plannerDaily planner HandheldHandheld Combined handheld and laptop systemCombined handheld and laptop system
Recipe book (laptop or tablet)Recipe book (laptop or tablet) File system (handheld)File system (handheld)
II: Evaluation of commercial PDAsII: Evaluation of commercial PDAs Long term use by SkipLong term use by Skip Short term use of camera functionShort term use of camera function
![Page 8: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/8.jpg)
Special challenges with Special challenges with research involving aphasicsresearch involving aphasics Access to participantsAccess to participants Communication with participantsCommunication with participants Right hemiparesisRight hemiparesis Lack of experience with computers, Lack of experience with computers,
PDAPDA Uncertain future of PDAsUncertain future of PDAs
![Page 9: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/9.jpg)
I: Participatory Design of I: Participatory Design of High-Level Application High-Level Application
PrototypesPrototypes
Anita Borg, Anita Borg, 1949 - 20031949 - 2003
• daily planner • interactive cookbook
Karyn Karyn MoffattMoffatt
![Page 10: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/10.jpg)
ESI Planner 1ESI Planner 1The Enhanced with Sound and Images Planner
PDA application (iPaq from HP)PDA application (iPaq from HP) A computerized daily planner A computerized daily planner
designed for people with designed for people with aphasia aphasia
Uses images, sound, and text Uses images, sound, and text to represent people and places to represent people and places in appointmentsin appointments
![Page 11: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/11.jpg)
I: I: Images, Sound, Text…Images, Sound, Text…
Say you have an appointment with Queen Say you have an appointment with Queen Elizabeth, at the Eiffel Tower on November Elizabeth, at the Eiffel Tower on November 6, 2003 from 8:00am to 10:00am6, 2003 from 8:00am to 10:00am
ESI Planner would display it like this:ESI Planner would display it like this:
![Page 12: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/12.jpg)
I: I: Participatory DesignParticipatory Design
Four phasesFour phases
![Page 13: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/13.jpg)
I: I: Participatory DesignParticipatory Design
Four phasesFour phases Idea Idea
brainstormingbrainstorming InterviewsInterviews Identified needs: Identified needs:
Daily plannerDaily planner Recipe bookRecipe book
![Page 14: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/14.jpg)
I: I: Participatory DesignParticipatory Design
Four phasesFour phases Idea brainstormingIdea brainstorming Paper low-fi Paper low-fi
prototypesprototypes
1 - Drawn by hand
2 - Using computer tools
6
7
8
9
101112
1
2
3
4
5
6
7
8
June: 9/6/03
7:00 am - 9:30 am
Marilyn Monroe Eiffel Tower
11 : 1510
20
1: 00
05
Starts
Ends
![Page 15: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/15.jpg)
I: I: Participatory DesignParticipatory Design
Four phasesFour phases Idea Idea
brainstormingbrainstorming Paper low-fi Paper low-fi
prototypesprototypes Medium-fi Medium-fi
prototypesprototypes
![Page 16: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/16.jpg)
I: I: Participatory DesignParticipatory Design
Four phasesFour phases Idea brainstormingIdea brainstorming Paper low-fi prototypesPaper low-fi prototypes Medium-fi prototypesMedium-fi prototypes High-fi prototypes and formal High-fi prototypes and formal
evaluation in labevaluation in lab
![Page 17: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/17.jpg)
I: High-fi PrototypesI: High-fi Prototypes
ESI Planner
NESI Planner
![Page 18: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/18.jpg)
I: Formal EvaluationI: Formal Evaluation
8 participants 8 participants Session 1:Session 1:
30 minutes with each Planner (ESI and 30 minutes with each Planner (ESI and NESI)NESI)
10 tasks (retrieval, creation, 10 tasks (retrieval, creation, modification)modification)
# of tasks completed# of tasks completed # of tasks completed # of tasks completed correctlycorrectly
Session 2: Western Aphasia BatterySession 2: Western Aphasia Battery
![Page 19: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/19.jpg)
I: ResultsI: Results
Preference: 5 ESI, 3 NESI.Preference: 5 ESI, 3 NESI.
Total Tasks Correct by Participant
0
2
4
6
8
10
12
SR CW CB WV JP GP NF MM
Participant
To
tal T
as
ks
Co
rre
ct ESI NESI Significantly Significantly
more tasks more tasks completed completed correctly with correctly with ESI Planner.ESI Planner.
![Page 20: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/20.jpg)
Limitations of ESI Limitations of ESI Planner 1Planner 1
Need for field studyNeed for field study Interface for input and modification Interface for input and modification
of appointmentsof appointments Lack of stable memory on iPAQ after Lack of stable memory on iPAQ after
power losspower loss Lack of library of icons and soundsLack of library of icons and sounds
![Page 21: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/21.jpg)
ESI Planner 2ESI Planner 2
Input on laptopInput on laptop Lingraphica library of icons and Lingraphica library of icons and
soundssounds Stable memoryStable memory Built-in camera in iPAQBuilt-in camera in iPAQ Participatory design with speech Participatory design with speech
language pathologists (SLPs)language pathologists (SLPs) Four week field study Four week field study
![Page 22: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/22.jpg)
LingraphicaLingraphica
Current Lingraphica systemCurrent Lingraphica system Laptop-based (easier interface)Laptop-based (easier interface)
Used at home for practiceUsed at home for practice
IssuesIssues Expensive, restricted to AAC insurance Expensive, restricted to AAC insurance
diagnosisdiagnosis
StigmaStigma
![Page 23: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/23.jpg)
A Lingraphica phraseA Lingraphica phrase
![Page 24: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/24.jpg)
Initial goal for prototypeInitial goal for prototype
Download appointments and phrases Download appointments and phrases from Lingraphica to ESI planner on from Lingraphica to ESI planner on handheldhandheld
Anticipated usesAnticipated uses Visits to doctors, etc.Visits to doctors, etc. ShoppingShopping Medication Medication
![Page 25: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/25.jpg)
ESI Planner 2 homeESI Planner 2 home
![Page 26: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/26.jpg)
appointmentsappointments
![Page 27: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/27.jpg)
phrasephrase
![Page 28: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/28.jpg)
The need for LgLiteThe need for LgLite
Lingraphica (Lg) too complexLingraphica (Lg) too complex Inability to add photos in Lg Inability to add photos in Lg No Windows version of LgNo Windows version of Lg
![Page 29: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/29.jpg)
LgLite interfaceLgLite interface
![Page 30: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/30.jpg)
LgLite interfaceLgLite interface
![Page 31: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/31.jpg)
The Pilot Field StudyThe Pilot Field Study
Seven aphasics at Adler Aphasia Seven aphasics at Adler Aphasia CenterCenter
Four weeks, one videotaped meeting Four weeks, one videotaped meeting with each participant per weekwith each participant per week
Log of interactions with iPAQ and Log of interactions with iPAQ and computercomputer
![Page 32: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/32.jpg)
OutcomesOutcomes
Little use of appointmentsLittle use of appointments Input only possible at Adler CenterInput only possible at Adler Center Desire for input on iPAQDesire for input on iPAQ
Extensive use of cameraExtensive use of camera Desire for better photo management on Desire for better photo management on
iPAQiPAQ Problems with sound playbackProblems with sound playback Range of text and speech abilitiesRange of text and speech abilities Enthusiasm for continued use of iPAQsEnthusiasm for continued use of iPAQs
![Page 33: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/33.jpg)
Next stepsNext steps
Add input on iPAQAdd input on iPAQ Improve photo management on iPAQImprove photo management on iPAQ Improve sound playback Improve sound playback Improve LgLite interfaceImprove LgLite interface Another field study at AdlerAnother field study at Adler
![Page 34: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/34.jpg)
Broader impactBroader impact
Dual usefulness between aphasics Dual usefulness between aphasics and elderly (poor vision, memory and elderly (poor vision, memory loss, Alzheimers, etc.)loss, Alzheimers, etc.)
Other visual language applicationsOther visual language applications
![Page 35: The Aphasia Project](https://reader035.fdocuments.in/reader035/viewer/2022062300/568148f3550346895db61002/html5/thumbnails/35.jpg)
For More Info…For More Info…
http://www.cs.ubc.ca/projects/http://www.cs.ubc.ca/projects/Aphasia/Aphasia/