The Design of Human-PoweredAccess Technology

Jeffrey P. BighamUniversity of Rochester

Richard E. LadnerUniversity of Washington

Yevgen BorodinStony Brook University

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Human-Powered Access Technology –

technology that facilitates and, ideally, improves interactions between disabled people and human assistants

Introduction

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Human Power in History

• People Rely on Assistance from Others– to overcome small accessibility problems– prevent small challenges from becoming bigger

History

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Managing Expectations• Structures Around Assistance– sign language interpreters– volunteer training / accountability

History

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Remote Services

• What has changed is ConnectivityConnectivity

History

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Remote Assistance

Video Relay Services

Real-timeCaptioning

History

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Crowdsourcing / Human Computation

For an overview see:Quinn and Bederson.“Human computation: a survey and taxonomy of a growing field. CHI 2011.

[1]

History

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Bigham et al. Nearly Real-Time Answers to Visual Questions. UIST 2010.Examples

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Examples

Solona

ESP Game

IQ Engines / oMoby

VizWizSocial Accessibility Project

Examples

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Examples

VizWiz

MAP Lifeline

Remote Real-Time Captioning

Video Relay ServicesScribe4Me

Remote Real-Time Reading Service

ASL-STEM Forum

Bookshare

Respeaking

GoBraille

Tactile Graphics Project

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Examples

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Design Dimensions

Intitiative: who initiates help?

• End User• Worker• Organization

Dimensions

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Design Dimensions

Latency: how long does it take to get help?

• Interactive• Short Delay• Undetermined

Dimensions

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Design Dimensions

Confidentiality: user expectations• Trusted Worker Pools• User Feedback• No Guarantees

Dimensions

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Design Dimensions

Broader Context:• User• Worker• Community

Dimensions

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

vs.

Similarities

-- two systems that have sighted people describe web images for blind people --

Differences

Functionality

Target Disability: Blind

Experts vs. Crowd

Latency

Application

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

vs.

Similarities

-- different target disabilities but similar goal --

Differences

Latency

User Initiative

Target Disability

Accuracy

Source

Application

VizWiz Scribe4Me

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Areas for Future ResearchApplication

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Areas for Future Research

• Latency

Application

Latency

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Areas for Future Research

• Latency

• Broader Context

Application

Broader Context

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Areas for Future Research

• Latency

• Broader Context

• Other Disabilities

Application

Other Disabilities

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

Conclusion

• Human-Powered Access Technology

• Identified 15 Examples

• Isolated 13 Design Dimensions

• Useful for Evaluating, Comparing, Motivating

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

http://www.gccis.rit.edu/taccess

due12/21/2011

Introduction History Examples Dimensions Application

University of Rochester Human-Computer Interaction Jeffrey P. Bigham

crowdability.org

Thanks!

Jeffrey P. Bigham

@jeffbighamhci.cs.rochester.edu

TACCESS Special Issue: www.gccis.rit.edu/taccessCrowdability: www.crowdability.org