TAUCHI – Tampere Unit for Computer-Human Interaction Tampere Unit for Human-Computer Interaction...
16
TAUCHI – Tampere Unit for Computer-Human Interaction Tampere Unit for Human-Computer Interaction University of Tampere Markku Turunen MUMIN workshop, Helsinki, 15-16.11.2002
-
date post
21-Dec-2015 -
Category
Documents
-
view
222 -
download
1
Transcript of TAUCHI – Tampere Unit for Computer-Human Interaction Tampere Unit for Human-Computer Interaction...
TAUCHI – Tampere Unit for Computer-Human Interaction
Tampere Unit for Human-Computer InteractionUniversity of Tampere
Markku Turunen
MUMIN workshop, Helsinki, 15-16.11.2002
TAUCHI – Tampere Unit for Computer-Human Interaction
Outline
Topics
• Research themes, context and methods
• Applications
• Future challenges and topics for discussion
TAUCHI – Tampere Unit for Computer-Human Interaction
Research themes
Interaction techniques for speech applications
• adaptive multilingual speech inputs and output
• error handling strategies
• interaction (dialogue) management strategies
• fusion and fission of multimodal information
• information representation in distributed applications
• context-awareness, privacy and trust
TAUCHI – Tampere Unit for Computer-Human Interaction
Research context
Pervasive and mobile settings
• multiple simultaneous multiparty dialogues
• human-to-computer, human-to-human
• implicit modalities: sensor information, position etc.
• speaker recognition and verification
• telephony applications, mobile settings
• special user groups (e.g. visually impaired users)
TAUCHI – Tampere Unit for Computer-Human Interaction
Research approach
Constructive HCI research
• architectures for adaptive applications
• prototype applications
• support for iterative development
• support for evaluation: Wizard of Oz, usability evaluation
• support for data (corpus) collection
TAUCHI – Tampere Unit for Computer-Human Interaction
Architecture research
speech application development framework
• a framework for adaptive speech applications
• designed especially for multilingual and distributed applications
• overall focus on system level adaptivity
• current focus on ubiquitous and multimodal applications
• Java and XML, freely available
• used in several projects and applications
TAUCHI – Tampere Unit for Computer-Human Interaction
Jaspis-based speech applications
• speech-based timetable services
• multilingual e-mail applications
• mobile speech applications
• ubiquitous computing applications
Application prototypes
traditional,unimodal
applications
innovative,multimodalapplications
TAUCHI – Tampere Unit for Computer-Human Interaction
Applications: Busman (Bussimies) / Interact
Speech-enabled timetable services
• speech interface for (bus) timetables
• “natural” spoken queries
• “mass-market” application
• two independent versions:
– Busman (Bussimies): Tampere version
– USIX-Interact: Helsinki version, collaboration with other universities (e.g. UIAH)
TAUCHI – Tampere Unit for Computer-Human Interaction
Applications: Mailman (Postimies) / AthosMail
Multilingual speech-based e-mail systems
• Basic e-mail features for telephone users (IMAP/POP3)
• Finnish and English & English / Swedish
• ASR + DTMF inputs
• Main focus on intelligible and pleasant speech outputs
• in collaboration with visually impaired users
• AthosMail: EU-funded IST project (DUMAS)
TAUCHI – Tampere Unit for Computer-Human Interaction
Applications: Mobile applications
Mobile speech applications
• integration of services
• support for group communication (awareness, shared knowledge)
• visually impaired users (short message services etc.)
• office environments
• mobile usage
TAUCHI – Tampere Unit for Computer-Human Interaction
Applications: Doorman (Ovimies)
Speech-based ubicomp systems
• identifies the target of the visitor’s visit or the identity of the staff member
• opens the door and guide the visitors in our premises
• conveys personal and organizational messages to staff members
TAUCHI – Tampere Unit for Computer-Human Interaction
Applications: Doorman (Ovimies)
Technology
• speech synthesis, speech recognition, speaker recognition, anthropomorphic guidance, physical switches, sensors
• EMFi-technology: wall and ceiling mounted loudspeakers and floor-sensors
• telephone and PDA interfaces for mobile users
TAUCHI – Tampere Unit for Computer-Human Interaction
Current vs. new application areas
Traditional speech applications Future speech applications
single user multiple users
desktop and telephonyoffice and home environments, mobile
settings
Single deterministic dialogueopen-ended, dynamically constructed
concurrent dialogues
active user active computer
centralized dialogue management distributed interaction management
TAUCHI – Tampere Unit for Computer-Human Interaction
Current vs. new application areas
Traditional speech applications Future speech applications
mostly unimodal mostly multimodal
alternative / exclusive (sequential) modalities
concurrent / synergistic (parallel) modalities
speech, text, graphics speech, sensors, …
monolingual multilingual
”natural” interaction methods based on human-human interaction
”innovative” interaction methods based on human-computer interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Discussion topics
Discussion topics
• English vs. Nordic languages
• Freely available and open-source components
• Demonstrations vs. working applications
TAUCHI – Tampere Unit for Computer-Human Interaction
http://www.cs.uta.fi/hci/spi/
TampereUnit forComputerHumanInteraction
Department of Computer and Information Sciences
