AAC device prototypeTomer Meshorer

Current solutions

• Very expensive (7K – 14K). • Embedded hardware. • Bulky (ugly)• Old hardware• Small real estate screen. Fail to use multiple screens• Fail to use the latest UI technology (touch)• Do not use any NLP technology• Limited prediction / NLG capabilities.• Limited voice banking.• No use for ASR.• No reporting. • Market failure (Single vendor controlling 70% of the market, and stiffen

innovation).

Goal: A new platform

• Based on commodity tablet (cheap, latest hardware)• Windows 7 (most advanced UI)• Multi-touch interface.• Support for the latest TTS systems• Easy to use.• Easy to configure.• Multi lingual from day 1 (Japan / Germany)• Platform for research idea implementation.

– NLP– NLG– ASR

First phase : AAC project

• Virtual keyboard• Prediction (written from scratch)• OS build in TTS• Scanning

Demo

Use case supported

Domain model

Typing

Scanning

Next phase: Increase communication rate by 10X• Use NLG as key component• Conversation parts prediction• ASR from aids increase the context• AAC data warehouse

– Use RDBMS on the device– Record everything (at the word level) , time, location….– Basis for ranking.

• Take the aid / SLP into the picture– Device for aid (cheap)– Reports for SLP