Read My LipsBy

Tamisra MondalMCKV Institute of Engineering [C.S.E.]

“ New technology spells out what is said when audio fails “

Developers

Dr. Helen L. Bear Prof. Richard Harvey

Major Applications

Criminal Investigation

To help Deaf and Dumb People to communicate

Entertainment World

In Aircraft Cockpit In Space

Other applications Can be applied in video calls

Can act as “Voice Assistant”

We can make a silent call

Telling a secret pin no. or Credit card no. will be easy

Existing Training Methods

HMM – Hidden Markov Model

RDA – Regularized Discriminant Analysis

SPLINE

ST Coding

ALR – Automated Lip Reading

Viseme Groups

Why “Read My Lips” More accurately distinguishes between

visually similar lip shapes

Uses a novel two-pass training method for the classifiers

Rosetta Raven Data, a new data set is used

This classifiers are not biased

Challenges Language barrier

Privacy related issues

Future Scope The technology can be made robust

Can be embedded in different gadgets

Can be used in smart phones used as satnav

Conclusion

The essence of this technology is in improving the training method for the classifiers to get better performance.