Slide 1

BY :KAShISH BHATIA&Harpreet SINGH

1What is Blue Eyes Technology..?Origination Of Word.Techniques Used.Emotion Mouse.Magic Pointing.Artificial Intelligent Speech Recognition.SUITOR.Eye Tracker.Working & Design.Advantages & Disadvantages.Applications.IBM Researches.References Conclusion.CONTENTS

2BLUE EYES TECHNOLOGY ..?It aims at creating computational machines that have perceptual and sensory ability like those of human beings.It uses camera and microphone to identify user actions and emotions.Due to this the machine can understand what a user wants, where he is looking at and even realize his physical or emotional states.The basic idea behind this technology is to give the computer the human power. BLUE + EYES = BLUE EYES

-Blue = Bluetooth.. -Eyes = Movement of Eyes..

BLUE in the term stands for Bluetooth , which enables reliable wireless communication..

EYES because the Eye Movement enables us to obtain and send a lot of interesting and important information for analysation..

ORIGINATION OF WORD 4 Emotion Mouse.

Manual And Gaze Input Cascaded (MAGIC).

Artificial Intelligent Speech Recognition.

Simple User Interest Tracker (SUITOR).

The Eye Movement Sensor.

TECHNIQUES USED5The mouse is loaded with sensors which read your physiological .To be precise, heart rate is taken by IR sensor on the thumb, temperature is taken using a thermosistor chip and GSR(Galvanic Skin Resistance) is taken through fingertips. You can use these readings to establish baseline emotional states and thus you can identify if someone is getting uptight or becoming exhilarated (nervous or happy).

Emotion Mouse

6Dynamically redenes the home position of the pointing cursor.Reduce the cursor movement needed for target selection.Reduce physical effort and fatigue, greater accuracy and naturalness and faster speed than traditional eye gaze system.Two Techniques of MAGIC : 1. Liberal Approach:To warp the cursor to every new object user looks at. 2. Conservative Approach:Does not warp the cursor target until the manual input device has been actuated.

Manual And Gaze Input Cascaded (MAGIC)7User speaks to the computer through microphone.Filtered and fed to ADC (Analog to Digital Converter) and then stored in RAM.Input words are scanned and matched against internally stored words.Identification causes some action to be taken.Example : Siri in iphone. Can be used : 1. To control weapons by voice commands. 2. By Pilots to give commands to computers by speaking into microphones.

Artificial Intelligent Speech Recognition8Finds outs the areas of interests of the user.

Help by fetching more information at desktop.

Notices where the users eyes focus on the screen.

Fills a scrolling ticker on a computer screen with information related to users task.

For Example : If you are reading a headline ,it will pop up the story related to that headline in the browser window.

Simple User Interest Tracker (SUITOR)9When a single light source that is off or on the axis with the camera optical axis,the camera is able to detect the light reflected from the interior of the eyeWhen Off axis source generates a dark pupil image.When On axis generates a bright pupil image.Pupil detection is realized by subtracting dark pupil image from bright pupil image.After threshold difference largest connected component is identified as pupil.The Eye Movement Sensor (Tracker)

10The major parts of the blue eyes system are :DAU (Data Acquisition Unit).CSU (Central System Unit).

The task of the mobile DAU is to get the data from the user (e.g. through emotion mouse) i.e. raw data and send it to CSU over the wireless connection (bluetooth).CSU maintain the other side of the bluetooth connection, analyse incoming sensor data and decides what exactly user wants,records the conclusion & provide visualization interface and responds to the user.

WORKING & DESIGN

11Connection Managermain task to perform low-level blue tooth communication.Data Analysisperforms the analysis of the raw sensor data in order to obtain information about operators physiological condition.Data Logger Moduleprovides support for storing the monitored data.Visualization Module provides user interface for the supervisors .

ATMEL 8952 MicrocontrollerBluetooth Moduleto communicate with CSU.PCM CODEC used to transmit operators voice and central system sound feedback.UART communication between bluetooth module and microcontroller.Jazz Multisensor:supplies raw digital data regarding eye position.LCD display.LED indicators.

DAUCSU

12Only registered mobile devices can connect to the system.Bluetooth connection authentication.Bluetooth connection encryption.Access rights restrictions.Personal and physiological data encryption.DATA SECURITY13A more natural mental model for the user.Faster than pure manual pointing.Improved subjective speed & reliable.Practical accuracy level & secured.Prevention from dangerous incidents.The reconstruction of the course of operators work.Visual attention monitoring (eye motility analysis).Physiological condition monitoring (pulse rate, blood oxygenation).Operator's position detection (standing, lying).Blue Eyes system can be applied in every working environment requiring permanent operator's attention.

ADVANTAGES14Doesnt predict nor interfere with operators thoughts.Cannot force directly the operator to work.Liberal approach is distracting when user is trying to read.Little Expensive.

DISADVANTAGES15Control weapon by voice commands.Pilot can give commamds to computers.For making airline & hotel reservations.Can be connected to word processors & instead of writing, simply dictate.Another application would be in the automobile industry. By simply touching a computer input device such as a mouse, the computer system is designed to be able to determine a person's emotional state.In retailing record and interpret customer movementsIn automobile industry.In video games.To create Face Responsive Display and Perceptive Environment.

APPLICATIONS16POD : The first blue Eye enabled mass production device was POD, the car manufactured by TOYOTA. It could keep the driver alert and active. It could tell the driver to go slow if he is driving too fast and it could pull over the driver when he feels drowsy.

PONG : IBM released a robot designed for demonstrating the new technology. The Blue Eyes robot is equipped with a computer capable of analyzing a person's glances and other forms of expressions of feelings, before automatically determining the next type of action. PONG is capable of perceiving the person standing in front of it, smiles when the person calls his name, and expresses loneliness when it loses sight of the person.

DEVELOPMENTS TILL NOW17

PODPONGBlue Eyes technology being developed by the IBM research center at Alma den lab to make such "Smart" Computers.A new Chinese input system-EASE(Eye-tracking Assisted Selection and Entry) is invented by CCR&HCI team based on gaze tracking technique. In this technology, they build natural cooperation of hand and eye, and remove the tiresome procedure on candidate selection procedure of Chinese input in order to make the Chinese character typing more natural and more efficient. EMOTIONAL MOUSE : -Sensors in the mouse which sense the physiological attributes which are correlated to emotions by simply touching the mouse.BLUE EYE Enabled TELEVISION : -Could become active when the user makes an eye contact.

IBM RESEARCHESThe nineties witnessed quantum leaps interface designing for improved man machine interactions.The BLUE EYES technology ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Now the next step is to improve the hardware. Instead ofusing cumbersome modules to gather information about the user, it will be better to use smaller and less intrusive units. The day is not far when this technology will push its way into your house hold, making you more lazy. It may even reach your hand held mobile device.Any way this is only a technological forecast.

CONCLUSIONhttps://www.research.ibm.com/beijing/projects/project2.htmlhttp://techmesa.blogspot.in/2011/09/blue-eyes-technology.htmlhttp://www.seminarsonly.com/computer%20science/blue%20eyes.phphttp://www.seminarslides.com/ppt/blue-eyes-technology/mail/http://technicalpages.blogspot.in/2008/02/blue-eyes-technology.htmlhttp://www.yuvaengineers.com/blue-eyes-maram-b-m-rajesh-kumar/http://www.youtube.com/watch?v=sfhqrTrT-ashttp://www.slideshare.net/Colloquium/blue-eyes-technology-2333478www.whitepapers.comwww.ibmresearchcenter.com

REFERENCES

ANY QUERIES.. ?