Silent sound technology_powerpoint
-
Upload
amitt-arrsh -
Category
Engineering
-
view
1.010 -
download
23
Transcript of Silent sound technology_powerpoint
Silent SoundTechnology
…Talking Without Talking
What will happen when...
Let’s make
it
possible
Contents• INTRODUCTION• NEED FOR SILENT SOUND• ORIGINATION• SENSORS NEEDED• METHODS • EMG• IMAGE PROCESSING• SILENT FEATURES• APPLICATION• CONCLUSION
IntroductionSilent Sound is a technology which makes it possible to make calls/transmit information without using vocal cords just in 4 steps.
Monitoring muscular & lip movements Transforming them into a computer generated sound Transmit them over a phone Receiver receives the information in audio
Need for Silent Sound
To overcome with embarrassed situation such as-
To reply urgent call while meeting
For a better way of communication in noisy place
To be helpful for-
Vocally challenged People
Sharing secret information
Origination Origination of idea1968- Stanley Kubrick science-fiction film 2001 – A Space Odyssey
First demonstration2010 -At CeBIT(Centrum fiir Biiroautomation, Informationstechnologie und Telekommunikation)
Under developmentscientists of Karlsruhe Institute Of Technology (KIT), Germany
Sensors NeededThese are the sensors that are used in Silent Sound Technology :
Pressure sensor
Vibration sensors
Motion sensor
Electromagnetic sensor
Methods Silent Sound Technology is mainly processed through following methods. They are :
Electromyography (EMG) Image Processing
ELECTROMYOGRAPHY
…A method to convert lips movement into sound.
Electromyography• EMG is a technique for evaluating & recording electrical activity
produced by skeletal muscles
• The silent sound technology uses electromyography for monitoring muscular movements while speaking
• EMG detects electrical potential generated by muscle cells when they are electrically or neurologically activated
• Detected signals are converted into electrical pulses
• Electrical signals are converted into speech, without utterance of sound
History of EMGYEAR OBSERVER OBSERVATION
1666First documented experiments dealing with EMG started
1666Francesco Redi
Highly specialized muscle of the Electric Eel
generates electricity
1849Dubois-Raymond
It’s possible to record electrical activity during a
voluntary muscle contraction
1890Marey
Recorded the first actual muscular activity
Coined the term “Electromyography”
Principle of operationIn general speaking aloud
Air passes through larynx & the tongue Words are produced by articulator muscle
But when we are about to speak Articulate muscle becomes active irrespective of passage of
air Even by saying words without producing sound weak
electric currents are sent from brain to speech muscles.
EMG -Procedure– A Needle electrode is inserted through the skin into the
muscle tissue.
– Valuable information about the state of the muscle and its
innervating nerve is observed
– The electrical activity when the muscle is at rest is
observed.
– Because skeletal muscles differ in the inner structure,
the electrode has to be placed at various locations to
obtain an accurate signal
– Shape, size, and frequency of the resulting motor unit are
judged.
EMG - Techniques
ELECTRODE
AMPLIFIER
FunctioningSTEPS UNITS FUNCTIONS
I
Monitoring Unit Monitors tiny muscular movements
II
Electromyographic Sensors Records electric signals produced by the facial muscles
III
Transducers Converts the pulses into electric signals .
IV
Vocoder Converts electrical signal into speech pattern
V
Matching Unit
Compare them with pre recorded signal pattern of spoken words
Image Processing
Image Processing • Converting digital data tape into a film image with minimal correction
& calibrations• In silent sound technology its output is an audio record
Image Processing techniques
Analysis of remotely sensed data is done using various
image processing techniques and methods that includes:
Analog image processing
Digital image processing
Data collection& processingStimuli and Procedure
A list of frequently used sentences were prepared
Electromagnetic articulograph AG500 is used to register 3-D MOVEMENTS of the
tongue, lip and jaw when subject was talking
Articulograph records the movement by establishing calibrated electromagnetic
field
Data processing
Head movements were subtracted from tongue and lip locations
A zero phase low pass filter is applied for removing signal
noise
All sequences were segmented and annoted with sentences
EMA based silence speech interface
Electromagnetic Articulograph
Trained mode (SVM)
Online recognition
Sound database
Sound playback
Recognition
Dat
a se
gmen
t
Pro
bab
le Sen
tences
Data acquisition
Lip movement
Output
req
ues
t
Sou
nd
w
aveformSenten
ce
sequence
Speech Acoustics
Silent Features• Allow people to make silent calls without
bothering others.
• Helps to interpret foreign language
Applications• In Military for communicating secret/confidential matters
• A hope for people who have lost their voice due to illness
or accident
• Sharing secrets like pin, password to trusted one
ConclusionThus Silent Sound Technology, one of the recent trends in the field of Information technology implements ‘Talking Without Talking’. It will be one of the innovative and useful technology and in mere future this technology will be of use in day to day life.