(The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of...

57
(The Human Ear) Peripheral Auditory System Place Theory of Hearing Amplitude Response of the Ear Logarithms and Sound Intensity Scales Periodicity Pitch and Fundamental Tracking Aural Harmonics and Combination Tones Ohm’s Law of Hearing Masking Binaural Effects Hearing Loss

Transcript of (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of...

Page 1: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

(The Human Ear)1. Peripheral Auditory System2. Place Theory of Hearing3. Amplitude Response of the Ear4. Logarithms and Sound Intensity Scales5. Periodicity Pitch and Fundamental Tracking6. Aural Harmonics and Combination Tones7. Ohm’s Law of Hearing8. Masking9. Binaural Effects10. Hearing Loss

Page 2: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

(The Human Voice)

11. Anatomy of the Vocal Tract12. Vocal Formants13. Analysis of Vocal Sounds

Page 3: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

“Dynamic Range” of ear

Frequency range: 20 Hz – 20 kHz

(factor of 1000)

Range of eye ~ 0.400- 0.700 microns

(factor of 2)

Intensity range: 1 to 1012

Range of eye ~ 1-1,000,000 (106)

Page 4: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Peripheral Auditory System

Page 5: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Cross section of the Cochlea

Page 6: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Guinea Pig “Hair Cells”

Similar in humans, chinchillas, cats and guinea pigs

Page 7: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

The “Place Theory” of Hearing

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 8: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Features of the “Place Theory”1. Correlation of frequency with position of

maximum response (higher frequencies closer to oval window at base of cochlea)

2. 20-5000 Hz frequency range >2/3 of membrane length

3. Remaining frequencies (5,000-20,000 Hz

squeezed into remaining <1/3

4. Equal frequency ratios occupy the same distance along membrane

Page 9: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Experimental basisfor the Place theory

1. The Critical Band

2. The Frequency JND

3. The Limit of Frequency Discrimination

and its analog experiment

4. Sharpening

Page 10: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

The Critical Band

~15% in frequency, greater at lower frequencies

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 11: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

The Just Noticeable Difference

~0.6% in frequency, greater at lower frequencies

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 12: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Limit of frequency discrimination

(two tones)

~7% for low frequencies, ~15% for higher frequencies

Page 13: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Analog experimentusing the arm

as basilar membrane

Page 14: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Effect of“Sharpening”

The JND is less for complex waves

Page 15: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Experiment Summary

From: Juan G. Roederer, The Physics and Psychophysics of Music

Page 16: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Escher: Waterfall

Page 17: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Escher: Staircase

Page 18: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Shepard’s Tones

Roger N. Shepard: Circularity in Judgements of Relative Pitch; Journal of the Acoustical Society of America, 1964

Page 19: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

A Pair ofParadoxes

Page 20: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Shepard’s tones in musicVoice of the ComputerJean-Claude Risset:

Computer Suite from “Little Boy”

I. Flight and Count-down

II. Fall (uses downward glissando Shepard’s tones to represent the fall of the atomic bomb on Hiroshima

III. Contra-Apotheosis

Page 21: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Fletcher-Munson (Equal Loudness) Curves

Page 22: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Sound Intensity Level Scale(SIL)

Units of bels or decibels

1. “Physics” scale2. Equal intensity ratios mean

equal steps of loudness3. Intensity JND

Page 23: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Loudness Level scale“Phons”

1. “Subjective” scale2. Accounts for variation

of loudness with frequency3. More useful in describing

hearing

Page 24: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

The decibel scale

SIL = SIL0 + 10 log (I/Io)

log 1 = 0.0log 2 = 0.3log 3 = 0.5log 4 = 0.6log 5 = 0.7

log 6 = 0.8log 7 = 0.85log 8 = 0.9log 9 = 0.95log 10 = 1.0

Page 25: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Examples using decibels1. Adding two equal signals2. Multiplying a signal by 33. Multiplying a signal by 104. Multiplying a signal by 1.255. Demonstration H5-21 Three Decibels6. Question of the Week #1497. Question of the Week #1508. Consultation as expert acoustic witness

Page 26: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Periodicity Pitchand

Fundamental TrackingPsychological phenomenon

Page 27: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Aural Harmonicsand

Combination Tones

Sum Tone: f+ = nf1 + mf2

Difference Tone: f- = | nf1 - mf2 |

Created by non-linearities primarilyin the bone chain of the middle ear

Physical phenomenon

Page 28: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Aural Harmonics

Page 29: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Combination Tone Experimentn m sum: f+ difference: f-

1 1 1200 Hz 200 Hz

1 2 1900 Hz 900 Hz2 1 1700 Hz 300 Hz2 2 2400 Hz 400 Hz

f1 = 500 Hz f2 = 700 Hz

Page 30: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Ohm’s Law of Hearing(excellent approximation)

Second order (quality) beats(counterexample to Ohm’s Law)

Masking(complication of Critical Band)

Page 31: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Quality Beats (Second-order beats)

Fundamental with mis-tuned 2nd harmonic

Page 32: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Source of Masking

From: Thomas Rossing, The Science of Sound

Page 33: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Masking Curves

From: Donald Hall: Musical Acoustics, Second Edition

a. Threshold of hearing for pure toneb. Masking by 365 Hz to 455 Hz 80 dB noise bandc. Masking by 400 Hz 80 dB tone

Page 34: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Steady-state tone quality

1. Number and amplitude of overtones2. Inharmonicities3. Periodicity pitch and

fundamental tracking 4. Difference tones (enhance fundamental)5. Critical Band and Masking (formants)

Page 35: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Musical Effects of theCritical Band and Masking

1. Open chords sound more clear than closed chords, especially using bass notes

2. Close notes sound sound homophonic – chords predominate

3. Spread out notes sound polyphonic – individual lines are more easily identified

4. Eg: Use of low chord in piano music affected by historical development of the piano

Page 36: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Binaural Effects

1. Binaural beats and diplacusis 2. Localization of sounds

(low f = 500-800Hz, high f > 1000Hz)3. Click illusions

(monaural and binaural)4. Precedence effect

Page 37: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Hearing Loss1. Temporary threshold shifts

Exposure to noiseReaction to drugs

2. Permanent hearing lossNoise or drug exposureNatural aging (presbycusis)Rubella during pregnancy

3. Tinnitus or ringing in ear (permanent or temporary)Noise or drugs

Page 38: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Treatment of Hearing Loss

1. Diagnosis using audiogram2. Surgery for outer and middle ear3. No correction for central

auditory system problems4. Hearing aid corrects threshold

problems5. Cochlear Implants

Page 39: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Cochlear Implant - Overview

Source: Prof. Graeme Clark, The Bionic Ear Institute

Page 40: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Cochlear Implant - Detail

Source: Prof. Leslie M. Collins, Duke University

Page 41: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Cochlear Implant ReferencesCochlear Implant Association, Inc.

http://www.cici.org/

The Bionic Ear InstituteThe University of Melbourne

http://www.bionicear.org/bei/index2.html

Advanced Bionicshttp://www.advancedbionics.com/

Page 42: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

TheHumanVocalTract

Page 43: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Closed tube system(formation of vowel sounds)

Shorter lengthRaises frequency

Moving center nodetoward closed endraises frequency byshortening wavelength

Page 44: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Vocal Formant spectra

“OO”

“AH”

“EE”

Page 45: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Vocal Spectrogram of Formants

Page 46: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Formants for vowel sounds

Page 47: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Constancy of formant frequencyas

Singing frequency changes

Page 48: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

TheSingersFormant

Averaged spectral energy distribution:Light: ordinary speechDark: orchestral accompanimentBrown: Good singer with orchestra

Johan Sundberg: The Acoustics of the Singing Voice; Sci. Amer., March 1977

Page 49: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Formation of Sibilants

Unvoiced:“sss”

Page 50: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Formation of Sibilants

Voiced:“zzz”

Page 51: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Audio Spectrograms

Page 52: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Voice and Synthesizer “wow”

Page 53: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Computerized Speech Laboratory

Page 54: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Matching vocal spectrograms

Page 55: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

1. Helium Voiceand Sulfur Hexafluoride Voice

2. Tibetan Monks and the

Tantric Rituals

3. The Harmonic Choir

4. Kronos String Quartetwith Tuvan Throat Singers

5. Falsetto singing andcountertenor singers

Page 56: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

Spectrograms of Bird Calls

What birds are they?

Page 57: (The Human Ear) 1. Peripheral Auditory System 2. Place Theory of Hearing 3. Amplitude Response of the Ear 4. Logarithms and Sound Intensity Scales 5. Periodicity.

The End