Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.
-
date post
15-Jan-2016 -
Category
Documents
-
view
222 -
download
0
Transcript of Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.
![Page 1: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/1.jpg)
Computational Spectro-temporal Auditory Model
Taishih ChiJune 29, 2003
![Page 2: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/2.jpg)
Auditory Model
• Overview – two stage processing• Model description and formulation• Examples of representations• Reconstruction from model output
representations• Discussions
SpectralEstimation
Early Auditory
SpectralAnalysis
Primary Cortex (A1)
SoundAuditorySpectrum
CorticalRepresentation
![Page 3: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/3.jpg)
Auditory ModelOverview
• Temporal dynamics reduction
• Monaural model• Two stage functional
model– Early stage
(spectrum estimation)
– Cortical stage (spectrum analysis)
![Page 4: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/4.jpg)
Early stage Mathematical Formulation
![Page 5: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/5.jpg)
Early Stage MATLAB Implementation
Matlab ToolBox Usage:yfinal = wav2aud(s, [frmlen, tc, fac, shft], filt);
s : acoustic input signal
yfinal: auditory spectrogram; N(time) x M(freq.)
CF = 440 * 2 .^ ((-31:97)/24 + shft);
![Page 6: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/6.jpg)
Cortical stage Spectrotemporal Receptive Field
4
0.125
4
0.125
4
0.125
4
0.125
4 4
0.125
CF
requ
ency
(kH
z)F
requ
ency
(kH
z)
Fre
quen
cy (
kHz)
Fre
quen
cy (
kHz)
Fre
quen
cy (
kHz)
Fre
quen
cy (
kHz)
Time (ms) Time (ms) Time (ms)
Time (ms) Time (ms) Time (ms)
250 250 250
250250250
0 0 0
0000.125
D E F
BA
![Page 7: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/7.jpg)
(a)
Time (ms)
Lo
g.
Fre
qu
en
cy
Downward; :1 cyc/oct, :4 Hz
500 1000
0.25 CF
0.5 CF
1 CF
2 CF
4 CF
(b)
-1.25 0 1.25
0
Log. Frequency (octave)
hs
0 1 2 3 4 5
0
Time (sec)
ht
Cortical stage Model Implementation
![Page 8: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/8.jpg)
Cortical stage Mathematical Formulation
where
then the spectrotemporal cortical response:
![Page 9: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/9.jpg)
Cortical stage Mathematical Formulation (cont’d)Consider the complex wavelet transform
where
then
![Page 10: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/10.jpg)
Cortical stage Cortical Representation of Speech
Fre
qu
en
cy (
Hz)
Time (ms)100 200 300 400 500 600 700 800 900 1000
125
250
500
1000
2000
Multiresolution Cortical Filters and Outputs
Upward Downward
Slow RateCoarse Scale
Slow RateFine Scale
Fast RateCoarse Scale
Fast RateFine Scale
Slow RateCoarse Scale
Slow RateFine Scale
Fast RateCoarse Scale
Fast RateFine Scale
![Page 11: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/11.jpg)
Cortical Magnitude Representation of Speech
Fre
quen
cy (
Hz)
Time (ms)
Auditory Spectrogram
100 200 300 400 500 600 700 800 900 1000
125
250
500
1000
2000
Multiresolution Cortical Filters and Outputs
Upward Downward
Slow RateCoarse Scale
Slow RateFine Scale
Fast RateCoarse Scale
Fast RateFine Scale
Slow RateCoarse Scale
Slow RateFine Scale
Fast RateCoarse Scale
Fast RateFine Scale
![Page 12: Computational Spectro- temporal Auditory Model Taishih Chi June 29, 2003.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d4a5503460f94a26d29/html5/thumbnails/12.jpg)
Cortical Stage MATLAB Implementation
Matlab ToolBox Usage:cr = aud2cor(y, para1, rv, sv, fname, DISP);
cr: 4D cortical representation (scale-rate(up-down)-time-freq.)
y : auditory spectrogram, N(time) x M(freq.)
para1 = [paras FULLT FULLX BP],paras:see WAV2AUD
FULLT (FULLX): fullness of temporal (spectral) margin.
BP: pure bandpass indicator.
rv: rate vector in Hz, e.g., 2.^(1:.5:5).
sv: scale vector in cyc/oct, e.g., 2.^(-2:.5:3).