Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent...
-
Upload
gervais-sims -
Category
Documents
-
view
212 -
download
0
Transcript of Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent...
![Page 1: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/1.jpg)
Blind speech dereverberation using multiple microphones
Inseon JANG, Seungjin CHOI
Intelligent Multimedia LabDepartment of Computer Science and Engineering, POSTECH
[email protected]@postech.ac.kr
![Page 2: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/2.jpg)
2
Outline
Introduction What is the Reverberant speech ?
Previous approaches for Speech dereverberation Blind speech dereverberation using multiple microphones
Blind Equalization using multiple microphones – Single Input Multiple Output (SIMO) system
Subspace Method Deterministic Method Results
![Page 3: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/3.jpg)
3
What is the Reverberant Speech ?
Reverberant speech
cf) Noisy speech
The degrading component of the case of reverberation is dependent on previous speech data, whereas the degrading component of the case of noise speech is independent of speech.
N
kkk nnsbnsnx
1
)()()(
)()()( nznsnx
![Page 4: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/4.jpg)
4
Previous approaches for Speech dereverberation
Cepstrum based approach Adaptive microphone array processing Blind Deconvolution Temporal envelope filtering Multi-Microphone sub-band envelope estimation Wavelet transform extrema clustering Maximum-kurtosis subband adaptive filtering Using LP Residual signal Using Probabilistic Models
![Page 5: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/5.jpg)
5
Blind Equalization using multiple microphones – SIMO system (1/2)
)(ˆ ksy
)1(kh
)(ks )(L
kn
)1(kn
)(Lkh
sourcesignal
Impulse response
received signal
)()( kx L
)()1( kx )1(kw
)(Lkw
Inverse filter
unknown
estimated signal
![Page 6: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/6.jpg)
6
Blind Equalization using multiple microphones – SIMO system (2/2)
where is the filtering matrix
For virtual channel,
,0
0
0
000
0
0
)()(0
)()(0
)()(0
iM
i
iM
i
iM
i
N
hh
hh
hh
H
)( MNN NH
)()()( inn
in
in BSΗX
,],,[ 1T
MNnnn ss S TiNn
in
in bb ],,[ )(
1)()(
B
L
)1(
)0(
)1(
)0(
)1(
)0(
LN
n
NLN
N
Ln
n
B
B
S
H
H
X
X
,],,[ )(1
)()( TiNn
in
in xx X
![Page 7: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/7.jpg)
7
Subspace Method
By orthogonality between the noise and the signal subspace,the column of are orthogonal to any vector in the noise subspace
for
Subspace-Based Parameter Estimation SchemeMinimization of the quadratic form
NH
NMLNi 00NHi HG
1
0
2ˆ)(NMLN
iN
Hi HGHq
![Page 8: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/8.jpg)
8
Deterministic Method (1/2)
Cross Relation Approach
),()()( kskhkx ii )()()( kskhkx jj
)()()()()( kskhkhkxkh ijij
)()())()(()( kxkhkskhkh jiji
)(ikh
)(ks
)( jkh
)()( kx j
)()( kx i
)(ikh
)( jkh
0
![Page 9: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/9.jpg)
9
Deterministic Method (2/2)
Channel estimate
Equivalently, the channel estimate can be obtained from the singular vector of associated with the smallest singular value
2
1)(minˆ hLh
hX
h)()( LL HXX
![Page 10: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/10.jpg)
10
Result (1/3)Reverberant signal and Dereverberant signal
![Page 11: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/11.jpg)
11
Result (2/3)Dereverberation using Subspace method
Channel length : 654 Test size : 5000
Result MSE : 1.3608e-007
![Page 12: Blind speech dereverberation using multiple microphones Inseon JANG, Seungjin CHOI Intelligent Multimedia Lab Department of Computer Science and Engineering,](https://reader035.fdocuments.in/reader035/viewer/2022072014/56649eb25503460f94bb8da4/html5/thumbnails/12.jpg)
12
Result (3/3)Dereverberation using Deterministic method
Channel length : 654 Test size : 1000
Result MSE : 7.7074e-018