Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation...

58
Multichannel Identification of Room Acoustic Systems with Adaptive Filters based on Orthonormal Basis Functions Giacomo Vairetti KU Leuven Department of Electrical Engineering (ESAT) STADIUS - Center for Dynamical Systems, Signal Processing and Data Analytics Enzo De Sena KU Leuven ESAT-STADIUS Toon van Waterschoot KU Leuven ESAT-STADIUS Marc Moonen KU Leuven ESAT-STADIUS Shanghai, March 22nd, 2016 ICASSP 2016 Michael Catrysse TELEVIC N.V. Søren Holdt Jensen Aalborg Universitet

Transcript of Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation...

Page 1: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel Identification of

Room Acoustic Systems with

Adaptive Filters based on

Orthonormal Basis Functions

Giacomo Vairetti

KU Leuven

Department of Electrical Engineering (ESAT)

STADIUS - Center for Dynamical Systems, Signal Processing and Data Analytics

Enzo De SenaKU Leuven

ESAT-STADIUS

Toon van WaterschootKU Leuven

ESAT-STADIUS

Marc MoonenKU Leuven

ESAT-STADIUS

Shanghai, March 22nd, 2016

ICASSP ● 2016

Michael CatrysseTELEVIC N.V.

Søren Holdt JensenAalborg Universitet

Page 2: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Digital Filters for Room Acoustics Modeling

Multichannel Identification Algorithm

Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 3: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Adaptive Digital Filters for Room Acoustics Modeling

Multichannel Identification Algorithm

Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 4: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Filters for Room Acoustics

1

Adaptive filter

H(z)

• Modeling of RTFs

• Filter Adaptation

• Track variations of RTFs

• SIMO system

Page 5: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Filters for Room Acoustics

1

◄ Adaptive

+ + +

Adaptive filter

H(z)

• Modeling of RTFs

• Filter Adaptation

• Track variations of RTFs

• SIMO system

• FIR filter (All-zero model)

• Simple

• Global convergent adaptation

Page 6: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Filters for Room Acoustics

• FIR filter (All-zero model)

• Simple

• Global convergent adaptation

Problems:

• Large number of adaptive parameters

• Excessive computational burden

• Excess MSE (misadjustment)

1

◄ Adaptive

+ + +

Adaptive filter

H(z)

• Modeling of RTFs

• Filter Adaptation

• Track variations of RTFs

• SIMO system

Page 7: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Filters for Room Acoustics

2

▲ Adaptive ▲

• IIR filter (Pole-Zero model)

• Reduced number of parameters

• Can describe both resonances and time-delays

Adaptive filter

H(z)

• Modeling of RTFs

• Filter Adaptation

• Track variations of RTFs

• SIMO system

Page 8: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive Filters for Room Acoustics

• IIR filter (Pole-Zero model)

• Reduced number of parameters

• Can describe both resonances and time-delays

Problems:

• Higher complexity of the adaptive algorithm

• Slower convergence rate of adaptation

• Possible instability or convergence to local minima

2

▲ Adaptive ▲

Adaptive filter

H(z)

• Modeling of RTFs

• Filter Adaptation

• Track variations of RTFs

• SIMO system

Page 9: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

2nd-order resonator

Fixed-Pole Adaptive IIR Filters (FPAF)

3

Fixed ►

◄ Adaptive

Page 10: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

2nd-order resonator

Fixed-Pole Adaptive IIR Filters (FPAF)

3

Fixed ►

◄ Adaptive

(All θ’s equal to one and response normalized)

Page 11: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

2nd-order resonator

Fixed-Pole Adaptive IIR Filters (FPAF)

3

Fixed ►

◄ Adaptive

(All θ’s equal to one and response normalized)

Page 12: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

2nd-order resonator

Fixed-Pole Adaptive IIR Filters (FPAF)

3

Fixed ►

◄ Adaptive

(All θ’s equal to one and response normalized)

Page 13: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

FPAFs for Room Acoustics

• FPAF Impulse Response

4

Page 14: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

FPAFs for Room Acoustics

• FPAF Impulse Response

• Room Impulse Response (RIR)

4

Page 15: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

FPAFs for Room Acoustics

• FPAF Impulse Response

• Room Impulse Response (RIR)

IDEA:

Use a digital filter whose impulse response is a linear combination of a finite

number of exponentially decaying sinusoids (discrete in time)

• Fixed poles (common resonance frequencies and damping constants)

• Adaptive linear coefficients (variable amplitude and phase)

4

Page 16: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

2nd-order resonator

Fixed-Pole Adaptive IIR Filters (FPAF)

5

Fixed ►

◄ Adaptive

• Filter output

← Intermediate signals vector

← Adaptive linear coefficients vector

Page 17: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

All-pass filter

2nd-order resonator

Orthonormalization filter

• Filter output

• OBF filters and FPAFs span the same approximation space

OBF filters (Kautz filters)

5

Fixed ►

◄ Adaptive

Page 18: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

• Advantages:

• Accuracy : poles are moved closer to the real poles of the system

• Flexibility : poles can be arbitrarily fixed in the filter structure

• Stability : poles can be fixed inside the unit circle

• Linearity : the filter structure is linear in the tap-coefficients µ

• Transversal filter structure → Global convergence of adaptation

• Same complexity of adaptation algorithm as FIR filters

• Orthogonality (only OBF filters)

• Good trade-off between accuracy and number of parameters

• Repeated poles and pole addition/deletion

• Numerically well-conditioning (no order restriction)

• Faster global convergence

6

FPAFs and OBF filters

Page 19: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive OBF Filter

Adaptation Rule

7

Page 20: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive OBF Filter - LMS

Adaptation Rule - LMS

7

Regression vector

Page 21: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive OBF Filter - LMS

Adaptation Rule - LMS

Convergence rate in the mean

no faster than

7

Page 22: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive OBF Filter - LMS

Adaptation Rule - LMS

Convergence rate in the mean

no faster than

7

For white input signal

For nonwhite input signal *

B. Ninness and H. Hjalmarsson. Model structure and numerical properties of normal equations.

IEEE Trans. Circuits Syst.I, Fundam. Theory Appl., 48(4):425–437, 2001.

Page 23: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Adaptive OBF Filter - LMS

Convergence rate in the mean

no faster than

7

For white input signal

For nonwhite input signal *

B. Ninness and H. Hjalmarsson. Model structure and numerical properties of normal equations.

IEEE Trans. Circuits Syst.I, Fundam. Theory Appl., 48(4):425–437, 2001.

Performance depends

on the choice of

the fixed pole parameters

Page 24: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Adaptive Digital Filters for Room Acoustics Modeling

Multichannel Identification Algorithm

Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 25: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Multichannel Identification Algorithm

Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 26: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multi-channel pole estimation (SIMO)

• Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O data

Multichannel identification algorithm

8

MULTICHANNEL

ADAPTIVE

OBF FILTER

(LMS)

Block-based

OBF-GMP

buffer

buffer

Page 27: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multi-channel pole estimation (SIMO)

• Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O data

Multichannel identification algorithm

10

MULTICHANNEL

ADAPTIVE

OBF FILTER

(LMS)

Block-based

OBF-GMP

buffer

buffer

Page 28: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

◄ BB-OBF-GMP

Multichannel ▲

Adaptive OBF

Filter (LMS)

RTFs ►

Page 29: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

RTFs ►

Input signal

Output signals

Page 30: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

OBF Filter

Page 31: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

OBF Filter

Page 32: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

OBF Filter

Filter outputs

Page 33: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

10

OBF Filter

Error signals

Page 34: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

11

Page 35: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

11

Page 36: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

11

Page 37: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

OBF filters (Kautz filters)

11

Fixed ►

◄ Adaptive

Page 38: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

OBF filters (Kautz filters)

11

Fixed ►

◄ Adaptive

Page 39: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

OBF filters (Kautz filters)

11

Fixed ►

◄ Adaptive

Page 40: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

11

Page 41: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 42: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 43: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 44: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 45: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 46: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 47: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 48: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Multichannel identification algorithm

BB-OBF-MP

Dictionary

11

Page 49: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Multichannel Identification Algorithm

Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 50: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 51: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

SUBRIR database – BANG & OLUFSEN

12

available for download (coming soon)http://www.dreams-itn.eu/index.php/dissemination/downloads/subrir

G. Vairetti et al., “A physically motivated parametric model for compact representation of room

impulse responses based on orthonormal basis functions”, in Proc. EURONOISE 2015.

Page 52: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Training – system identification

13

Pole grid:

3000 poles

300 angles

10 radii

MULTICHANNEL

ADAPTIVE

OBF FILTER

(LMS)

Block-based

OBF-GMP

buffer

buffer

Poles estimated from input-output dataInput data = white noise sequence

Output data = input data convolved with h(n)

Page 53: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Compare the performances in the approximation of RIRs

using an FIR filter and an adaptive OBF filter with fixed common poles

Data sets of the same size as the training set, but different combinations:

Set 1: same 2 source positions, 3 different microphone positions

Set 2: 2 different source positions, 3 different microphone positions

Validation setup

14

Average misadjustment

Page 54: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

• Orthogonality assures

o numerical well-conditioning

o fast convergence of the filter adaptation (same as FIR filters)

• Reduced estimation error compared to FIR filters

• Robust to variations in the RTF → poles can be fixed after estimation

Validation results

15

Page 55: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Simulation Results

Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 56: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

► Conclusions

Outline

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”

ICASSP ● 2016

Page 57: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Conclusions

► Summary

• OBF filters for modeling and identifying room acoustic systems

motivated by the physical definition of the RIR and by the concept

of common acoustical poles (and variable zeros)

• Scalable, stable and well-conditioned Identification algorithm for

the estimation of the poles of adaptive OBF filters from

multichannel I/O data

• Same convergence rate of adaptation as FIR filters

• Reduced estimation error compared to FIR filters

• Estimated common set of poles robust to variations in the RTF

16

Page 58: Multichannel Identification of Room Acoustic Systems with ... · Multi-channel pole estimation (SIMO) • Estimate the fixed poles of an adaptive OBF filter from multi-channel I/O

Giacomo Vairetti

KU Leuven

Department of Electrical Engineering (ESAT)

STADIUS - Center for Dynamical Systems, Signal Processing and Data Analytics

[email protected]

http://www.dreams-itn.eu/

ICASSP ●2016

G. Vairetti et al., “Multichannel Identification of Room Acoustic Systems with

Adaptive Filters based on Orthonormal Basis Functions”