(12) United States Patent US 8,346,380 B2 Lee et a]. Jan. 1...

US008346380B2

(12) United States Patent Lee et a].

US 8,346,380 B2 Jan. 1, 2013

(10) Patent N0.: (45) Date of Patent:

(54)

(75)

(73)

(*)

(21)

(22)

(65)

(60)

(30)

Sep. 24, 2009

(51)

(52) (58)

(56)

METHOD AND AN APPARATUS FOR PROCESSING A SIGNAL

Inventors: Hyun Kook Lee, Seoul (KR); Sung Yong Yoon, Seoul (KR); Dong S00 Kim, Seoul (KR); Jae Hyun Lim, Seoul (KR)

Assignee: LG Electronics Inc., Seoul (KR)

Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 USC 154(b) by 553 days.

Appl. N0.: 12/567,580

Filed: Sep. 25, 2009

Prior Publication Data

US 2010/0079185 A1 Apr. 1, 2010

Related US. Application Data

Provisional application No. 61/100,262, ?led on Sep. 25, 2008.

Foreign Application Priority Data

(KR) ...................... .. 10-2009-0090516

Int. Cl. G06F 17/00 (2006.01) US. Cl. ........................... .. 700/94; 381/23; 381/310

Field of Classi?cation Search ................ .. 381/310,

381/119, 17*23; 327/100, 165, 166, 334, 327/355, 233; 704/500, E17.005; 700/94

See application ?le for complete search history.

References Cited

U.S. PATENT DOCUMENTS

7,916,873 B2 3/2011 Villemoes et al. 7,933,415 B2 4/2011 Breebaart 7,961,890 B2 6/2011 HolZer et al.

2005/0053242 A1 3/2005 Henn et a1.

(Continued)

FOREIGN PATENT DOCUMENTS

CN 1954362 A 4/2007

(Continued)

OTHER PUBLICATIONS

Breebaart et al., “Parametric Coding of Stereo Audio”, EURASIP Journal on Applied Signal Processing, vol. 9, pp. 1305-1322, 2005.

(Continued)

Primary Examiner * Xu Mei

Assistant Examiner * Friedrich W Fahnert

(74) Attorney, Agent, or Firm * Birch, Stewart, Kolasch & Birch, LLP

(57) ABSTRACT

A method of processing a signal is disclosed. The present invention includes receiving (a) doWnmix signal being gen erated from plural-channel signal and (b) spatial information indicating attribute of the plural-channel signal in order to upmix the doWnmix signal and including phase shift ?ag indicating Whether phase of a frame of at least one channel of the plural-channel signal is shifted; obtaining inter-channel phase difference (IPD) coding ?ag indicating Whether IPD value is used to the spatial information from a header of the spatial information; obtaining IPD mode ?ag indicating Whether the IPD value is used to frame of the spatial infor mation from the frame based on the IPD coding ?ag; obtain ing the IPD value of parameter band in the frame, based on the IPD mode ?ag; upmixing plural-channel signal by applying the IPD value to the doWnmix signal; and shifting the phase of the frame of the at least one channel of the plural-channel signal based on the phase shift ?ag.

7,447,629 B2 11/2008 Breebaart 7,797,163 B2 9/2010 Pang et a1. 12 Claims, 19 Drawing Sheets

in 210 240

L P 2 dow'nmixing upmixing

R unit unit

spatial information ~ 220 spatial information generalmg “mt (including IPD)

lPDnsing- I _\_ 221 delermlnmg "mt information obtaining unit ~ 230

IPD value IPD coding ?ag measuring unit '‘7 222 obtaining unit 7 23 1

spatial info. IPD mode ?ag , 223 IPD mode ?ag I 23,) generating unit obtaining unit ‘

IPD coding flag L” IPD value generating unit _ 224 _ obtaining unit I 23 3

US 8,346,380 B2

US. PATENT DOCUMENTS KR 10-0649299 B1 11/2006

0000000000 00 000000 00000 00 a. 0g 0g 333333553 3} $333; 2006/0004583 A1 1/2006 Herre et al. W0 W0 Zoos/039038 Al 4/2008 2006/0153408 A1 7/2006 Faller et al. 2007/0194952 A1 8/2007 Breebaart et al. OTHER PUBLICATIONS 2007/0219808 A1 9/2007 Herre et al. 2007/0223709 A1 9/2007 Kim et a1, Herre et al., “The Reference Model Architecture for MPEG Spatial 2007/0244706 A1 10/2007 Tsushima Audio Coding”, Presented at the 118th Audio Engineering Society 2008/ 0002842 A1 1/ 2008 Neusinger et al. Convention, Barcelona, Spain, May 28, 2006, Convention Paper 2008/0031463 A1 2/2008 Davis 6447, 2008/0199014 A1 8/2008 Kurniawati et 31 “TeXt of 14496-3 2001/:FDAM 2, Parametric Coding”, Joint Video Zoos/0243520 A1 10/2008 Breebwt Team (JVT) of ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/ Zoos/0304670 A1 12/2008 Breebm SC29NVG11 and ITU-T SG16 Q6) XX XX, No. N6130, Feb. 23, 2009/0210236 A1 8/2009 Moon et al. 2004,1313‘ 1422, Xp030013089‘ 2009/0222272 A1 9/2009 séefeldt et 31' Gert Weinrich, “Improved EXternaliZation and Frontal Perception of 2011/0173005 A1 7/2011 HllP‘?“ et a1~ Headphone Signals”, AES, Mar. 24, 1992, pp. 1-46, XP040369732. 2011/0235810 A1 9/2011 Neuslnger et a1‘ Purnhagen, “Low Complexity Parametric Stereo Coding in MPEG

FOREIGN PATENT DOCUMENTS 4”, Proc. of Intl., Conf. on Digital Audioeffects, XX, XX Oct. 5,2004, pp. 163-168, XP002364489.

CN 101263742 A 9/2008 Samsudin et al., “A Stereo to Mono DoWnmiXing Scheme of EP 1 736 774 B1 5/2008 MPEG-4 Parametric Stereo Encoder”, Acoustics, Spech and Signal JP 2005-523479 A 8/2005 . JP 2007_526522 A 9/2007 Processing, IEEE Intl. Conf., Jan. 1, 2006, pp. V529-V532 JP 2007-531913 A 11/2007 XP031101562~ _ JP 2008527431 A 7 /2008 Werner Oomen et al., “MPEG4-EXt2: CE on Low CompleX1ty Para JP 2010521002 A 6/2010 metric Stereo”, Joint Video Team (JVT) ofISO/IEC MPEP & ITU-T JP 2011-527456 A 10/2011 VCEG(ISO/IEC, JTC 1/SC29/WG11 and ITU-T SG16 Q6),XX, XX, KR 10-2008-0051042 A 6/2006 No. M10366, Dec. 2, 2003, pp. 1-38, XP030039221.

US. Patent Sheet 1 0f 19 Jan. 1, 2013

FIG. 1

| ‘Spatial information

Header Framel @

US 8,346,380 B2

FrameN

()( )

Header

bsPhaseCodingzl

FrameZ Frame3

//// /// /

bsPhaseMode=1 hsPhaseM0de=0

——"> IPD value -—-—> IPD va1ue=0

US. Patent Jan. 1, 2013 Sheet 2 0f 19 US 8,346,380 B2

m .05


ulll m .UE

Rm

/%

1:10: 3


FIG. 4

410 420

[PD measuring unit [PD obtaining unit

L__ IPD value Av 411 dequautized IPD *v 424 measuring unit value obtaining unit

422 \ R [PD IPD value \ coat.“ . ?n? . —- quantization unit K dequantization dequantization A“ 423

g 412 unit unit

t i [PD quantization mode IPD_qu?11t_m°de_?ag [PD quantization mode NJ 421 ?ag generating unit \\ 413 ?ag obtaining unit


0mm w

ohm

2% w

E5 manna? NED

~ owm

m 6E

EB mcs?ucom GE Emma“

%

N omm

E5 wEEEEBm 02? GE E2 152% 4 :5. MQEEQE Emma own

%


FIG. 7

pb==0

N ' time slot LlJ ZJ 3


FIG. 8

1 f pb:4 / A plug I // _ v/ / / /

pb—2 ‘Z k L’ I I

P‘H \ /: k ; |/ ~( / ‘z

parameter bar1d=0 ?/ W |\ / , /

1-, 2JL3J 4 L5 NJ timeslot

£2 2 phase phase

60 “““"'““ 60 k???mvé +

smoothed ~___'____~____

phase

10 i" 10 _1_


FIG. 10

(MB OdB, 440° OdB DdB, -30°

Decoding without IPD

Synthesis Original

OdB OdB

Decoding Without IPD

Synthesis Original

US. Patent Jan. 1, 2013 Sheet 11 0119 US 8,346,380 B2

S .65

Q

US. Patent Jan. 1, 2013 Sheet 12 0119 US 8,346,380 B2

FIG. 12

“D l

w

a was

arm,“ V. .1

D 1mm R Mm :D l uLUD u 0 amt m? vwm

1 DH m WW I

D W mm“ 0 MM. .[

3? . U mmm 0m .rmd

.t .t m m 0 0 1 nVUb g 2t(m.m mmtt? 1 all 1

W Wm wm 2 DW DM 1 Km Pm

FIG. 13

Start frames of new constant LPD sequence

r3 ,//// ///,

Frames where no valuable IPD is detected

’//// Frames where valuable IPDs are detected


FIG. 14

14$ 1460

DMX . . .

= upnuxing umt

a

global-frame IPD value 1450 1410 w of p1'6V10l1S frame I

. . .t

mewmg um _‘ global-frame IPD value

f obtaining unit 1420 % global-frame lPD value \

calculating unit

1440

1430 w global-frame IPD ?ag global-frame IPD ?ag generating unit obtaining unit


FIG. 15

1520 1595

a downmix signal . . . upmixmg unit

1510 1550 1590

ICC value ICC ICC value ICC‘ ICC value measuring unit modifying unit obtaining unit

1520

2 1580 LPD value N 1540 2

mgasu?ng unit infoimation deteimining IPD hm.) .Value -

at o taming unit ILD value um

measuring unit

1530

IPD mode ?ag IPD mode ?ag 1560 m generating unit obtaining unit ~ 1570


FlG. 16

15% a dowmnix signal

1610 2 1660

L input signal ‘ I classifying . . .

R unit upm nun g unit

1620 1650

i 2 l ' lPD value _ IPD value

L measuling unit obtaining unit

1630 1640

l l l IPD ?ag IPD ?ag

generating unit obtaining unit

US 8,346,380 B2

1860

/ output unit

US. Patent Jan. 1, 2013 Sheet 17 0119

FIG. 18

m

1810

Wire/wireless 1840 communication unit /

wire A“ 1811 signal decoing unit

communication unit PD cp‘l?ng ?ag "V1841 infrared * 1812 obtaining unit

Bitstrcam communication unit IPD mode ?ag “01842 Bluetooth obtammg unit

unit '“~-' 1813

[PD value _ - obtainin unit “1843

wireless LAN A’ 1814 g communication unit “pm-King

- "v I844

unit 1820

user

authenticating unit

?ngeipiint . - - - '~ 1821

rccogmzrng umt 1850

i-‘i-S - ~1s22 / recognizing umt _

control unit

face Ad recognizing unit 1823

voice Av recognizing unit {824

1830

input unit

@WI @4831

signal output unit “V 1861

display unit

"“ 1862

[6111016 controller unit A“ 1833


FIG. 19

1910 1920

/ / 1“ terminal M 2“ terminal

wire/wireless communications

1930 1940

sewer W 1st terminal wire/wireless communications

(11)

(12) United States Patent US 8,346,380 B2 Lee et a]. Jan. 1...

Documents

Transcript of (12) United States Patent US 8,346,380 B2 Lee et a]. Jan. 1...