IEEE CTCN 2016-06-22 Object-based Audio for Home Theater ... · and Video Games Presented to the...

Object-basedAudioforHomeTheaterSystems

andVideoGamesPresentedtothe

IEEECentralTexasConsultantsNetworkby

SergioLiberman2016-06-22

Abstract

Home theater systems have seen great advanced invideo quality with 4K resolution, 3D and highdynamic range with the recently introduced UltraHD and Dolby VisionTM.The correspondent advances for the soundtrackuses object-based audio technology to offer 3D-likesound fields. This presentation will discuss DolbyAtmos® and DTS:X® object-based audio, and theapplications for home theater, video games andmobile.

Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

2

3Object-basedAudio forHomeTheaterSystemsandVideoGamesSergioLiberman- 2016-06-22

Object-BasedAudio

ObjectvsChannelBasedAudio

• Channel-basedaudioformatisfundamentallylimitedbecauseitiscreatedtoplaybackonaspecificspeakerarrayconfiguration.Expandingthesystembyaddingmorespeakersdonotresultinbetteraudiofield.

• Ifamovieismixedfora5.1speakerconfiguration,ithasjusttheinformationrequiredtoplaybacktofivespeakers,setinpredefinedlocations,andonesubwoofer.Thereisnoinformationforadditionalspeakers.Thespeakerpositionsarerigidlydefined.


4

ObjectvsChannelBasedAudio

• Objectbasedaudioisnotlockedtoacertainnumberofspeakers.Instead,theaudiodatacarriesadditionalinformationabouttheaudioobjectstoallowthefinalaudiorenderingtooccurattheprocessorinthelivingroom,usingtheparticularspeakerconfiguration.

• InDolbyAtmosandDTS:X,eachsoundinamoviescene—agunshotorascream,forinstance—canbeanobject.Filmmakerscanpreciselyspecifywherethosesoundobjectsshouldappearinthe3Dacousticspaceandhowtheyshouldmovearound.


5

Object-basedAudioCodecs

• Dolby Atmos• DTS:X• Auro 3D• MPEG-H


6


3DAudioinHomeTheater

DOLBYATMOS®FEELEVERYDIMENSIONTM

“DolbyAtmostransportsyouintothestorywithmovingaudiothatflowsallaroundyouwith

breathtakingrealism.”


8

DTS:X®EXPERIENCEDTS:X

“DTS:X places sound where it would occurnaturally in space, creating the most lifelike,multi-dimensional audio experience ever. Beprepared — this improved immersion andheightened realism makes horror movies scarier,comedies more laugh-out-loud, and car chasescenes even more intense.”


9

EvolutionofHomeTheaterAudio(Dolby)

• Mono: one Front speaker (C)• Stereo: two Front speakers (L, R)• Dolby Prologic: three Front speakers (L, C, R), plus rear

surround.• Dolby Digital 5.1 surround sound - Front speakers (L, C, R)

and Surround speakers (LS and RS), plus effects channel.• Dolby Surround 7.1 - Front speakers (L, C, R), Surround

speakers (LS and RS), Rear Surround (RLS and RRS), pluseffects channel. May get to 9.1 with the addition of twofront height speakers.

• Dolby Atmos – builds on top of Dolby Surround 7.1, addingoverhead speakers, from 5.1.2 up to 9.1.2 speakerconfigurations.


10

DolbyAtmosandDTS:XChannelandObjectAudioHybrids

• Dolby Atmos adds object based audio tochannel based Dolby Digital Plus. Assumesspecific speaker arrays to reduce complexity.

• DTS:X also adds object based audio to DTSchannel audio streams. However, DTS:X allowsarbitrary speaker array configurations formore flexibility.


11

5.1SpeakerArray


12

5.1.2AtmosCeilingSpeakerArray


13

5.1.2AtmosEnabledSpeakerArray


14

9.1SpeakerArray


15

9.1.2AtmosSpeakerArray


16

YamahaYSP-5600DolbyAtmosEnabledSoundBar


17

WhatequipmentisrequiredforDolbyAtmosandDTS:Xplayback?

• Blu-rayplayer– existingBlu-rayplayersarecompatible.

• Soundbar– mustbeequippedwithDolbyAtmosand/orDTS:Xdecoders,andtheadditionalheightspeakers.

• A/VReceiver– mustbeequippedwithDolbyAtmosand/orDTS:Xdecoders.

• Speakers:additionalheightspeakersorDolbyAtmosEnabledspeakersarerequired.


DolbyAtmosandDTS:XBlu-RayDiscs

• DolbyAtmos:– http://www.dolby.com/us/en/experience/dolby-atmos/bluray-and-streaming.html

• DTS:X:– http://dts.com/dtsx


Formoreinformation

• http://dts.com/dtsx• http://www.dolby.com/us/en/brands/dolby-atmos.html

DolbyAtmosatthemovietheater:• http://www.dolby.com/us/en/experience/dolby-

atmos/movies.htmlDolbyAtmosmovietheatersintheAustinarea:• EVOEntertainmentCenter,3200KyleCrossing,KyleTX78640• Santikos MayanPalace,1918S.W.MilitaryDrive,SanAntonio

TX78221



3DAudioinGames

3DAudioinGames• Object-basedaudioofferstheflexibilityrequiredforsound

eventsingames.• Beingfreeoftherestrictionsofchannel-basedaudioallows

precisepositioningoftheaudioeventsinthe3Dacousticspace,tailoredtotheend-pointspeakerorheadphonesystemconfiguration.


3DAudioinGames“Avideogame'saudiosceneismadeupofmanyindependentaudioobjects,liketheenginesofashipflyingaboveyouorweaponsfiringattargetspastyourhead.Traditionalaudiotechnologiesrequiregamesounddesignerstoflattenthethree-dimensionalaudiointoatwo-dimensionalplane,losingvaluablepositioninginformationintheprocess.ButDolbyAtmosremovesthisbarrier.Forthefirsttime,thethree-dimensionalaudiosceneispreserved,soyou'rerightinthemiddleoftheaction.Now,notonlycanyoucanheartheenemyinfrontandbehindyou,butaboveyouaswell—givingyouacompetitiveadvantage.”


StarWarsBattlefrontwithDolbyAtmos



3DAudioinHeadphones

Head-relatedTransferFunction


3DAudioinHeadphones• Ahead-relatedtransferfunction(HRTF)isaresponsethatcharacterizeshowanearreceivesasoundfromapointinspace;apairofHRTFsfortwoearscanbeusedtosynthesizeabinauralsoundthatseemstocomefromaparticularpointinspace.

• Humanshavejusttwoears,butcanlocatesoundsinthreedimensions– inrange(distance),indirectionaboveandbelow,infrontandtotherear,aswellastoeitherside.Thisispossiblebecausethebrain,innerearandtheexternalears(pinna)worktogethertomakeinferencesaboutlocation.


3DAudioinHeadphones• DolbyHeadphone• DTSHeadphone:X• SmythRealiser

TheRealiserprovidesanexperienceinwhichmultichannel(orstereo)recordingsoundsareindistinguishablythroughheadphonesasitdoesthroughaloudspeakerarrayinarealroom.TheRealiserappliesHRTFstomultichannelsoundtodrivetheheadphones.TheRealiseremploysthreecriticalcomponentsnotseenintheotherproducts:

• personalization• headtracking• thecaptureofthepropertiesofanyreallisteningspaceand

soundsystem.



SignalProcessingPlatformsforDevelopmentand

Implementation


MomentumDataSystemsEQ1• DevelopmentplatformforDolbyAtmosandDTS:X• UsesstandardDA8xxTItools(CCS,PA,Linux,etc.)• MultiDSPsystem:

– ThreeTIDSPchips:DA830+2xDA808– ARM926+3xC647xDSPcores@456MHz– 12-channelanalogin,24-channelanalogout.– HDMII/O


MDSEQ1BlockDiagram

MDSAPM-89L


• APM-89LprocessormoduleforDolbyAtmosandDTS:Xdecoding

• TwoDSPchips:DA830+DA810


MDSEVMD• DolbyAtmosandDTS:XdemoplatformfortheAPM-89Lprocessormodule.

• 8-channelanalogin,16-channelanalogout.• HDMII/O

ThankYou

Myname:SergioLibermanMyemail:[email protected]


IEEE CTCN 2016-06-22 Object-based Audio for Home Theater ... · and Video Games Presented to the...

Documents

Transcript of IEEE CTCN 2016-06-22 Object-based Audio for Home Theater ... · and Video Games Presented to the...