Changes in Musical Culture and Practices as a result

of new Multimedia Technologies

QuickTime™ and a decompressor

are needed to see this picture.

http://crel.calit2.netsdubnov@ucsd.edu

ISM 2011, Dec. 6

Shlomo Dubnov

Technology in Music Industry

• Delivery Channels: CD and Internet

• Production: DAW• Content Access: Music

Discovery Sites• What next ?

Market Research

• "Seeing that music industry is more diverse and fragmented, monetising the new music experience has become increasingly complex”– Dominique Leguern, Director of MIDEM

• Almost one in five music fans 'will do anything' to meet their idols, and many are happy to view ads and even share their personal information for access to free music– Synovate, Music Matters, MIDEM 2010

Music Consumption Patterns

• Cultural diversity– 63% consider themselves passionate about music – 'I couldn't care less' (1) to 'I'd listen every minute of the day if I

could' (10). – rank 6 and above: top Brazil (80%), Spain and the UK (79% each),

lowest in Australia (27%)

• Celebrity culture– 'give anything' to meet their favorite music artists US (33%), UK

(32%) and Spain (30%), China, Hong Kong, and Hungary (7%)

• Brands sponsorship– 47% of people globally don't think this is a good idea, with

Hungarians the most opposed, at 63%– 30% of people globally look out for competitions or promotions that

feature their favourite artists and bands, topped by China at 49%

Changes in Music Industry

• 1980s, the "Big 6" — EMI, CBS, BMG, PolyGram, WEA and MCA

• 1998, the "Big 5” - Sony bought CBS Records in 1987, PolyGram merged into Universal Music Group

• 2004, the “Big 4” - Sony acquired BMG• 2011, the “Big 3” - Universal acquired EMI

QuickTime™ and a decompressor

are needed to see this picture.

Sony CD 1976 MP3 1991

1000 True Fans

Tribe / Herd

Music as a social product

True fan is a person who spends $100 on his favorite artist per year

Integrated Music Experience

• New Composition Models• Multi-Layer• Database Search• Content Matching• Interactive Sets• Generative Music• Group Intent and Coordination

Multi-Layer Representation

Layers Layer synchronization

XML Symbols for Synchronization

Semantic Web Music

QuickTime™ and a decompressor

are needed to see this picture.

New Content Models

• Remixes

• Mashups

• Sound Clips

• Tracks

• DJ Sets

• Controllerism

• Live Improvisation

QuickTime™ and a decompressor

are needed to see this picture.

Ophir Kutiel “Kutiman” - ThruYou

Represents and audio as a finite state automaton with similarity transitions

Audio Oracle

Provides much “cleaner” structure discovery then Similarity Matrix

Can be used for improvisation, style imitation, composition

Structure Discovery

Video Remix

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

Original video is continuous shot so every jump is a recombination

http://shlomodubnov.wikidot.com/compositions

Machine Improvisation

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Memex:Piano Violin QuickTime™ and a

TIFF (Uncompressed) decompressorare needed to see this picture.

Composer Duets:

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Research Topics

• Representation of musical structure• Interaction Rules, Predictive Models• Interface and Group Coordination• Automatic structure discovery

– Tonality, Chord detection– Beat detection, Tempo, Rhythm– Repetition Structure

• Characterization of Aesthetics and Emotions

Group Interaction with Music

• Distributed DJ• Live improvisation set• GUI is part of the composition

http://192.168.0.101:3000/demo

Musical Information Dynamics

• Aesthetic perception as a communication process • Music triggers cognitive processes in the listener• Structure can be measured as mutual information from past to present• The information paradox: Discover more by listening more… (you gain by learning, not get bored!) • Related to Birkhoff Aesthetic Measure

Slow brain appraisal

Fast brain processing

Self-supervision (emotions, etc.,…)

Receiver y

Channel. Source x

( , ) ( ) ( | )I x y H x H x y= −

Birkhoff’s Aesthetic Measure

M = O/C O - Perceived Order C - Complexity

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

O=V+E+R+HV-F

V - verticalE - equilibriumR - rotation

HV - networkF - form

Audio Analysis

• OMRAS2

• Vamp Plugins

• Matlab tools

Summary

• Integrated music experience• More Granularity• Deeper understanding of musical structure• Easier Access to Music Knowledge• Individual and Group Interaction• More Creativity