The Echo Nest Remix at Dorkbot NYC, March 4 2009

Post on 12-May-2015

1.981 views 0 download

Tags:

description

Brian Whitman from The Echo Nest presents The Echo Nest Remix API to Dorkbot NYC, March 4 2009.

Transcript of The Echo Nest Remix at Dorkbot NYC, March 4 2009

THE ECHO NEST REMIX API

Hello dorkbot nyc! I am Brian Whitman a co-founder of

The Echo Nest Corporation, a music intelligence concern based in

Somerville, MA, USA.

The Remix API is/was developed by our lovely employees and well-wishers:

Ben Lacker, co-founders Tristan Jehan & myself,Josh Lif-ton, Rob Ochsorn, Adam Lindsay

http://code.google.com/p/echo-nest-remix

THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO

THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO

THINGS WE MAKE MONEY DOING

THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO

THINGS WE MAKE MONEY DOING

REMIX

THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO

THINGS WE MAKE MONEY DOING

REMIX

something to do withhall & oates

WHAT THE ECHO NEST REMIX API

DOES

segments

2 4 6 8 10 12 14 16 segments

20

15

10

5

1

25

20

15

10

5

1

25

0 0.5 1 1.5 2 sec.

0 0.5 1 1.5 2 sec.0

0.2

0.4

0.6

0.8

1

C

D

E

F#G

B

C#

D#

F

G#AA#

0 0.5 1 1.5 2 sec.

segm

enta

tion

audi

tory

spe

ctro

gram

pitc

h fe

atur

estim

bre

feat

ures

auditory spectrogram

pitch features

timbre features

JEHAN STYLE

beat markers

tempogram

tempo spectrum

0 5 10 15 20 25! -2

! -1

0

1

2x 104

0 5 10 15 20 25

72 96 143 190 2400

0.2

0.4

0.6

0.8

1

60

6072

96114

143

240

114

190

JEHAN STYLE

ANY OL SOUND, for free, chop it up into

Sections: verse, chorus, bridge

Bars

Beats (downbeat)

Segments / syllables / notes

>> song.segments[segment, segment, segment...]>> song.segments[10].start34.502>> song.segments[10].timbre[-30.2, -10.4, 4.5, 3.2...]>> song.segments[10].pitch[0.5, 0.13, 1.0, .... ]

>> song.segments.reverse()

>> for i in segments: i.stretch(2) i = i + othersong.segment[12]

ALL SONG ELEMENTS ARE ITEMS IN A LIST

>> You can mix elements, time stretch them, detect & change pitch, move themaround, repeat them on downbeats, find a closest match in another song, detect and modify volume envelopes, read/write mp3, aiff, wav

File "<stdin>", line 1SyntaxError: invalid syntax

WHAT YOU CAN DO WITHTHE ECHO NEST REMIX API

MAKE WEB SITES

MAKE WEB SITES THAT CONFUSE PEOPLE

MAKE PRETTY PICTURES

MAKE PRETTY PICTURES

MAKE MUSIC

I’ve always wanted to hear Justin Timberlake trying to sing Billie Jean automatically by comparing timbre,

pitch and loudness distances.

-B.L.

MAKE MUSIC

Let’s go on residency in Amsterdam and get an adorably nervous Austrian accordionist to play like a bird!

-K.D. & B.W.

MAKE MUSIC

James Brown... FOREVER.

- T.J.

MAKE MOVIES

THE NEAR FUTURE OFTHE ECHO NEST REMIX API

STAGE ONE:ALL MUSIC, ALL THE TIME

>> from echonest import search>> segments = search.query(“voice”, soundsLike=”bjork”, pitch=”F#”)>> len(segments)65706>> new_song = random.shuffle(segments).write(“bjork2009.mp3”)

STAGE TWO:GET OFF THE COMPUTER

HAVE YOU SEEN THIS THING IT’S CRAZY

STAGE THREE:Let NORMAL PEOPLE use it

0%

25%

50%

75%

100%

nothing not much a little somewhat pretty good expert dork prime

Mus

ic g

oodn

ess

Computers know-how

brian

YES WE CAN

HELP US

do you wonder if sysex is turing

complete?are you one of those python “people” (you know what I’m saying)

did you ever write a music app in {R,

MATLAB, Excel, bash}?

would you like to put girl talk out of

business?

we catalog every orchestra hit 1980-1992. want the password?

http://code.google.com/p/echo-nest-remix

brian@echonest.com