The Echo Nest Remix at Dorkbot NYC, March 4 2009
33
THE ECHO NEST REMIX API Hello dorkbot nyc! I am Brian Whitman a co-founder of The Echo Nest Corporation, a music intelligence concern based in Somerville, MA, USA. The Remix API is/was developed by our lovely employees and well-wishers: Ben Lacker , co-founders Tristan Jehan & myself, Josh Lif-ton, Rob Ochsorn, Adam Lindsay http://code.google.com/p/echo-nest-remix
-
Upload
brian-whitman -
Category
Technology
-
view
1.981 -
download
0
description
Brian Whitman from The Echo Nest presents The Echo Nest Remix API to Dorkbot NYC, March 4 2009.
Transcript of The Echo Nest Remix at Dorkbot NYC, March 4 2009
THE ECHO NEST REMIX API
Hello dorkbot nyc! I am Brian Whitman a co-founder of
The Echo Nest Corporation, a music intelligence concern based in
Somerville, MA, USA.
The Remix API is/was developed by our lovely employees and well-wishers:
Ben Lacker, co-founders Tristan Jehan & myself,Josh Lif-ton, Rob Ochsorn, Adam Lindsay
http://code.google.com/p/echo-nest-remix
THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO
THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO
THINGS WE MAKE MONEY DOING
THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO
THINGS WE MAKE MONEY DOING
REMIX
THINGS WE CAN DO IN OUR COMPANY THAT NO ONE ELSE CAN DO
THINGS WE MAKE MONEY DOING
REMIX
something to do withhall & oates
WHAT THE ECHO NEST REMIX API
DOES
segments
2 4 6 8 10 12 14 16 segments
20
15
10
5
1
25
20
15
10
5
1
25
0 0.5 1 1.5 2 sec.
0 0.5 1 1.5 2 sec.0
0.2
0.4
0.6
0.8
1
C
D
E
F#G
B
C#
D#
F
G#AA#
0 0.5 1 1.5 2 sec.
segm
enta
tion
audi
tory
spe
ctro
gram
pitc
h fe
atur
estim
bre
feat
ures
auditory spectrogram
pitch features
timbre features
JEHAN STYLE
beat markers
tempogram
tempo spectrum
0 5 10 15 20 25! -2
! -1
0
1
2x 104
0 5 10 15 20 25
72 96 143 190 2400
0.2
0.4
0.6
0.8
1
60
6072
96114
143
240
114
190
JEHAN STYLE
ANY OL SOUND, for free, chop it up into
Sections: verse, chorus, bridge
Bars
Beats (downbeat)
Segments / syllables / notes
>> song.segments[segment, segment, segment...]>> song.segments[10].start34.502>> song.segments[10].timbre[-30.2, -10.4, 4.5, 3.2...]>> song.segments[10].pitch[0.5, 0.13, 1.0, .... ]
>> song.segments.reverse()
>> for i in segments: i.stretch(2) i = i + othersong.segment[12]
ALL SONG ELEMENTS ARE ITEMS IN A LIST
>> You can mix elements, time stretch them, detect & change pitch, move themaround, repeat them on downbeats, find a closest match in another song, detect and modify volume envelopes, read/write mp3, aiff, wav
File "<stdin>", line 1SyntaxError: invalid syntax
WHAT YOU CAN DO WITHTHE ECHO NEST REMIX API
MAKE WEB SITES
MAKE WEB SITES THAT CONFUSE PEOPLE
MAKE PRETTY PICTURES
MAKE PRETTY PICTURES
MAKE MUSIC
I’ve always wanted to hear Justin Timberlake trying to sing Billie Jean automatically by comparing timbre,
pitch and loudness distances.
-B.L.
MAKE MUSIC
Let’s go on residency in Amsterdam and get an adorably nervous Austrian accordionist to play like a bird!
-K.D. & B.W.
MAKE MUSIC
James Brown... FOREVER.
- T.J.
MAKE MOVIES
THE NEAR FUTURE OFTHE ECHO NEST REMIX API
STAGE ONE:ALL MUSIC, ALL THE TIME
>> from echonest import search>> segments = search.query(“voice”, soundsLike=”bjork”, pitch=”F#”)>> len(segments)65706>> new_song = random.shuffle(segments).write(“bjork2009.mp3”)
STAGE TWO:GET OFF THE COMPUTER
HAVE YOU SEEN THIS THING IT’S CRAZY
STAGE THREE:Let NORMAL PEOPLE use it
0%
25%
50%
75%
100%
nothing not much a little somewhat pretty good expert dork prime
Mus
ic g
oodn
ess
Computers know-how
brian
YES WE CAN
HELP US
do you wonder if sysex is turing
complete?are you one of those python “people” (you know what I’m saying)
did you ever write a music app in {R,
MATLAB, Excel, bash}?
would you like to put girl talk out of
business?
we catalog every orchestra hit 1980-1992. want the password?
http://code.google.com/p/echo-nest-remix
