The Role of AI and Machine Learning in Creativity

Douglas Eck@douglas_eck

Research Scientist �Google Brain Team �

ConvNets

Translation

https://research.googleblog.com/2016/09/a-neural-network-for-machine.html

Perfect translation

HumanNeural (GNMT)

Phrase-based (PBMT)

English>

Spanish

English>

French

English>

Chinese

Spanish>

English

French>

Spanish

Chinese>

Spanish

Translation model

Tran

slat

ion

qual

ity

old: PBMT

new: GNMT

BACKTRANSLATION FROM JAPANESE

Kilimanjaro is a mountain of 19,710 feet covered with snow, which is said to be the highest mountain in Africa. The summit of the west is called “Ngaje Ngai” God ‘s house in Masai language. There is a dried and frozen carcass of a leopard near the summit of the west. No one can explain what the leopard was seeking at that altitude.

Kilimanjaro is 19,710 feet of the mountain covered with snow, and it is said that the highest mountain in Africa. Top of the west, “Ngaje Ngai” in the Maasai language, has been referred to as the house of God. The top close to the west, there is a dry, frozen carcass of a leopard. Whether the leopard had what the demand at that altitude, there is no that nobody explained.

Google Neural Machine Translation (new system):

Phrase-Based Machine Translation (old system):

12% of all responses sent on mobile are sent with ML-based suggestions

Google Inbox

QuickDraw Dataset

Thanks to Jonas Jongejan and friends at Google Creative Lab.

Learning to Draw

Lower temperature

Higher temperature

Human Input Human InputReconstruction Reconstruction

Demo

A

ht

Xt ht

Note on

Note off

Note Velocity

Advance clock

A

ht

Xt ht

Note on

Note off

Note Velocity

Advance clock

Chopin Etude in E Major (Opus 10 No 3)

Neural Network Performances

Chopin Etude in E Major (Opus 10 No 3)

Neural Network Performances

Chopin Etude in E Major (Opus 10 No 3)

Neural Network Performances

Chopin Etude in E Major (Opus 10 No 3)

Neural Network Performances

Chopin Etude in E Major (Opus 10 No 3)

Neural Network Performances

RNN Decoder

A

ht

Xt

Encoder Z Decoder

Decoder

Encoder

Z

Measure and Phrase Decoders

Photo: Magenta team member Jesse Engel

g.co/magenta

“Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit ... The distorted guitar sound is the sound of something too loud for the medium supposed to carry it….” �� -- Brian Eno, A Year With Swollen Appendices