Language models that stimulate creativity...Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth...

by Matthew Huebert

Language models thatstimulate creativity

BrainTripping

Building BrainTripping+ Lessons Learned

+ Observations

makin’ brains

Dr. SeussJustin BieberJesus ChristParis Hilton

Queen Elizabeth IIKurt Cobain

RihannaMother Teresa

Steve JobsBeethoven

Donald TrumpStephen Hawking

Lil WayneCharles Darwin

Helen KellerSarah Palin

Pope Benedict XVITupac Shakur

Albert EinsteinMaya AngelouJane GoodallMitt RomneyGeorge BushPaul Graham

Condoleeza RiceDr. Phil

Chairman MaoFriedrich Nietzsche

Bill GatesEdgar Allan PoeStephen ColbertL. Ron Hubbard

Jane AustenBarack ObamaSigmund Freud

ShakespeareKim Jong Il

0 10000 20000 30000 40000

Vocabulary sizeAuthors are listed in order of corpus length

35 000

100 000

200 000

500 000

1 000 000

Corpus Length




Steve JobsBeethoven











0 10000 20000 30000 40000

Musicians35 000

100 000

200 000

500 000

1 000 000

Corpus Length




Steve JobsBeethoven











0 10000 20000 30000 40000

Politicians35 000

100 000

200 000

500 000

1 000 000

Corpus Length

portraits

Scott McLeod

Copyright 2010 Creators Syndicate

Devoir-de-Philosophie.com

Scott McLeod

BBC Photo Library

Keith Kasnot / National Geographic Image Collection [left]The Unit of Art in Medicine/The University of Manchester [right]

suggestion algorithm

Zipf’s Law

Zipf’s Law

High Frequency“glue” words

Low Frequencyunexpected, random

Speed of Word Lookup

10 seconds

read;synthesize;

produce


10 seconds

read;synthesize;

produce


10 seconds 100 milliseconds

read;synthesize;

producereal-time

interaction


10 seconds 100 milliseconds

Shared Authorship

user algorithm source author

Anonymity

Real Identity

yellow_frog_1982

Matthew Huebert

Anonymity

Real Identity

Mask

yellow_frog_1982

Matthew Huebert

Matt tripping on Freud

intuition for data

In a cave in Kartoom lives a beast called the Natch


In a cave Kartoom lives beast called the Natchin a


In a cave

Kartoom lives

1 2

3

4

5

6

beast called the Natch8 9 10

7

In a cave Kartoom lives beast called the Natchin a

One fish, two fish, red fish, blue fish.


One fish two fish red fish blue fish1 2 3 4 5 6 7


One fish two fish red fish blue fish1 2 3 4 5 6 7

One

fishtwo

red

blue

1

2

3

4 5

6 7

Implementation

speed (developer, response time)simplicity

Heroku (managed servers, simple to scale)Node.js (same language on client and server)In-memory language models

human process

Hacking BrainTrippingNode.js hackathon in Montréal

Hisako, Gina Cook, Brian Doherty, Mary Ellen Cathcart, Jon Volkmar, Martin Provencher, Jeff Marshall

Experiment Quickly

HACK

PITCH

PRESENT

Thanks!

BrainTripping.comMatthew Huebert

[email protected]@geoshift

http://www.BrainTripping.com

http://www.BrainTripping.com

mailto:[email protected]

mailto:[email protected]

Future

• Structured creative writing: “constrain and suggest”

• Foreign language “training wheels”

Language models that stimulate creativity...Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth...

Documents

Transcript of Language models that stimulate creativity...Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth...