Lawrence Du Seattle Final

23
Deep Convolutional Generative Adversarial Networks (DCGANs) for Creating Pixel Art Lawrence Du

Transcript of Lawrence Du Seattle Final

Deep Convolutional Generative Adversarial Networks (DCGANs) for Creating Pixel Art

Lawrence Du

Creating art for mobile apps takes skill and money

Problem: The Costs of Making Art for Indie/Mobile GamesTotal cost of adding one new character: $109,000Artwork cost: $30,000

Problem: The Costs of Making Art for Indie/Mobile GamesTotal cost of adding one new character: $109,000Artwork cost: $30,000

Deep Learning for AI assisted art generation

Fake pictures of bedrooms created by deep neural network

One franchise built around pixel art...

Pokémon Red (released 1998)

Using Pokémon as a training set

● 64 x 64 x 3 pixels = 12,228 features per image ● 700+ Unique Pokémon ● 76,000+ animation frames

Feature engineering with images

● database used for eliminating shape outliers

● 231 Pokémon selected (19,231 frames)

● Expansion of training set size:

○ Brightness○ Hue○ Contrast○ Left-right transformations.

Feature engineering with images

● database used for eliminating outliers

● 231 Pokémon selected (19,231 frames)

● Expansion of training set size:

○ Brightness○ Hue○ Contrast○ Left-right transformations.

Feature engineering with images

● database used for eliminating outliers

● 231 Pokémon selected (19,231 frames)

● Expansion of training set size:

○ Brightness○ Hue○ Contrast○ Left-right transformations.

DEMO

www.DeepPixelMonster.com(TRY IT YOURSELF)

Alternate link: http://76.176.145.160:5000/

Implementation

● Written using

● 30+ neural architecture combinations tested.

● Training takes 20-30 minutes on GPU

● Front-end Python

● Amazon AWS

Implementation

DISCRIMINATOR

GENERATOR

Implementation

GENERATOR

Network Balancing

DISCRIMINATORLOSS

GENERATORLOSS

● LINE messenger - $238 million on stickers in 2015● Easier to send a sticker than to write Chinese characters (kanji)

Additional use cases for AI pixel art

Lawrence [email protected]

PhD Biological Sciences (UC San Diego)

Solution: Use Deep Learning for AI assisted art generation

Intelligent infill

AI generated music album covers