Building the cloud, one house at a time

Boris Mattijssen

+316 57889845

b.mattijssen@nerdalize.com

Follow Nerdalize

Outline

● Who is Nerdalize?

● How to benefit from the cloud

● Hands-on: Using Docker and Nerdalize

A short introduction of Nerdalize

https://drive.google.com/file/d/0B3jFM9iPYZpDRGZHMHBOWHhUZ1U/view

Cloud is the steam engine of the 21st century

Cloud is the steam engine of the 21st century

The Nerdalize benefits

The World

saves on energy

3t CO2/yr per household

Home Owner

saves on heating

€300/yr

Cloud User

reduces cloud costs

30% - 50%

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at great price / performance;

3. without vendor lock-in;

4. and being easy to use.

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

50 CloudBoxes

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

Delft3D 1000 vCPU

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

How can the cloud benefit you?

1. Providing you with much compute capacity;

2. at a good price / performance;

3. without being locked in;

4. and being easy to use

> nerd upload dataset ~/my-dataset

> nerd workload start quay.io/nerdalize/delft3d --input-dataset 308c7bf29

> nerd task create 07bb2204534256f48a66

> nerd dataset download 81b8365bd1a6b3d36e7b ~/simulation-output

Workshop

Interactive workshop

1. Getting to know each other

2. Setup

3. Running Delft3D in Docker

4. Running Delft3D (in Docker) on Nerdalize

Getting to know each other

● Who is running Windows / macOS / linux?

● Who works with Delft3D?

● Who has ever worked with Docker?

Setup

1. Install Docker

2. Download Delft3D example dataset

Running Delft3D in Docker

What is Docker?

“Docker containers wrap up a piece of software in

a complete filesystem that contains everything it

needs to run: code, runtime, system tools, system

libraries – anything you can install on a server. This

guarantees that it will always run the same,

regardless of the environment it is running in.”

What is Docker?

File

System Runtime

System

Tools

System

Libs

What is Docker?

What is Docker?

Why use Docker?

1. Deterministic software configuration

2. Portable (Across computers and to the Cloud)

3. Easy to share and collaborate on

4. Quick to start and extend

Simple as that

docker run \

-v ~/my-dataset:/input \

-v ~/simulation-output:/output \

quay.io/nerdalize/delft3d

Running Delft3D on Nerdalize

Running Delft3D on Nerdalize

1. Upload your input dataset

2. Run the Docker container on Nerdalize

○ Scale up to 8 vCPU for demo

○ Could scale up to hundreds of vCPUs in real-world cases

3. Download your output dataset

Running Delft3D on Nerdalize

nerdalize.com/beta

promo code dsd17

What did we do?

Workload - Image

- Dataset

Worker Task

(Delft3D)

Input

Dataset

Output

Dataset

Upload

Start

Workload

Create Execute Upload

Create

Task

View logs Download

Results

Worker

Worker

Evaluation

Building the cloud, one house at a time

Boris Mattijssen

+316 57889845

b.mattijssen@nerdalize.com

Follow Nerdalize

nerdalize.com/dsd17

Docker pointers (also see speaker notes)

1. Nerdalize documentation: www.nerdalize.com/docs

2. Nerdalize Delft3D application page: www.nerdalize.com/applications/delft3d

3. Docker short intro video (12 min): https://www.youtube.com/watch?v=YFl2mCHdv24

4. Docker long intro (45 min): https://www.youtube.com/watch?v=Vyp5_F42NGs&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX

a. Also his video on Dockerfiles is intersting (45 min):

https://www.youtube.com/watch?v=6Er8MAvTWlI&index=4&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX

5. Short videos about a lot of Docker concepts:

https://www.youtube.com/watch?v=kWkIMMYn6d4&index=1&list=PL7hgvWUGJtUtm-ZudXLKrqAnhkiRi0TtH

6. Docker official documentation (has some nice examples): docs.docker.com