3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

S7583

3D interior design and realistic

rendering with Iray, Quadro

VCA and VR

Ankit PATEL– NVIDIA Senior product manager

Jonathan MERLET– 3DVIA rendering specialist

2

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

You want to refurnish your interior

…but how can you visualize the possibilities ?

3

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Realistic rendering in design process

Iray integration and architecture

What’s next

Plan

4

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Example in construction work

5

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Our goal

Give the user a nice view of his project

• Fast (a few minutes)

• Cheap (a handful of dollars)

6

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

The problems

• Users not rendering experts

• Lighting often sub optimal

• Arbitrary scenes

7

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

So…

• « Push button » interface

• Automatic adjustments (exposition)

• Biaised rendering with Iray Interactive

8

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Iterations

Max Quality

Photoreal

Interactive

99% Quality – 3470 it. – 3m46s 99% Quality – 65470 it – 4h30

Quality

Biased rendering

9

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

User renderings examples

10

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

11

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

12

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

13

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

14

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

15

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Some customer reactions

« It’s really interesting, it allows you to project yourself

when you buy a house »

« It’s nice, it nearly looks like real life pictures »

« It looks really great ! »

16

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

360 Stereo rendering

17

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

360 Stereo rendering

• One image for each eye

• Depth effect in VR headset/cardboard

• Visualisable in browser (krpano), Facebook

• More expensive and sligthly trickier

18

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

360 Stereo rendering

• Facebook 360 example

• Krpano example

19

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Realistic rendering in design process

Iray integration and architecture

What’s next

Plan

20

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

VIDEO

Home by me presentation

21

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Demonstration

22

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

A bird’s eye view of the architecture

Client

Cloud

Storage

Webservice

+ DB

Message

Queue

Load balancing

and conversion

worker

Rendering

cluster

1. Upload scene

2. Request3. Post

message

4. Pick

message

5. Get scene

6. Dispatch

8. Get image 7. Upload image

23

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Current state

• 200,000 renderings in 14 months

• 7 month and a half of compute time

• But load isn’t regular, and increasing…

24

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Rendering workers

Before

• Independent Amazon g2.8x instances which did conversion + rendering

Now

• VCA cluster + load balancing worker

• Amazon instances if too much load

• VCA 4x faster than Amazon instance

25

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

VCA presentation

26

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

HardwareRequired

● 8 x P6000 professional graphics boards

● 1 x Mellanox ConnectX-3 Infiniband FDR

Minimum

● 2 x Intel Xeon E5 CPUs (40 HT cores)

● 256 GB system memory

● 1TB of SSD storage (2x 512GB)

● 1 x 1 GigE network interface

● Power supply sufficient to accommodate components and

headroom for burst power needs

● System enclosure with mechanicals and thermal

management capable of accommodating components

without performance degrading

27

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Quadro VCA Software ● VCA Manager - cluster management software

○ for Interactive cluster rendering

○ for launching 3rd party apps

● Iray Queue Manager - Iray batch rendering

○ Same UI and features as Iray Server

● NVIDIA Rendering Software

○ Iray 2015.3 and newer

○ OptiX 4.0 or newer

○ Iray Cache manager

● Linux CentOS 7.2

● NVIDIA Quadro driver

1yr VCA software subscription license

28

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

WAN (10/100 Mbps)

Infiniband (56 Gbps)

Node (1)

Master

GPU

CPU

Node (2)

Slave 1

GPU

CPU

Node (3)

Slave 2

GPU

CPU

Node (n)

Slave n

GPU

CPU

Load balancing

and conversion

worker

Cloud

Storage

6. Dispatch

Client7. Upload image 8. Get image

29

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

VCA Certified Partner Program

Rigorous NVIDIA test SW

Select NVIDIA Tesla and Quadro GPUs

NVIDIA Partner Network

Enterprise support

30

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Global AvailabilityVCA Certified Partners

AMERICAS

EMEA

ASIA PACIFIC

GLOBAL

31

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Realistic rendering in design process

Iray integration and architecture

What’s next

Plan

32

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Image, 360, then…

33

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Light baking

• Render light maps in Iray, display in WebGL

• Realistic real time static scene (no modification possible)

• Visible in a VR headset

34

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Iray irradiance probes

Samples luminosity from an hemisphere

35

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Main steps

Unwrap the mesh to compute texture coordinates

36

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Main steps

From the texture coordinates, compute probes normals/positions

37

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Main steps

Render light map with Iray irradiance probes and save in RGBE

38

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Main steps

Render in WebGL with auto exposure and tonemapping

39

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Light baking

Demonstration

40

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

The challenges

• Unwrapping an arbitrary mesh is hard

• « Good » tonemapping is subjective

• Only for view independent lighting

• Less computation, more textures

41

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Noise reduction

42

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Noise reduction

• Low lighting => noise

• Solved by more iterations, but add cost

• Use Nvidia deep learning trained denoiser

• Trained on 1000 3DVIA scenes

43

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Low number of iterations

Time : 1’08’’

44

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

High number of iterations

Time : 6’

45

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Low number of iterations + denoiser

Denoising pass :

< 100ms

46

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

Next steps

• Improve light baking

• Continue partnership with Nvidia on denoiser

• Explore other applications (Inspirationnal, mdl in real time)

47

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015

http://home.by.me

Questions ?

48

3DS

.CO

M©

Das

saul

tSys

tèm

es| C

onfid

entia

l Inf

orm

atio

n | 5

/10/

2017

| ref

.: 3D

S_D

ocum

ent_

2015