Simulate and validate your DNN inference with...
Transcript of Simulate and validate your DNN inference with...
![Page 1: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/1.jpg)
3DS
.CO
M©
Das
saul
tSys
tèm
es| C
onfid
entia
l Inf
orm
atio
n | 3
/20/
2018
| ref
.: 3D
S_D
ocum
ent_
2015
Simulate and validate yourDNN inference with CATIA
before ADAS industrialdeployment
« AI in the Loop »
Simon BerardCATIA Strategic Planning Senior Analyst
![Page 2: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/2.jpg)
Agenda
1
2
3
WHY does Autonomous Driving Experience matter ?
WHAT are the mandatory capabilities ?
HOW does it work ?
![Page 3: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/3.jpg)
WHAT IS AN AUTONOMOUS DRIVING EXPERIENCE FOR ?
PR
OG
RA
M A
DV
AN
CEM
ENT
PROBLEM DEFINITION
NETWORK STRUCTURE
CONVERGENCE
RE-TRAINING
?
Number of known issues
to find and fix
the root cause
Difficulty
WH
YW
HA
TH
OW
Field test issues
![Page 4: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/4.jpg)
HOW DOES AN AUTONOMOUS DRIVING EXPERIENCE MAKE THE DIFFERENCE ?
DANGEROUS
SITUATIONS
BEHAVIOR
WH
YW
HA
TH
OW
SOFTWARE
![Page 5: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/5.jpg)
WHY DOES DASSAULT SYSTEMES DEVELOP AN AUTONOMOUS DRIVING EXPERIENCE ?
TOWARDS
COGNITIVE AUGMENTED DESIGN
WH
YW
HA
TH
OW
![Page 6: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/6.jpg)
WHY DOES DASSAULT SYSTEMES DEVELOP AN AUTONOMOUS DRIVING EXPERIENCE ?
AUTOMATION & SELF OPTIMIZING DESIGN
Multidiscipline, Multiscale, MultiphysicsGenerative Design W
HY
WH
AT
HO
W
[MOD|SIM]
![Page 7: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/7.jpg)
WHAT TO EXPERIENCE ? AV FUNCTIONAL ARCHITECTURE COVERAGE
THINK ACTSENSE
WH
YW
HA
TH
OW
![Page 8: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/8.jpg)
WHAT TO EXPERIENCE ? AV FUNCTIONAL ARCHITECTURE COVERAGE
PERFORMANCES ACCURACY
THINK ACTSENSE
BRAKES DAMPERS
WH
YW
HA
TH
OW
![Page 9: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/9.jpg)
WHAT TO EXPERIENCE ? PARAMETERS SPACE EXPLORATION
WH
YW
HA
TH
OW
![Page 10: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/10.jpg)
CERTIFICATION
WHEN DOES AN AUTONOMOUS DRIVING EXPERIENCE APPLY ?
VALIDATION
OWNERSHIP
MANUFACTURING
UPSTREAM
DETAILED
CONCEPTUAL
WH
YW
HA
TH
OW
![Page 11: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/11.jpg)
WHAT ARE THE TRAPS ALONG THE WAY ?
CONTROL THE BIAS AT ALL STAGES
SYNCHRONIZATION BARRIERS EXTERNAL COMPUTATIONS CROSSED-CAUSAL DEPENDENCIES
WH
YW
HA
TH
OW
![Page 12: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/12.jpg)
WHAT IS HAPPENING INSIDE THE CAR ?
INTEGRATE, CO-EXECUTE AND VALIDATE VIRTUAL HETEROGENEOUS MODELS, VIA A REAL-TIME AND INTERACTIVE PLATFORM.
SENSORS
VEHICLE DYNAMICS
TIRES
DAMPERS
CONTROL
STEERING
WH
YW
HA
TH
OW
![Page 13: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/13.jpg)
WHAT IS HAPPENING OUTSIDE OF THE CAR ?
STAGING OF INTERACTIVE EXPERIENCES BY COMPOSING PRODUCT, NATURE & LIFE
CAD ASSETS
BUILT-IN BEHAVIORS
REUSE PRODUCT BEHAVIORS
ANIMATE IN CONTEXT OF EXPERIENCE
REALTIME PHYSICS
WRITE EXPERIENCE SCENARIOUSING NATURAL LANGUAGE
WH
YW
HA
TH
OW
![Page 14: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/14.jpg)
HOW TO INTEGRATE A PROJECT IN THE EXPERIENCE ?
1 2 3 4
7 6 5
Nvidia publicationEnd to End Learning for Self-Driving Cars [arXiv:1604.07316v1 [cs.CV] 25 Apr 2016]2016 Sully Chen Implementationhttps://github.com/SullyChen/Autopilot-TensorFlow
Nvidia ADAS Network
DEEP LEARNING COMPONENT TO VALIDATE
EXPORT TO PRODUCTION LEVEL FMU CONVERSION PHYSICAL SYSTEM DESIGN
CO-SIMULATION EXPERIENCE SCENARIZATIONRESULTS ANALYSIS
Mechatronics SystemFreeze the Network
WH
YW
HA
TH
OW
![Page 15: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/15.jpg)
HOW DOES IT WORK ?
SENSE THINK ACT
WH
YW
HA
TH
OW
![Page 16: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/16.jpg)
AI IN THE LOOP
WH
YW
HA
TH
OW
![Page 17: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/17.jpg)
NEXT STEPS
Generative Tests
Generative AI convergence
Real-time for Hardware in the Loop
Real-time Environment interaction
WH
YW
HA
TH
OW
![Page 18: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/18.jpg)
EXPERIENCE BENEFITS
1
2
3
Possibility to explore variants of scenarios and configurations
4
Explore, experiment and see
Play the experience guaranteeing physical accuracy
Combine Knowledge and Know How
![Page 19: Simulate and validate your DNN inference with CATIAon-demand.gputechconf.com/gtc/2018/presentation/s... · CATIA Strategic Planning Senior Analyst. Agenda 1 2 3 WHY does Autonomous](https://reader034.fdocuments.in/reader034/viewer/2022042116/5e93d566fe215a6bb717949e/html5/thumbnails/19.jpg)
19
3D
S.C
OM
© D
ass
au
ltSy
stèm
es
| C
on
fid
en
tial
Info
rmati
on
| 3
/20
/20
18