Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only...
Transcript of Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only...
![Page 1: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/1.jpg)
TITLE
Autonomous Think Tank HAD Solutions for the Future
1 © 2018 ANSYS, Inc. June, 24 2019
Realize Your Product Promise®
Gilles GALLEEDirector, Autonomous Vehicle Simulation Solution
ANSYS
Take the lead on the autonomousrace with virtual validation
June 24, Museo Ferrari - Maranello
![Page 2: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/2.jpg)
Self-Driving Cars and Robo-Taxis
Drones and Urban Air Mobility
Autonomous Mobile Robots
The Autonomous Vehicle Revolution is Here
![Page 3: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/3.jpg)
Drastic reduction in fatalities
Global economic impact
Mobility for the immobile
Elimination of traffic jams
600,000 Lives Saved per Year
$7 TN in Global Economic Impact
40 Hours per Person per Year Saved from Traffic Jams
The Race is On To Deliver Disruptive Impact
![Page 4: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/4.jpg)
Five levels of autonomy
Reference: http://safety.trw.com/autonomous-cars-must-progress-through-these-6-levels-of-automation/0104/
![Page 5: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/5.jpg)
Exclusive research byANSYS and SAE
The SAE Automotive Industry Survey Confirmed:
“Public Confidence and Adoption” is the number 1 barrier to the widespread adoption of fully autonomous vehicles
Demonstrating Safety isthe Critical EngineeringChallenge
Demonstrating Safety is the Critical Challenge
![Page 6: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/6.jpg)
Critical challenges
Physical virtual simulation replaces traditional road and track tests that are too costly and take too long to complete
ANSYS is building the only comprehensive solutionfor simulating autonomous vehicle
With the objective to accurately test millions of scenarios
Safety of embedded software
Human factors and HMI in design process
![Page 7: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/7.jpg)
Critical challenges
Physical virtual simulation replaces traditional road and track tests that are too costly and take too long to complete
ANSYS is building the only comprehensive solutionfor simulating autonomous vehicle
With the objective to accurately test millions of scenarios
Safety of embedded software
Human factors and HMI in design process
![Page 8: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/8.jpg)
Autonomous driving technology stack
Image source: http://www.businessinsider.com/how-ubers-driverless-cars-work-2016-9
Central computer makes decisions with machine-learning and control algorithms.
Human Machine Interfaces exchange information with human occupants.
Sensor Fusion boards and software combine sensor signals.
Drive-By-Wire systems turn, accelerate, and brake the car based on control decisions.
![Page 9: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/9.jpg)
PerceptionLIDAR
PerceptionRADAR
PerceptionULTRASONIC
PerceptionCAMERA
CommunicationV2X
CommunicationGPS
Vehicle StateIMU, Etc
Autonomous driving technology stack HARDWARE & SOFTWARESENSING &
COMMUNICATIONFUSION ADAS/AD
FEATURES
Sensor Fusion
FUSION
Localization
HD MapsDATA SET
L1 – L3 Features
ADASFEATURES
Smart Headlights
Drive Monitoring
Etc...
L4 – L5 Features
ADFEATURES
Path Planning
Etc...
VEHICLE
ControlsACTUATORS
WORLD
Display
HMI
Audio Interaction
Haptic Feedback
* ADAS = Advanced Driver Assistance Systems
AD = Automated Driving / Autonomous Driving
Dozens of simulation use cases for developing hardware and software
![Page 10: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/10.jpg)
PerceptionCAMERA
Perception software uses Artificial Intelligence to identify objects
Artificial Intelligence (AI) Key Terms:• Neural Networks (NN)• Convoluted Neural
Networks (CNN)• Deep Learning
PerceptionLIDAR
PerceptionRADAR
Artificial Intelligence is mostly used in perception
![Page 11: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/11.jpg)
Physical Miles Driven Necessary for L2-L5 Validation
Akio Toyoda, President of Toyota @ Paris Auto Show“It is estimated that some 8.8 billion miles of road
testing, are required”
275 Million miles of fault free driving will be required to prove safety equivalent to a human driver
RAND – Driving to Safety Study275M fault free miles needed to
achieve equivalent safety to human driver
![Page 12: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/12.jpg)
Autonomous Vehicles
Physical road testing alone is not a solutionBillions of miles of road testing will be needed to validate the safety of an autonomous vehicle . . .
. . . i.e. 15,000 round trips to the moon
Autonomous Vehicles
-Rand Corporation
![Page 13: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/13.jpg)
Simulation is the Only Practical Solution: Waymo Case Study
Sacha ArnoudDirector of Engineering at Waymo (*):
✓Driverless Cars: 90% Done, 90% Left To Go
✓Industrialization requires 10x the effort
✓Real world driving is critical but what is more important is the ability to simulate.
(*) https://www.forbes.com/sites/chunkamui/2018/02/28/driverless-cars-90-percent-done-90-percent-left-to-go/#671202f820a0
![Page 14: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/14.jpg)
ANSYS AV Simulation Platform
Sensor Models, Radar, Camera, LiDAR, Ultrasound, Speed, GPS, V2X
Simulation Platform architecture development started in 2017
![Page 15: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/15.jpg)
ANSYS and BMW Group Partner to Jointly Create the Industry's First Simulation Tool Chain for Autonomous Driving
![Page 16: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/16.jpg)
Safety of AV Systems ➔ ISO 26262 + SOTIF
18
Perception
01
Motion Planning
02
Motion Execution
03
Functional Safety Analysis(FuSa)
Safety of the Intended Functionality (SOTIF)
Hazards due to limitations (sensors, AI...) Hazards induced by SW and HW system faillures
ANSYS solution enables to achieve the million miles of driving scenarios required to achieve the safety of ISO 26262
With a particular attention to the simulation of the sensors (SOTIF)
![Page 17: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/17.jpg)
Video / MIL
Running SOTIF Driving Scenarios in VRXPERIENCE
![Page 18: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/18.jpg)
Sensor simulation in scenario
22
![Page 19: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/19.jpg)
Why are edge cases a problem?
23
Perhaps your autonomy can detect 999 out of every 1,000 images with pedestrians that walk on two legs.
But what if it only detected 700 out of every 1,000 images with pedestrians that use wheelchairs?
P ( accident | wheelchair) should be the same as P ( accident | walker)
Mis
s R
ate
False Alarm Rate
![Page 20: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/20.jpg)
So we need to find all the edge cases!
The pedestrian in a wheelchair is an edge case, i.e. a condition that unknowingly poses safety risks.
Edge cases can be caused by…• Weather conditions (snow, rain, wildfire)• Lighting conditions (glare, night, high beams)• Infrastructure (fences, reflective surfaces, statues)• Types of road users (wheelchairs, people in costumes)• Incomplete training of machine learning systems!
Just because you handle one edge case safely doesn’t mean you’ll handle the next one safely, too!
![Page 21: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/21.jpg)
and identify the root causes of these edge cases
25
{ “sun glare”, “guardrail” } { “sun glare”, “fence”, “high-visibility vest” }
{ “sun glare”, “guardrail” }
Root causes (“triggering events” per SOTIF) can be hypothesized, validated, mitigated, and verified.
![Page 22: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/22.jpg)
Some Root causes can be surprising
26
“Children”
“Red objects”
“Sensor noise”
“Windshield wipers”“Columns”
“Camouflage”
“Sun glare”
“Bare legs”
These results are from open-source neural networks. Your mileage may vary.
![Page 23: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/23.jpg)
ANSYS SCADE Vision filters through huge data sets to identify real-world edge cases and safety risks
The CNN detects the bicyclist in baseline scene……but detection is weak in augmented scenes,
especially when bicyclist gets close.
![Page 24: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/24.jpg)
Sensor Models
Radar
Camera
LiDAR
ANSYS Sensor Models for Level 2 – Level 5
Physics based simulation is required for virtual validation
Physics based simulation is required for virtual validation
Gaming engines fail to virtually validate because of their lack of physics or measured materials
![Page 25: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/25.jpg)
Camera: Simulation from component design to full scenarios
Component Development
Optical, Thermal, Structural
Design & Analysis
Vehicle Integration
Vision Performance Analysis
Position Optimization
In-driving scenario
Vision System
Test & Validation
Camera
![Page 26: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/26.jpg)
Traditional Rendering Engine ANSYS’s Physically Accurate Simulation
Camera: Real world fault detection - solar glare
Sensors Fails No Sun Glare
Detected
Requires further physical testing on
road
Camera
![Page 27: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/27.jpg)
ANSYS’s physically accurate, real time driving scenario simulations mixing multi-physics sensors for SIL and HIL testing applications.
AUTONOMOUS VEHICLES
Camera & Radar simulations in driving scenarios
Radar
Radar + Camera simulation in driving scenario
![Page 28: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/28.jpg)
Critical challenges
Physical virtual simulation replaces traditional road and track tests that are too costly and take too long to complete
ANSYS is building the only comprehensive solutionfor simulating autonomous vehicle
With the objective to accurately test millions of scenarios
Safety of embedded software
Human factors and HMI in design process
![Page 29: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/29.jpg)
Interfaces In Automotive
Connected car leadsto more distraction
Levels 2 to 4 of autonomy make the transition to autonomy risky
Complexity of HMI
![Page 30: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/30.jpg)
36
Car’s HMI has to be intuitive and easy to use especially in critical situations
Interfaces in Automotive
![Page 31: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/31.jpg)
Human – Vehicle – Environment: « Closed Loop » in VR
Objectives:➢Zero physical prototypes➢Yet complete validation
Expected benefits:• Driver in the loop (safety, distraction,
mobility efficiency, user experience)• Capitalize user feedback and data• Better match customer’s expectations• Improve & Refine HMI design and
procedures• Explore new concepts faster
HUMAN
VEHICLEENVIRONMENT
![Page 32: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/32.jpg)
Simulation of Light and Human Vision
![Page 33: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/33.jpg)
AVTOL
Automatic Vertical Take-Off and Landing
![Page 34: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/34.jpg)
Airbus and ANSYS Partner to Enable Autonomous Flight to Support Future Combat Air System by 2030
![Page 35: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/35.jpg)
AutonomousTractor
Initial work
![Page 36: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/36.jpg)
Examples – off-road and agriculture use cases 1/2
Forward and rear vision camera – field scenario Headlamp – night drive scenario
![Page 37: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/37.jpg)
Examples – off-road and agriculture use cases 2/2
Front camera and LiDAR – digger scenario Front camera and LiDAR – tractor scenario
![Page 38: Take the Lead on the Autonomous Race with Virtual Validation · ANSYS is building the only comprehensive solution ... the car based on control decisions. Perception LIDAR Perception](https://reader034.fdocuments.in/reader034/viewer/2022042315/5f03b0337e708231d40a4884/html5/thumbnails/38.jpg)
Safely Transition To AV Thanks To Simulation
Physical virtual simulation replaces traditional road and track tests that are too costly and take too long to complete
ANSYS is building the only comprehensive solutionfor simulating autonomous vehicle
With the objective to accurately test millions of scenarios
Physical virtual simulation replaces traditional road and track tests that are too costly and take too long to complete
ANSYS is building the only comprehensive solutionfor simulating autonomous vehicles
Virtual simulation enables to take human factors into account all along the design process
Φ