Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1...
29
Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich www.scs.ch Vision trifft Realität. Will robots drive our cars soon? Driver assistant systems with FPGA und DSP Felix Eberli, Department Head, SCS
Transcript of Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1...
Supercomputing Systems AG Phone +41 43 456 16 00
Technopark 1 Fax +41 43 456 16 10
8005 Zürich www.scs.ch
Vision trifft Realität.
Will robots drive our
cars soon?
Driver assistant systems with FPGA und DSP
Felix Eberli, Department Head, SCS
2 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Futuristic ideas already 1956
3 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Driverless car in the 1980’s
4 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
DARPA Challenge – 11.9km after start (5%)
5 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
DARPA Urban Challenge 2007
6 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Mercedes Benz Versuchsfahrzeug 2013
S-500 “Bertha”
7 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Google car with laserscanner (2014)
8 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Tesla Auto Pilot (2015)
https://www.teslamotors.com/de_CH/blog/your-autopilot-has-arrived
9 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Will robots drive our cars soon?
10 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
But already in series as many driver assistant systems
• ADC (Distronic)
• Blind spot detection
• Break assist
• Pedestrian detection
• Park pilot
• Stop & Go Pilot
• Highway Pilot
• ….
• Lets see
13 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Sensor View – Radar and Stereo
16 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS company profile
• Founded 1993 and privately owned by Prof. Dr. Anton Gunzinger
• 90+ employees:
Electrical engineers
Software engineers
Physicists
Mathematicians
• Company offices at Technopark Zurich, Switzerland
17 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Services
Departments
• Embedded & Automotive
• Life Science / Medical
• High Performance Safety
• Embedded
• High Performance Computing
• SW / Public Transport
• SW / Broadcast
• Measure & Decide
Embedded & Automotive
• Feasibility studies
• Hardware (Specification, Design, Schematics, Layout, Production)
• Firmware/IP (FPGA, DSP)
• Software (Drivers, Host SW – Windows/Linux)
• Optimizations (ARM, DSP, EVE, Neon)
18 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Embedded & Automotive Department
19 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Why autonomous driving? - Traffic Must Become Safer
50% of all accidents with injured occur
in urban environments.
CH: 269 fatalities in 2014
0
5000
10000
15000
20000
0
100000
200000
300000
400000
500000
600000
1970 1980 1990 2000 2010
4002
391.000
Injured/ Year
Fatalities / Year
31 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
The Principle of Stereo Vision
Left Image Right Image Disparity Image
Challenge: on-line calibration to guarantee
perfect results for the whole lifetime of the car.
Color encoded distance:
close ….. far
H.Hirschmüller: "Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual
Information", DAGM 2005, CVPR 2005
32 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
The Principle of Stereo Vision
2008 world-wide first real-time
implementation of Semi-Global
Matching on an automotive compliant
FPGA
S.Gehrig, F.Eberli, T.Meyer, “A Real-time Low-Power Stereo Vision Engine Using Semi-Global
Matching”,
ICVS 2009 (Best Paper Award)
33 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Local Stereo vs. Daimler Global Stereo
Advantages of Daimler-Stereo Semi-Global Matching (SGM)
Significantly more 3D measurents
Significantly fewer Measurement errors in low-contrast regions
robust against periodic structures
SGM Correlation
Color encoded distance:
close ….. far
34 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Stereo Results in Real-Time
Baseline 25cm, 45° horizontal field of view
Color encoded distance:
close ….. far
44 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Sensors in Modern Cars
45 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Comparison Tesla – Daimler Sensors (2014)
66 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Is Stereo-Based Driver Assistance a Solved Problem?
If we want Vision to become an all-day all-night sensor for safety
critical systems, we should be able to work under those adverse
conditions!
90 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Current research focuses
on a deeper understanding of the scene
• https://www.cityscapes-dataset.com/examples/
91 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Outlook Self Driving Cars – Additional Links
• BMW kündigt selbstlenkende Fahrzeuge für 2021 an http://www.zdnet.de/88269245/bmw-kuendigt-selbstlenkende-fahrzeuge-fuer-2021-an/
• Sieben Firmen testen zurzeit selbstlenkende Autos auf Kaliforniens Straßen
• Mercedes Future Truck 2025
• Chris Urmson – Google Director Self-Driving-Cars https://youtu.be/Uj-rK8V-rik
92 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Baby you can drive my car…
Source: https://youtu.be/H0jJAPvN2uI?t=18
95 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Stereo Vision Evaluation Plattform
96 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Output of the SCS Stereo Vision Evaluation Plattform
More info: www.scs.ch/fpgabox
97 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Example measurement accuracy 3:
Distance measured = 10.549m +/- 0.022m (Baselength = 25cm)
Supercomputing Systems AG Phone +41 43 456 16 00
Technopark 1 Fax +41 43 456 16 10
8005 Zürich www.scs.ch
Vision meets reality.
Supercomputing Systems AG
[email protected] +41 43 456 16 19
