Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World...

31
Confidential Dr. Roman Katz Program Manager Reference Systems Ibeo Automotive Systems GmbH Automated Scenario Generation for Testing ADAS Based on Post-processed Laserscanner Data IPG Apply and Innovate 2016 September 2016, Karlsruhe

Transcript of Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World...

Page 1: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Dr. Roman Katz

Program Manager Reference Systems

Ibeo Automotive Systems GmbH

Automated Scenario Generation for Testing ADAS Based on Post-processed Laserscanner Data

IPG Apply and Innovate 2016

September 2016, Karlsruhe

Page 2: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Ibeo’s Vision

Our contribution to the society is to save of a huge amount oflives by equipping every car in this world with laserscannersand reliable safety applications.

Page 3: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Timeline

Foundation of Ibeo Company

1998

SICK AG becomes parent company

2000

Start of Production (SOP)

ScaLa

2017

Cooperation Contract with Valeo

2010

Federal President Award: “Smart Eyes for Vehicles –Country of Innovations”

2009

SAE Tech-Award: “The most Innovative Product

of the Year”

2006

Frost & Sullivan Award: “European Automotive

Safety Systems Entrepreneurial Company

Award”

2008

Team LUX @ DARPA Urban Challenge

2007

Management Buy Out: Ibeo becomes

independent from SICK

ZF buys 40% Stake in Ibeo

2016

Page 4: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

AUDI used 2 Scala Laserscanners (Ibeo)

CES 2015: 900 km Autonomous Drive by Audi

Page 5: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

CES 2015: Autonomous Parking by BMW

BMW used 4 ibeo LUX Laserscanners

Page 6: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Ibeo 6-Sensor Fusion Systems used by 9 OEMs for their Autonomous Driving Research

Nissan 09/2013HONDA 09/2014

OPEL 09/2014 BMW 02/2013

GM 02/2013

(*) dates relates to month/year the OEM publication of their research using Ibeo sensors.

In addition 4 more OEMs use Ibeo‘s 6-sensor-fusion system for autonomous driving (not published yet).

Page 7: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Current Programs at Ibeo

Reference Systems HADMapping and

Localization

Page 8: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Agenda

• Intro to ADAS testing and Ibeo‘s solutions

• Reference data and virtual scenario generation

• Conclusions

Page 9: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

ADAS TESTING AND IBEO‘S SOLUTION

Page 10: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Challenges for Testing ADAS/HAD

Complex traffic scenarios

Perception road users and contextHuge amounts of data

Highly accurate ground-truth

Various sensors technologies

Combined functionalities

Page 11: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Ibeo‘s Solutions for Testing ADAS

• Object perception

• Road perception

• Ego-positioning

Reference data

• Objects to ego-lane association (OELA)

• Rear monitoring BSD/LCA

• Event & scenario detection

Reference applications

• Virtual scenarios from real data

• DuT Tools

• Automation, scripting & big data

Automation & tooling

Page 12: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

REFERENCE DATA AND VIRTUAL SCENARIO GENERATION

Page 13: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Ibeo‘s Solutions for Testing ADAS

• Object perception

• Road perception

• Ego-positioning

Reference data

• Objects to ego-lane association (OELA)

• Rear monitoring BSD/LCA

• Event & scenario detection

Reference applications

• Virtual scenario generation

• DuT Tools

• Automation, scripting & big data

Automation & tooling

Page 14: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Ibeo‘s Solutions for Testing ADAS

• Object perception

• Road perception

• Ego-positioning

Reference data

• Objects to ego-lane association (OELA)

• Rear monitoring BSD/LCA

• Event & scenario detection

Reference applications

• Virtual scenario generation

• DuT Tools

• Automation, scripting & big data

Automation & tooling

Page 15: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Reference Data

Object

PerceptionRoad Perception

• Object perception

• Road perception

• Ego-positioning

Reference data

Page 16: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Object Perception

Online

Tracking

Reference Object Generation

Page 17: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Object Perception

Online tracking Reference object generation

Page 18: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Road Perception

Lane marking map with ref. objects

Page 19: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Road Perception

Level 0

Level 1

Level 2

Level 3

Road perception

Classified

point cloud

Object description

Semantic

information

Page 20: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Road Perception (Level 1)

Page 21: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Road Perception (Levels 2-3)

Page 22: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Automation and Tooling

Joint work with IPG Automotive GmbH

• Virtual scenario generation

• DuT Tools

• Automation, scripting & big data

Automation & tooling

Post ProcessingReal World Scenario Simulation

Page 23: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Reference Data From Real World Scenarios

Post ProcessingReal World Scenario

Page 24: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Reference Data From Real World Scenarios

Page 25: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Virtual Scenario from Reference Data

Post Processing Simulation

Page 26: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Virtual Scenario from Reference Data

Page 27: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Virtual Scenarios from Real World Data

Page 28: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

CONCLUSIONS

Page 29: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Conclusions: Ibeo‘s Solutions for Testing ADAS

• Object perception

• Road perception

• Ego-positioning

Reference data

• Objects to ego-lane association (OELA)

• Rear monitoring BSD/LCA

• Event & scenario detection

Reference applications

• Virtual scenario generation

• DuT Tools

• Automation, scripting & big data

Automation & tooling

Page 30: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Conclusions: Virtual Scenarios from Real World Data

Post ProcessingReal World Scenario Simulation

Page 31: Automated Scenario Generation for Testing ADAS Based on Post … · Automation & tooling Real World Scenario Post Processing Simulation. l Reference Data From Real World Scenarios

Co

nfid

en

tia

l

Dr. Roman Katz

Program Manager Reference Systems

Ibeo Automotive Systems GmbH

email: [email protected]

www.ibeo-as.com

Thanks!