Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process...

19
FZI FORSCHUNGSZENTRUM INFORMATIK Vehicle-in-the-loop: Innovative Testing Method for Cognitive Vehicles Dr.-Ing. Thomas Schamm, M.Sc. Marc René Zofka, Dipl.-Inf. Tobias Bär Technical Cognitive Assistance Systems FZI Research Center for Information Technology

Transcript of Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process...

Page 1: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

FZI F

ORSC

HUNG

SZEN

TRUM

IN

FORM

ATIK

Vehicle-in-the-loop: Innovative Testing Method for Cognitive Vehicles Dr.-Ing. Thomas Schamm, M.Sc. Marc René Zofka, Dipl.-Inf. Tobias Bär Technical Cognitive Assistance Systems FZI Research Center for Information Technology

Page 2: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

About us §  Foundation of the state Baden-

Wuerttemberg §  Member of Innovationsallianz

Baden-Württemberg and Technologieregion Karlsruhe

§  Innovation hub in Baden-Wuerttemberg for information technology

§  Innovation partner of the Karlsruhe Institute of Technology

§  Medium-sized provider of research services

Figures and facts 2013 §  Overall budget: 14 M € §  Researchers: 135 §  More than 200 projects,

orders directly from the industry and publicly funded joint projects

§  Certified Quality Management System according to ISO 9001

2

The FZI

15.09.14 © FZI Research Center for Information Technology

Page 3: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

FZI’s formula for success: a strong network

15.09.14 3 © FZI Research Center for Information Technology

Page 4: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Targeted research: Our research fields

15.09.14 © FZI Research Center for Information Technology 4

Software Engineering

Information Process Engineering

Intelligent Systems and Production Engineering

Embedded Systems and Sensors Engineering

IT -

Cor

e Te

chno

logy

Application Fields

Mobility Automation Production Logistics

Knowledge Information

Society

Health Care

Energy Software

Big Data &

Intelligent Vehicles

IT – Quality & Security

Service robotics

eMobility

Embedded Systems Design Automation Trusted Cloud Computing

Energy Management

Logistics & Supply chain optimization Life Cycle Management

Smart Home Ambient Assisted Living

Multiplatform & Software Architectures

Automated Driving

Mobile Business Processes

Parallel Processing

Industry 4.0

Knowledge Management

Complex Event Processing

eLearning

Four research divisions at FZI cover the entire innovation cycle of applied research:

Page 5: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

… is a unique research environment in emergent markets §  FZI Living Lab smartAutomation §  FZI Living Lab smartEnergy §  FZI Living Lab smartHome/Ambient Assisted Living §  FZI Living Lab smartMobility §  FZI Living Lab Service Robotics §  FZI Living Lab Automotive §  FZI Living Lab mobileIT/mobileBusiness §  FZI Living Lab smartSecurity

The FZI House of Living Labs …

15.09.14 © FZI Research Center for Information Technology 5

Page 6: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

The FZI House of Living Labs …

… integrates all FZI Living Labs … offers a modern infrastructure for development, evaluation and

presentation of trend-setting technologies … provides research and development for all trades §  Interdisciplinary development of integrative ICT solutions with

partners from industry, science and society §  Novel research environment especially for SMEs

15.09.14 6 © FZI Research Center for Information Technology

Page 7: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Research Project: ReTivU

§  Real testing in virtual environment („Reales Testen in virtueller Umgebung“)

§  Common research Project between FZI and IPG

§  Founded by BMWi

§  Run-time: 03/2013 – 02/2015

§  Goals §  Developing and Testing of ADAS §  Testing ADAS with Driver as Unit-under-Test §  Integration platform for different complementary simulation tools

15.09.14 © FZI Forschungszentrum Informatik 7

Page 8: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU - Overview

Retivu

Traffic Simulation

Augmented Reality

Instrumented Test Vehicle

Vehicle Simulation

15.09.14 © FZI Forschungszentrum Informatik 8

Page 9: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU – Vehicle Simulation

15.09.14 © FZI Forschungszentrum Informatik 9

§  IPG CarMaker

§  Vehicle Simulation

§  Environment Simulation §  Static Elements §  Dynamic Elements

Page 10: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU – Virtual and Augmented Reality

15.09.14 © FZI Forschungszentrum Informatik 10

§  Task: Measure driver‘s head due to vehicle‘s influences in order to move virtual camera

§  Possible sensor techniques

§  Laser-based §  Expensive

§  Inertial sensors §  Accelerometer, §  Gyroscopes and §  Magnetometer

§  Optical sensors §  Illumination effects §  Shutter techniques

Page 11: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU – Virtual and Augmented Reality

15.09.14 © FZI Forschungszentrum Informatik 11

§  Task: Display virtual environment to test engineer

§  Possible techniques §  Virtual Reality §  Optical See-Through §  Video-See-Through

è Security Issues

Source: [Zofka2014]

Page 12: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU – Augmented Reality

15.09.14 © FZI Forschungszentrum Informatik 12

Page 13: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU – Augmented Reality

15.09.14 © FZI Forschungszentrum Informatik 13

Marker Setup

Tooling for -  Marker Calibration -  Marker Detection -  Head Pose Estimation

Page 14: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Semivirtual Simulation of Vision-based ADAS

§  Testing of Vision-based Vehicle Classification and Tracking §  Using simulations … §  On real test drives … §  Why not testing on mixed reality?

15.09.14 © FZI Forschungszentrum Informatik 14

Page 15: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Traffic flow simulation: SUMO

§  DLR Simulation of Urban Mobility §  Microscopic Traffic Simulation §  Realistic traffic scenarios

§  Road Networks §  Vehicle Following Behaviour §  Traffic Signal

§  APO-TCP Interface between CoCar, CarMaker and SUMO

§  Idea: Testing of ADAS capabilities in complex virtual traffic situations

15.09.14 © FZI Forschungszentrum Informatik 15

Karl-Wilhelm-Platz, Karlsruhe

Page 16: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Traffic flow simulation: SUMO

15.09.14 © FZI Forschungszentrum Informatik 16

Page 17: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

CoCar – Instrumented Test Vehicle

15.09.14 Ralf Kohlhaas 17

3D TOF-Kamera

GPS 3D TOF-Kamera

Laserscanner

Farbkamera

Inertialsensorik

Laserscanner

Laserscanner

Farbkamera

Stereokamera

Lenkung

Gas Bremse

Page 18: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

ReTivU - Goals

§  Adaption of the VIL methology [1] to highly autonomous vehicles

§  Integrative testing platform

§  Creation of an easy integratable product

§  Testing of §  Emergency Braking Assistant §  Parking Assistant §  Autonomus Drive

15.09.14 © FZI Forschungszentrum Informatik 18

Page 19: Vehicle-in-the-loop: Innovative Testing Method for ... · Software Engineering Information Process Engineering Intelligent Systems and Production Engineering ... FZI Living Lab smartHome/Ambient

Literature

[Bock2008] Thomas Bock: Vehicle-in-the-loop, Cuvillier-Verlag [Zofka2014] M. Zofka et. al: Semivirtual Simulations for Vision-based ADAS, IEEE Intelligent Vehicles Symposium 2014, Detroit, Michigan

15.09.14 © FZI Forschungszentrum Informatik 19