V1.0 | 2017-08-01

Vector China Congress, 2017

Automated Diagnostic Validation 2007 – 2017 – 2020

2

Changes in Automated Diagnostic Validation

Automated Diagnostic Validation

2007

2017

2020?

3

What does it mean?

Automated Diagnostic Validation

Protocol

4

What does it mean?

Automated Diagnostic Validation

Protocol Application

5

What does it mean?

Automated Diagnostic Validation

Protocol Application

Download/Update

6

What does it mean?

Automated Diagnostic Validation

Protocol Application

Analysis

Tracking

Tracing

Download/Update

7

� Which (Diagnostic-) functions does the ECU support?

� How does the ECU behave or react on requests?

Standards

� Formal Diagnostic Descriptions: > ODX (than later as ISO-22901)

> Or „de facto“ industry standard CANdelaStudio

� Standard Diagnostics: especially ISO14229 „Unified Diagnostic Services“

How does it work?

Automated Diagnostic Validation

2007

8

How does it work?

Automated Diagnostic Validation

2007

9

Protocol, Protocol, Protocol,…

Automated Diagnostic Validation

200710 years ago….

� Many Diagnostic-Newbies: OEMs, Developer,…

� Incomplete Diagnostic Data

� Insufficient depth of tests, no automation,

high testing effort

� Small format bug caused hard-> ECU issues (crash!)

… today

� Many OEMs have their own diagnostic test specification> Often available as automated tests

> Continuous improvements

� In general: Protocol conformance quality is good.

10

� Generation of diagnostic embedded code out of diagnostic descriptions

� Checking of diagnostic request format (DCM)

� Restrictions on execution: Session / Security (DCM)

� Creation of response in correct format (DCM)

� Fault memory configuration (DEM)

� …

Do we really need protocol conformance tests?

…‘cos mistakes always happen (murphy's law)… �

� … in AUTOSAR configurations

� … on implementing diagnostic functions

� … on connecting the diagnostic implementation with the ECU’s application

� … if diagnostics in ECU does not match the diagnostic description

� …

AUTOSAR

Automated Diagnostic Validation

2009

Yes!

11

� Content check if diagnostic parameters and fault memory related data

Is it possible to automate application tests?

� Additional sources for diagnostic related information> XCP, Bus signals, Measurement- and Simulation-Hardware,…

� Automatic or manual linking to Sources without direct diagnostic relation> E.g. on identifying the names (DTC “ECU X is offline” – ECU X exists in arxml)

� One specific Test is the result for the diagnostic specification and

the “I/O”-Type> DTC/Failure Type Byte -> “Short Cut” -> Tests for short cut to ground

> Diagnose Service combination -> Read/Write -> Memory

> Rx: A signal on the bus modifies the reading of a diagnostic Parameter

> Tx: Writing a diagnostic parameter modifies the bus signal

> …

� Claas increased the test coverage from 55% to 95%.

Yes!*

Application

Automated Diagnostic Validation

2010dbc

arxml

a2l

HiL,

...

VirtualTarget

* … but unfortunately not as smooth as for protocol conformance tests

12

Application

Automated Diagnostic Validation

2014

CANoe ILECU

System under Test

txMsgTemp

Temp.Sensor

Read (19,22)

IO Control

(2F)

control

measure

control

check

CANoe.DiVa

Test Hardware

13

� ISO standard defines diagnostic services used for SW download, but … > Differences in data formats and processes

> Supported feature set: incremental update, signatures, encryption, …

> OEM-specific reprogramming Tools

How to handle such a diversity in a Test?

� Vector vFlash > Reprogramming support for more than 100 different bootloader implementations

> Start download and trigger errors from external

Tests

� Generically: black box tests like e.g.:> Download without Erase Memory

> Overvoltage/ Undervoltage while transferring data

> …

� OEM-specific: gray box Tests> Test of specific Features: e.g. Identification data

Software Download using Diagnostics

Automated Diagnostic Validation

2015

14

Analysis, Tracking, Tracing …

Automated Diagnostic Validation

2017

Test

Report

Link Requirement &TestCase

CANoe.DiVa

CANoe

Test Run

Import

Test

Generation

Test Results

Test Case

Requirement/

Test Data

Management

System

Requirements

15

Where are we now?

Automated Diagnostic Validation

ProtokollApplikation

Weiterverarbeitung und

NachverfolgungDownload/

Update

2017

Protocol Application

Analysis

Tracing

Tracking

Download/Update

16

� Chances…

> Maintenance from a distance

> Selling of additional service

> (… a lot more)

� … and risks

> Crime

> YouTube…

� Requirements to diagnostic quality still increases

> Diagnostic functions

> Reliability of Software Update

> Security

Connectivity and DoIP

Automated Diagnostic Validation

2017

17

Security & Validation

Automated Diagnostic Validation

2017

18

Security – A threat Analysis on the OTA Process

Automated Diagnostic Validation

2017C

C

BackendDiag Gateway

� Assets

� Flash data along the communication path:

> Over-the-air communication between backend and vehicle

> Storage devices

> In-vehicle communication

� Impacts:> Financial loss

> Consumer confidence

> System malfunction

> Safety functions

InternetSW

Gateway

Body

Chassis

ADASInfotainment

Flash Bootloader

� Threats:> Compromising keys

> Data access or manipulation

> Man-in-the-middle

> Denial of services

� Security keys

Vehicle

Access Point

19

Security & Validation

Automated Diagnostic Validation

2017Vector OEM Security Source

Security Manager OEM 1- Sign- Authenticate

OEM 2- Encrypt

ASR SecOC/(UDS Default)

Backend

GUI- administration of Security Sources - Configuration of Security Sources:

- access to backend- Platform…

RT Component- Crypto Bib- Sign/Verify- Encrypt/Decrypt- Authenticate,…

Filebased

Cloud

Vector Tool

20

� OEMs will (have to !) increase their requirements for diagnostic test and quality.

� There will be more and more release cycles:> Continuous Integration

> Automation of test processes

� Application related tests beyond of what is currently available.

� Tracking and tracing of requirements for automated tests

� Executing security related tests, Testing security itself

� Simulation and Testing: Aspects of functions rather than ECUs

2020++

� New topics… > Autonomous driving

> AUTOSAR Adaptive

> Computer as part of the vehicle

� … new diagnostics? > Formats?

> Protocols?

> 4.0?

What else?

Automated Diagnostic Validation

2020

21

Automated validation of diagnostics …

Summary

Automated Diagnostic Validation

… remains exciting ...

… works

… is no witchcraft

… is no longer related to just protocol tests

… is for sure not completed

… is faced to new challenges

22

Q & A

Automated Diagnostic Validation

Your questions are welcome !

23 © 2017. Vector Automotive Technology (Shanghai) Co., Ltd.. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2017-08-01

For more information about Vectorand our products please visit

www.vector.com

Author:

Henry Ge

Vector China