Iwsm2014 verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

26
Verifying the Accuracy of COSMIC Automation Tools: an AUTOSAR-based Example and a Case Study H. Soubra (ESTACA), A. Abran (ETS), A. Ramdane- Cherif(UVSQ) IWSM MENSURA, October 6-8 2014, Rotterdam

Transcript of Iwsm2014 verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

Page 1: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

Verifying the Accuracy of COSMIC Automation Tools: an AUTOSAR-based Example and a Case Study

H. Soubra (ESTACA), A. Abran (ETS), A. Ramdane-Cherif(UVSQ)

IWSM MENSURA, October 6-8 2014, Rotterdam

Page 2: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

2

Page 3: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

3

Page 4: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Context: FSM Automation

• Manual application of FSM is tedious and time-consuming• Especially for organizations with a large number of projects• Not to forget the ‘human’ error factor

4

Why FSM automation?

Page 5: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Context: FSM Automation

• The Accuracy of the FSM automation tool developed should be independently demonstrated… but

5

FSM automation Risk ?

How?!?

Page 6: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Context: FSM Automation

6

Accuracy verification of Automation tools ?

Page 7: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

7

Page 8: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

8

Page 9: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Automation accuracy verification protocol

9

Page 10: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

10

Page 11: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

11

Page 12: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

AUTomotive Open System Architecture 1

12

Standardizedconfiguration

processes

Standardizedconfiguration

processes

Standardized software

architecture

Standardized software

architecture

Standardized applicationinterfaces

Standardized applicationinterfaces

Cooperate on standards

Compete on implementation

Page 13: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

AUTomotive Open System Architecture 2

• System engineering approach with a layered architecture.

• Standardization and distribution of functions.

• Principle of Reuse and configuration.

• http://www.autosar.org/

13

Page 14: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

AUTomotive Open System Architecture 3

• Software is widely independant of Hardware.• Time and costs are reduced due to the simplification of

the development processes.• Quality and efficiency are enhanced because of software

reuse at OEM and suppliers.

14

Page 15: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

A Steer-by-Wire system with AUTOSAR 1

 The system provides two main functionalities: rack torque and feedback torque.

15

Page 16: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

A Steer-by-Wire system with AUTOSAR 2

16

Run_Sensor

TimingEvent5 ms Run_Command

TimingEvent

5ms

Run_InterECU_Wheel

DataReceivedEvent

SteerManager SWC

iSensorData_angle

iSensorData_torque

iInterECUWheel_angle

iInterECUWheel_torque

SteerSensor_data

InterECU_WM_to_SM

InterECU_SM_to_WM

FeedbackTorque

Run_Sensor

TimingEvent5 ms Run_Command

TimingEvent

5ms

Run_InterECU_Steer

DataReceivedEvent

WheelManager SWC

iSensorData_angle

iSensorData_torque

iInterECUSteer_angle

iInterECUSteer_torque

WheelSensor_data

InterECU_SM_to_WM

InterECU_WM_to_SM

RackTorque

(To FlexRay Bus)

Run_Acquisition

TimingEvent5 ms

SteerSensor SWC

Run_Acquisition

TimingEvent5 ms

WheelSensor SWC

(To FlexRay Bus)

(From FlexRay Bus)

(From FlexRay Bus)

Run_Actuator

DataReceivedEvent

SteerActuator SWC

Run_Actuator

DataReceivedEvent

WheelActuator SWC

Page 17: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Functional size of the steer-by-wire system: Measurement detail of the Steer Manager SWC

17

1E

1E

1E 1X

1X

1X

1X

1E

1E

1E

1E

1E

1X

1X

Run_Sensor 2E + 2X 4 CFPRun_Command 5E + 2X 7 CFPRun_InterECU_Wheel 1E + 2X 3 CFP

Page 18: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Functional size of the steer-by-wire system

18

AUTOSAR SWC

Runnable (COSMIC Functional Process)

Data group movements identified

Functional Process Size (in

CFP)

 SteerManager

Run_Sensor 2E + 2X 4Run_Command 5E + 2X 7Run_InterECU_Wheel 1E + 2X 3

SteerSensor Run_Acquisition 2E + 1X 3SteerActuator Run_Actuator 1E + 1X 2 Wheel Manager

Run_Sensor 2E + 2X 4Run_Command 5E + 2X 7Run_InterECU_Steer 1E + 2X 3

WheelSensor Run_Acquisition 2E + 1X 3WheelActuator Run_Actuator 1E + 1X 2

Total 38 CFP

Page 19: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Automation algorithm for AUTOSAR

19

Identify all Runnables of the application software being measured.

triggered by a Timing Event? identify 1E

Require Ports(RPort): identify 1E

Provide Ports (PPort): identify 1X

Read InterRunnableVariables : identify 1E

Write InterRunnableVariables : identify 1X

Aggregate the identified data group movements to obtain its functional size

Fo

r ea

ch R

un

nab

le

Aggregate the functional sizes of the Runnables identified to obtain the

functional size of the software being measured.

Page 20: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

20

Page 21: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

21

Page 22: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Case study 2: from the industry

1. Prototype tool: Renault/ETS/UVSQ2. 77 specifications in Simulink

22

Total Number of Models Total Size obtained manually (CFP)

Total Size obtained using the prototype tool (CFP)

Difference (%)

Accuracy

76 fault-free models 1,729 1,739 Less than 1% >99%

All 77 models 1,758 1,791 1.8% >98%

Page 23: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

23

Page 24: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Agenda

• FSM Automation

• A verification protocol for FSM automation accuracy

• Case study 1: AUTOSAR example

• Case study 2: example from the industry

• Conclusion

24

Page 25: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Conclusion

Is FSM automation helpful?

But be careful that your automation tool does what it’s supposed to do…or else…

25

Page 26: Iwsm2014   verifying the accuracy of automation tools for cosmic measurement (hassan soubra)

IWSM/MENSURA 2014 -October 6-8, Rotterdam©2014 Soubra, Abran, Ramdane-Cherif

Q & A

26

[email protected]