A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6...

20
www.eng.it AutoSYS 2011 Quality Management for Automotive software-based systems and functionality Berlin (Germany), July 5-6 2011 Luigi Buglione Buglione Giuseppe Lami Lami Six reasons for adding the MAN.6 process A proposal for a new common process scope for Automotive SPICE

description

The presentation introduced the rationale by six reasons why adding the MAN.6 process in an ISO/IEC 15504 assessment could bring several advantages to an organization, whatever the application domain

Transcript of A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6...

Page 1: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

www.eng.it

AutoSYS 2011 Quality Management for Automotive

software-based systems and functionalityBerlin (Germany), July 5-6 2011

Luigi BuglioneBuglione

Giuseppe LamiLami

Six reasons for adding the MAN.6 process

A proposal for a new common process scope for Automotive

SPICE

Page 2: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

www.eng.it

Engineering At a glance

ERP ECMIT Security

Plant ManagementSystem

Broadband & MediaManaged Operations

System Int. & System Int. & ConsultancyConsultancy

OutsourcingOutsourcing

SoftwareSoftware

7070

1010

2020

8080

2020

5454

2727

1919

8080

1010

1010

FinanceFinance IndustryIndustry TELCOTELCO UtilitiesUtilities

%%

%%

%%

ResearchResearch and and DevelopmentDevelopment

3535

1919

4646

PA & HCPA & HC

_ The first Italian ICT player

_ more than 730 M/€ revenues_ 1000 clients_ 6,300 IT specialists

www.eng.it

Page 3: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

www.eng.it

ISTI-CNR At a glance

The Institute of Information Science and Technologies

“A. Faedo” - Pisa, Italy

People:250 Total• 103 Research staff• 60 Technical/Administrative

staff• 87 Research associates

(research fellows, PHD students, fellowships)

• ~110 Other (Research associates, visiting scientists, affiliates)

Research Areas @ ISTI:• Networking S&T• Domotics• Internet Services• Wireless Networks• Knowledge S&T• Human Interfaces in Information Systems• Knowledge Discovery and Delivery• Information Systems• Networked Multimedia Information Systems• Software S&T• Dependable Computing• Formal Methods and Tools• Software Engineering• System and Software Evaluation Center• Visual and High Performance Computing S&T• High Performance Computing• Signal & Images• Visual Computing• Flight and Structural Mechanics• Mechanics of Materials and Structures• Space Flight Dynamics

Page 4: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

4 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Goals of the presentation

G1. Show the pros & cons of current typical scopes in process appraisals for the Automotive sector G2. Propose the rationale by SIX (6) reasons for introducing the MAN.6 (Measurement) process G3. Discuss the impacts and possible advantages in the appraisal scope of an organization

Page 5: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

5 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Agenda

• Introduction– A bit of humour…– ISO/IEC 15504-based appraisal scopes

• The Six (6) reasons1. Measurement is not Project Management!2. Gathering Historical Data3. Optimize the Cost-of-Non-Quality (CONQ)4. Improved the Root-Cause Analysis (RCA) capability5. Goal-oriented Analysis for Process Improvement6. Improving Estimates

• Conclusions & Prospects• Q & A

Page 6: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

6 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Introduction A bit of humour…

Page 7: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

7 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Introduction A bit of humour…

UR

L: w

ww

.dilb

ert.c

om

Page 8: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

8 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Introduction ISO/IEC 15504-based appraisal scopes

Page 9: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

9 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Introduction ISO/IEC 15504-based appraisal scopes

• Are they the right Are they the right ‘‘process profilesprocess profiles’’ or not? And eventually why?or not? And eventually why?

Page 10: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

10 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Agenda

• Introduction– A bit of humour…– ISO/IEC 15504-based appraisal scopes

• The Six (6) reasons1. Measurement is not Project Management!2. Gathering Historical Data3. Optimize the Cost-of-Non-Quality (CONQ)4. Improved the Root-Cause Analysis (RCA) capability5. Goal-oriented Analysis for Process Improvement6. Improving Estimates

• Conclusions & Prospects• Q & A

Page 11: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

11 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 11. Measurement is not Project Mgmt!

• If considering also MAN.6…If considering also MAN.6… Not only time and cost measures (EAV approach), but few more (but focused) measures

in the project historical databases driven by your informative goals

Page 12: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

12 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 22. Gathering Historical Data

• If considering also MAN.6…If considering also MAN.6… Stressed more the need for historicize data in the Project Historical Database (PHD) More focused measures will help in reducing the ‘cone of uncertainty’ in estimates

Page 13: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

13 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 33. Optimize the Cost-of-Non-Quality (CONQ)

• If considering also MAN.6…If considering also MAN.6… CONQ reduction by a more focused measurement on core elements, also looking to their

cause-effect relationship (e.g. by a BSC-like approach) and more affordable estimates (e.g. Defect and Safety Mgmt from an ISO 26262 perspective)

Page 14: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

14 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 44. Improved Root-Cause Analysis capability

• If considering also MAN.6…If considering also MAN.6… Stimulated the refinement of a cause-effect analysis by measures goal-driven, as in a

BSC: needed input also for ISO/TS 16949:2009 §8.4 (Analysis of Data)

Page 15: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

15 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 55. Goal-oriented Analysis for Process Improv.

• If considering also MAN.6…If considering also MAN.6… Reinforce process assessment results in multiple PAs and GPs also for mid-term

achievements (e.g. PA 2.2 for more data stored in org PHD and PA 3.1 for better cause-effect analysis based on PHD data)

Page 16: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

16 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six Reasons 66. Improving Estimates

• If considering also MAN.6…If considering also MAN.6… more measures, possibly a higher level of granularity for some of them allowing a

multiple linear regression analysis with lower MREs moving from the same data

Source: Gencel C. & Buglione L., Do Different Functionality Types Affect the Relationship between Software Functional Size and Effort?, Proceedings of IWSM/MENSURA 2007, Palma de Mallorca (Spain), November 5-8 2007, pp. 235-246

)()()()()(_ 543210 EIFBILFBEQBEOBEIBBEffortNW +++++=

Use more independent variablesUse more independent variables• E.g. when using FSM methods, e.g. use combinations of 2+ BFC types

IFPUG BFC (EI, EO, EQ, ILF, EIF) COSMIC BFC (E, X, R, W)

• Results: increased R2 using the same dataset

PreconditionsPreconditions• Historicize project data at the proper level of granularity. E.g.

FSU at the BFC type level (by frequencies and – eventually – weigthed values) Effort at the SLC phase and/or by ReqType and/or… Defects by severity/priority class and/or resolution time by phase, and/or…

• Skill people – not only estimators – a bit more on Statistics• Use something more than averages!

Page 17: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

17 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Agenda

• Introduction– A bit of humour…– ISO/IEC 15504-based appraisal scopes

• The Six (6) reasons1. Measurement is not Project Management!2. Gathering Historical Data3. Optimize the Cost-of-Non-Quality (CONQ)4. Improved the Root-Cause Analysis (RCA) capability5. Goal-oriented Analysis for Process Improvement6. Improving Estimates

• Conclusions & Prospects• Q & A

Page 18: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

18 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Conclusions && Prospects

• Process Appraisals More process models contains a lot of processes trend to set up a ‘core’ set of basic

processes for appraisals Some proposals in the past, no one including measurement (ORG.5 MAN.6) Appraisals have of course a cost, but how much could it cost more to introduce MAN.6? And

eventually, which could be the ROI from such introduction looking at the possible benefits it could arise to projects?

• Measurement (MAN.6MAN.6) process From our viewpoint, looking at the cause-effect relationship of main process models (e.g. ISO

15504, CMMI, etc.), the measurement process is one of the core set of processes to be taken into account also in a short, quick, reduced-scoped appraisal

Six reasons were shown for introducing MAN.6 in (reduced) appraisal scopes, discussing its impact on appraisal results and corrective/improvement actions to take

Some conclusions... Time and Cost measures cover only two possible perspectives for managing a project from a

Project Management viewpoint, but not from a technical one MAN.6 is the only way to observe – no matter if from an internal or external perspective – the

way a project has been planned to be monitored and controlled during its lifetime We donWe don’’t need too much measures, but few, core ones: t need too much measures, but few, core ones: only applying MAN.6 it’ll be possible to

verify if a project is running the proper level of control for achieving its business goals As a consequence, the introduction of MAN.6 would not seen as an additional cost, but as an

opportunity for organization when appraising their processes

Analyze facts and talk through data(Kaoru Ishiwaka, TQM guru)

Page 19: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

19 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Q && A

vielen Dank für Ihre Aufmerksamkeitvielen Dank für Ihre Aufmerksamkeit!!Thanks for your attentionThanks for your attention!!

Page 20: A proposal for a new common process scope for AutomotiveSPICE: Six reasons for adding the MAN.6 process

20 AutoSys 2011 – Berlin (Germany) July 5, 2011– © 2011 L.Buglione, G.Lami

Six reasons Contacts

Luigi BuglioneETS/Engineering.IT

[email protected]

Giuseppe LamiISTI-CNR

[email protected]