Where We are and What’s Next in Hungarian Software Process Improvement ? Katalin Balla NJSZT...

Where We are Where We are and What’s Next and What’s Next

in Hungarian Software in Hungarian Software

Process Improvement ?Process Improvement ? Katalin BallaKatalin Balla

NJSZT Szoftvertechnológiai Fórum NJSZT Szoftvertechnológiai Fórum 09. October 09. October 2007. 2007.

Budapest Budapest

09.10.2007. Where We are and What's Next in Hungarian SPI? 2 / 29

ContentsContents

~ IntroductionIntroduction~ Pioneering in SPIPioneering in SPI~ About current projects connected to SPIAbout current projects connected to SPI

~ TST GVOP-3.3.1-2004-04-0079/3TST GVOP-3.3.1-2004-04-0079/3~ "Pázmány Péter Program" (RET-06/2005.) / "Pázmány Péter Program" (RET-06/2005.) /

NKTH NKTH ~ IKKK-GVOP-2004-3.2.2 IKKK-GVOP-2004-3.2.2

~ GoalsGoals~ The surveyThe survey~ Findings, results of the surveyFindings, results of the survey

~ Conclusion, further possibilitiesConclusion, further possibilities


IntroductionIntroduction

~ Hungarian software companies experience more Hungarian software companies experience more and more the requirement of producing and more the requirement of producing provablyprovably good - quality software, “certified software”, as a good - quality software, “certified software”, as a condition for staying in the market. condition for staying in the market.


IntroductionIntroduction

~ What to certifyWhat to certify~ Product, process, Product, process,

resources…resources…~ According to what According to what

standard / model?standard / model?~ ISO 9001, AQAP, CMMI, ISO 9001, AQAP, CMMI,

SPICE, ISO 9126…SPICE, ISO 9126…~ How to get extra results How to get extra results

from certification?from certification?~ Improve software qualityImprove software quality~ Develop processes that Develop processes that

increase software increase software development efficiencydevelopment efficiency

~ Do SPIDo SPI

ISO 9126(Boehm,

McCall)...

Process

Produc

t Resour

ce

Def

QA

Metric

Objects

Attributes

PM methodologiesPeople CMMWeinberg...

GQM

ISO 9001:2000

CMMSPICECMMI

ISO 15504TSP, PSP


ContentsContents


~ TST GVOP-3.3.1-2004-04-0079/3TST GVOP-3.3.1-2004-04-0079/3~ "Pázmány Péter Program" (RET-06/2005.) / NKTH "Pázmány Péter Program" (RET-06/2005.) / NKTH ~ IKKK-GVOP-2004-3.2.2 IKKK-GVOP-2004-3.2.2




Pioneering in SPIPioneering in SPI19931993

Hungarian membeship in Hungarian membeship in the the Bootstrap Institute Bootstrap Institute, , Bootstrap audits in Bootstrap audits in HungaryHungaryMiklós Bíró, Éva Feuer, Tibor Miklós Bíró, Éva Feuer, Tibor

RemzsőRemzső19961996

NJSZT NJSZT Software Quality Software Quality Management Division Management Division

19971997European Systems and European Systems and Software Initiative in Software Initiative in HungaryHungary

19991999Pioneering Process Pioneering Process Improvement Experiment Improvement Experiment in Hungaryin Hungary

20002000First official First official Introduction to Introduction to

the CMM® the CMM® training in training in Central&Eastern EuropeCentral&Eastern Europe

20012001CMMI Briefing CMMI Briefing in Budapestin Budapest

20042004Article: 10 years od SPI in Article: 10 years od SPI in Hungary Hungary (Bíró, Iványos, Balla, (Bíró, Iványos, Balla, Messnarz)Messnarz)

20052005EuroSPI International Confer EuroSPI International Confer in Budapestin Budapest

2005, 20062005, 2006CMMI-related events / CMMI-related events / presentation (free)presentation (free)

20072007HTE – product quality HTE – product quality

20072007Hungarian Society for QualityHungarian Society for Quality


ContentsContents






TST GVOP-3.3.1-2004-04-TST GVOP-3.3.1-2004-04-0079/30079/3

~ Development in Development in Hungary of world-class Hungary of world-class services connected to services connected to software quality software quality improvement and improvement and auditing auditing ~ Dec 2004-Dec 2006Dec 2004-Dec 2006~ SQI, TUE, TUBSQI, TUE, TUB


TST GVOP-3.3.1-2004-TST GVOP-3.3.1-2004-04-0079/304-0079/3


TST GVOP-3.3.1-2004-TST GVOP-3.3.1-2004-04-0079/304-0079/3

~ Developing Developing ~ QMIM – methodology QMIM – methodology

supporting synergic supporting synergic usage of more usage of more quality modelsquality models

~ Quality Organizer – a Quality Organizer – a support tool fro using support tool fro using multiple quality multiple quality approacheapproachess~ Contains 27 software Contains 27 software

quality-related quality-related standards / standards / approaches approaches


RET-06/2005RET-06/2005

~ TUB - ITUB - In cooperation with 9 big software companies, sponsored n cooperation with 9 big software companies, sponsored by National Office for Research and Technologyby National Office for Research and Technology (NKTH) (NKTH)~ 2005-20082005-2008~ BME Innovation and Knowledge Centre of Information BME Innovation and Knowledge Centre of Information

Technology – BME(IT)2Technology – BME(IT)2 ~ BME Információtechnológiai Innovációs és BME Információtechnológiai Innovációs és

TudásközpontTudásközpont~ http://it2.ik.bme.huhttp://it2.ik.bme.hu

~ R & DR & D~ Development methodology and frameworkDevelopment methodology and framework

~ Head of programe: Dr. Charaf HassanHead of programe: Dr. Charaf Hassan~ Distributed and embedded systemsDistributed and embedded systems

~ Head of Programe: Dr. Béla FehérHead of Programe: Dr. Béla Fehér

~ IT security and qualityIT security and quality~ Head of programe: Dr. Károly KondorosiHead of programe: Dr. Károly Kondorosi

~ Human-machine relationHuman-machine relation ~ Head of programe: Dr. László Szirmay-KalosHead of programe: Dr. László Szirmay-Kalos

~Security (COBIT, Security (COBIT, BS7799)BS7799)~Quality (processes, Quality (processes, ISO 9126)ISO 9126)~TechnologyTechnology


ContentsContents


~ TST GVOP-3.3.1-2004-04-0079/3TST GVOP-3.3.1-2004-04-0079/3~ "Pázmány Péter Program" (RET-06/2005.) / NKTH"Pázmány Péter Program" (RET-06/2005.) / NKTH ~ IKKK-GVOP-2004-3.2.2 IKKK-GVOP-2004-3.2.2




IKKK-GVOP-2004-3.2.2IKKK-GVOP-2004-3.2.2

~ Sponsored by Hungarian Ministry of Sponsored by Hungarian Ministry of Trade and EU (Trade and EU (http://ikkk.inf.elte.hu/)http://ikkk.inf.elte.hu/)~ A cooperation of 7 software companies, A cooperation of 7 software companies,

coordinated by the Eötvös Lóránd University of coordinated by the Eötvös Lóránd University of Science, Budapest.Science, Budapest.

~ 5 main areas: simulation, adaptive software,5 main areas: simulation, adaptive software, telecommunication, imageingtelecommunication, imageing

~ Duration: 3 years (Nov. 2004- Nov. 2007)Duration: 3 years (Nov. 2004- Nov. 2007)

~ Main target: Main target: ~ To establish and maintain the activity of a research To establish and maintain the activity of a research

and development center, in order to ensure an and development center, in order to ensure an ongoing cooperation between software industry and ongoing cooperation between software industry and academic sphere. academic sphere.

quality,quality,

ELTE Informatika

i Kooperációs Kutatási és

Oktatási Központ (ELTE IKKK)


IKKK-GVOP-2004-3.2.2IKKK-GVOP-2004-3.2.2

~ Quality - related R&DQuality - related R&D~ Goals: Goals:

~ Clarifying theoretical basis of component-based technologies, Clarifying theoretical basis of component-based technologies, direct attention towards new areas of their appdirect attention towards new areas of their applilication, cation, introducing them to university curriculum - Head of programe: introducing them to university curriculum - Head of programe: Prof. Dr. László Kozma Prof. Dr. László Kozma

~ To establish and maintain a center for software estimations To establish and maintain a center for software estimations and quality auditingand quality auditing~ Modeling software development risks by Bayesian Belief Modeling software development risks by Bayesian Belief

Networks, Safety start-up of distributed systems, testing, Networks, Safety start-up of distributed systems, testing, modeling programs by graphs, Curses related to : software modeling programs by graphs, Curses related to : software metrics, PSP- Dr. Attila Kovácsmetrics, PSP- Dr. Attila Kovács

~ Defining theoretical basis and implementation of multiparadigm-Defining theoretical basis and implementation of multiparadigm-based software metrics – Zoltán Porkolábbased software metrics – Zoltán Porkoláb

~ To execute surveys about To execute surveys about ~ Company characteristics related to quality - Dr. Attila KovácsCompany characteristics related to quality - Dr. Attila Kovács~ Quality approaches and SPI done in Hungary - Dr. Katalin Quality approaches and SPI done in Hungary - Dr. Katalin

BallaBalla


IKKK-GVOP-2004-3.2.2– IKKK-GVOP-2004-3.2.2– the surveythe survey

~ Scope: to investigate in Hungary the Scope: to investigate in Hungary the „„where we are in SPIwhere we are in SPI”, i.e.: ”, i.e.: ~ Basic software quality models used in SPI Basic software quality models used in SPI ~ SPISPI

~ DriversDrivers~ BarriersBarriers

~ Get an idea about actual maturity / capability level of Get an idea about actual maturity / capability level of software companies / software development software companies / software development processesprocesses

~ Recognize Recognize ~ actually most mature processes in software developmentactually most mature processes in software development~ actually most immature processes in software developmentactually most immature processes in software development~ most common most common

~ difficulties companies face while doing SPI difficulties companies face while doing SPI ~ most common most common

~ benefits companies encounter while doing SPI benefits companies encounter while doing SPI


IKKK-GVOP-2004-3.2.2– IKKK-GVOP-2004-3.2.2– the surveythe survey

~ Participants:Participants:~ 88 software development companies / companies software development companies / companies

having large software development departmentshaving large software development departments~ 55 Hungarian-owned Hungarian-owned~ 3 Hungarian members of (big) multinational companies3 Hungarian members of (big) multinational companies

~ Software developed:Software developed:~ Automotive, safety-critical, telecom, medical devices, Automotive, safety-critical, telecom, medical devices,

software used in customs, „general purpose” software software used in customs, „general purpose” software

~ Surveying technique:Surveying technique:~ Interviews / CMMI-related, mini - internal appraisalsInterviews / CMMI-related, mini - internal appraisals


IKKK-GVOP-2004-3.2.2– IKKK-GVOP-2004-3.2.2– findings of the surveyfindings of the survey

~ Basic software quality models used in Basic software quality models used in SPISPI~ ISO 9001:2000 is still the most used quality approachISO 9001:2000 is still the most used quality approach--

„„informatics” companies, total: 439 IT-related informatics” companies, total: 439 IT-related companies are ISO-certifiedcompanies are ISO-certified~ + standards connected to the business domain of + standards connected to the business domain of

the company (health-care, automotive…) + AQAPthe company (health-care, automotive…) + AQAP~ Software product quality models are rarely Software product quality models are rarely

used (some elements of ISO 9126)used (some elements of ISO 9126)~ CMMI® is becoming a popular, “trusted” SPI CMMI® is becoming a popular, “trusted” SPI

model in Hungarymodel in Hungary

152152



~ Drivers of the SPIDrivers of the SPI~ Internal needs, eg.:Internal needs, eg.:

~ To have reliable project progress data (how much… by when…?) To have reliable project progress data (how much… by when…?) ~ To have better estimatesTo have better estimates~ Personal knowledge should be transformed into organizational knowledge Personal knowledge should be transformed into organizational knowledge ~ To have a „better” testing To have a „better” testing ~ To have configurations under controlTo have configurations under control~ To understand the nature and cost of the change requestsTo understand the nature and cost of the change requests~ Marketing Marketing ~ Wish to stabilize the organization (But: successful SPI can be done ina Wish to stabilize the organization (But: successful SPI can be done ina

stable organizational environment – contradiction)stable organizational environment – contradiction)

~ Cases when SPI has been started to satisfy a specific customer Cases when SPI has been started to satisfy a specific customer requirement (eg. for certification) are extremely rarerequirement (eg. for certification) are extremely rare



~ Barriers of the SPIBarriers of the SPI~ There are never enough resources. People must There are never enough resources. People must

work on „real” projects. So, SPI is done „overtime”. work on „real” projects. So, SPI is done „overtime”. ~ „„Let the consultant do it for us.”Let the consultant do it for us.”~ „„Just let us finish the SPI…” – processes might not Just let us finish the SPI…” – processes might not

be „real”, therefore useless – fact recognized while be „real”, therefore useless – fact recognized while doing the SPI, therefore stopping itdoing the SPI, therefore stopping it

~ „„CMMI ML3 or nothing…” – unrealistic goals and CMMI ML3 or nothing…” – unrealistic goals and schedules, causing terrible stress to the employeesschedules, causing terrible stress to the employees

~ Good practices are „kept” inside the company – no / Good practices are „kept” inside the company – no / few possibilities to learn from others’ experience few possibilities to learn from others’ experience

~ Marketing value of doing SPI is still rather low in Marketing value of doing SPI is still rather low in Hungary Hungary



~ Get an idea about actual maturity / capability level of Get an idea about actual maturity / capability level of software companies / software development software companies / software development processesprocesses~ According to CMMIAccording to CMMI

~ ML not reaching 2 …ML not reaching 2 …~ MA, risk management in projects rarely existsMA, risk management in projects rarely exists~ PPQA is not phased to projectsPPQA is not phased to projects

~ DAR process almost never in placeDAR process almost never in place~ Usually technical processes have a higher capability level than Usually technical processes have a higher capability level than

managerial ones („these are the real work…”)managerial ones („these are the real work…”)~ ……but: technical processes are not divided (eg: one „testing” but: technical processes are not divided (eg: one „testing”

process, where it is difficult to identify VER, VAL, PI)process, where it is difficult to identify VER, VAL, PI)~ Wish to identify as few „cases” as possibleWish to identify as few „cases” as possible

~ … … but the unique, „standard” process seems to be too complicated but the unique, „standard” process seems to be too complicated for everyonefor everyone



~ Recognize actually most mature processes in Recognize actually most mature processes in software developmentsoftware development~ CM, TS, testing (as a VER+VAL+ PI CM, TS, testing (as a VER+VAL+ PI

procedure) -(most times satisfy CMMI procedure) -(most times satisfy CMMI requirements for ML2 and ML3 almost requirements for ML2 and ML3 almost entirely) entirely)

~ PP, PMC (most times partially satisfy CMMI PP, PMC (most times partially satisfy CMMI requirements for ML3)requirements for ML3)~ MissingMissing (eg.) (eg.): „record basis of estimates”: „record basis of estimates”



~ Recognize actually most immature processes in Recognize actually most immature processes in software developmentsoftware development

~ MA, DARMA, DAR, PPQA, PPQA (most times do not satisfy (most times do not satisfy CMMI requirements for ML3)CMMI requirements for ML3)~ Results in: not satisfying GP 2.8, GP 2.9 for the Results in: not satisfying GP 2.8, GP 2.9 for the

other processesother processes

~ REQM SP1.4 (maintain bidirectional REQM SP1.4 (maintain bidirectional traceability…) – never found satisfiedtraceability…) – never found satisfied



00,10,20,30,40,50,60,70,80,91P P L

P TO

S CM

RM

S QA

S S M

TP

OP FOPD

IC

P R

IS M

S P E

QPM

S QM

Process profile Process profile according to CMMaccording to CMM

Process profile Process profile according to CMMIaccording to CMMI



~ Recognize most common difficulties companies face Recognize most common difficulties companies face while doing SPIwhile doing SPI~ What model to choose? What model to choose? ~ We never execute 2 projects which are alike…how to standardize We never execute 2 projects which are alike…how to standardize

them? (mistake: standardization is approached from technical them? (mistake: standardization is approached from technical aspects…)aspects…)

~ Fear from spending (and reporting!!!) time for non-technical activitiesFear from spending (and reporting!!!) time for non-technical activities~ Difficulties in understanding GG2 (if CMMI is used)Difficulties in understanding GG2 (if CMMI is used)

~ Describing GG2 in one short document, generically, for all processesDescribing GG2 in one short document, generically, for all processes~ Vehement protest against planning, monitoring, measuring etc. Vehement protest against planning, monitoring, measuring etc.

something else than the technical activities („illogic”)something else than the technical activities („illogic”)~ Protest against doing CM for something else than the productProtest against doing CM for something else than the product

~ How to measure product quality attributes?How to measure product quality attributes?~ How to measure something else than effort, time and the nr. of change How to measure something else than effort, time and the nr. of change

request?request?~ What are my product types?What are my product types?



~ Recognize most common benefits Recognize most common benefits companies encounter while doing SPIcompanies encounter while doing SPI~ A „really good” PM system is put in placeA „really good” PM system is put in place~ Reliable data starts to show up Reliable data starts to show up ~ Easily usable templates and models are developed (no more Easily usable templates and models are developed (no more

arguing about what type of data should be sent to a manager…)arguing about what type of data should be sent to a manager…)~ Better estimations can be made, based on historical data that has Better estimations can be made, based on historical data that has

been started to be collected been started to be collected ~ „„Proud employees” – they have been asked about how the Proud employees” – they have been asked about how the

company should do thingscompany should do things~ „„Working on SPI was the most interesting and challenging job I Working on SPI was the most interesting and challenging job I

had”had”~ ROI: would be good to know – but for the moment it is not, or ROI: would be good to know – but for the moment it is not, or

just in subjective termsjust in subjective terms


ContentsContents






Conclusion, further Conclusion, further possibilities possibilities

~ SPI and CMMI-based SPI have entered the SPI and CMMI-based SPI have entered the field of interest of Hungarian field of interest of Hungarian governmental and academic sphere. governmental and academic sphere.

~ It is important (also for Hungarian It is important (also for Hungarian government) to have a permanent government) to have a permanent dialogue between industry and academy.dialogue between industry and academy.

~ Interest in using software quality models, Interest in using software quality models, including CMMI, is growing among including CMMI, is growing among Hungarian software companies.Hungarian software companies.


Conclusion, further Conclusion, further possibilitiespossibilities

~ Possible strategies Possible strategies ~ Centralizing, pushing CMMI (might be good, because Centralizing, pushing CMMI (might be good, because

companies would be prepared for foreign customers’ needs) – companies would be prepared for foreign customers’ needs) – eg. in all big Hungarian governmental tenders CMMI eg. in all big Hungarian governmental tenders CMMI certification could be a requirement. certification could be a requirement.

~ Leave companies to do SPI and get certified as their own Leave companies to do SPI and get certified as their own business drives them (only those will do SPI for certification, business drives them (only those will do SPI for certification, who is forced by the customer)who is forced by the customer)

~ Golden-mean: propagating of SPI advantages, making Golden-mean: propagating of SPI advantages, making available information about models, teaching courses - but it available information about models, teaching courses - but it should not be mandatory for companies to get certified. should not be mandatory for companies to get certified.

~ Would be good to be able to learn form each-others’ Would be good to be able to learn form each-others’ experience… experience…

~ Would be good to do clustered SPI…Would be good to do clustered SPI…


[email protected]@iit.bme.hu

Where We are and What’s Next in Hungarian Software Process Improvement ? Katalin Balla NJSZT...

Documents

Transcript of Where We are and What’s Next in Hungarian Software Process Improvement ? Katalin Balla NJSZT...