Microsoft power point from requiremens management to requirements authoring - an experience report...

From Requirements Managementto Requirements AuthoringAn Experience Report from Airbus Group

Jean Claude Roussel:Airbus Group

Juan Llorens:The REUSE Company

www.reusecompany.com

2 June 18, 2015© Airbus Group and The REUSE Company

AIRBUS GROUP AT A GLANCE


WHY AIRBUS PROMOTES RE?

Source: INCOSE HandbookTime

Cum

ulat

ive

perc

enta

geLif

ecyl

ce C

ost

OperationsthroughDisposal

100%Production

and test

50%

8%Design

15% 20%Concept

Commited Costs

3-6x

500-1000x

20-100x

Development


WHY AIRBUS PROMOTES RE?

50%

29%

21%

30%

52%

18%

20%

22%

58%

Requirements Engineering Capability

Proj

ect P

erfo

rman

ces

Correlation between Project Performances andRequirement Engineering Capability

Source : Report on SE Effectiveness Survey NDIA-IEEE-SEI/CMU-INCOSE Nov 2012


70% of defects are introduced during requirements phases It is important to write effective Requirements

Experiences show that about 25% of system Requirements are criticaland can be improved (re-written) No Shall: 8 to 10% Forbidden words: 10 to 15% Subject, multiple objects, design: 15% Incorrect grammar: 50%, …

Requirements error costs are high Fixing requirements after delivery may cost up to 100 times the one for fixing a

requirement error

Training, best practices and verifying requirements by reviews can help toget complete and consistent requirements: But the process is costly and time consuming

THE PROBLEM


Increase and improve the requirements quality control process to producebetter (Correct – Consistent – Complete) requirements Specifications

Reduce the number of iterations of the internal review processes

Reduce the number of iterations between System Engineers and sub-contractors and improve the verification activities

Promote requirements quality management during authoring (before controlactivities) Produce CCC requirements “right the first time”

THE GOAL


A FIRST ANSWER:

Requirements Quality Analyzer (RQA) Tool

Delivered by TRC (The Reuse Company)– Completely linked with IBM DOORS RMS– Focusing on Syntactic analysis and Semantic analysis

Tool evaluation– Airbus Group Innovations– Airbus Defense and Space Close cooperation with Tool vendor in order to improve the tool

Tool deployment– Airbus (Commercial Aircraft) A320 Neo Cabin Flex, A330 Neo

– Airbus Defense and Space Satellites, ARIANE 6 and M51 (English and French version) IFF projects and Sferion Programme


AIRBUS DEPLOYMENT SCENARIO:

Provide End Users (requirements authors) with the capabilityto improve their requirements quality.

Context :• A320neo: around 250 users (100 Requirements Modules)

Constraints:• No additional trainings for end users

Request:• All information available in IBM DOORS environment

Our retained solution:• Tool used in batch mode, on weekly basis for instance• Results of analysis available in DOORS modules thanks to specific views and a detailed

report available outside DOORS

Our next expectation:• Real time analysis of the Requirements quality in DOORS environment• Real time support to elicit a requirement


PROS & CONSof Requirements Quality Analysis

RQA V14.1 Good tool (Airbus feedback) but quite complex to use and parameterize

Process Approach Improve Tools integration with existing ones

Simplify complex loop (writing checking : traceability & quality updating)

Needs for future Switch from a posteriori quality analysis to instant checking (RAT) Implement on-the-fly process allowing requirements capture & checking, to be performed

simultaneously

Assume tools evolution, tools integration Imply teams adherence and specially the quality teams Not so easy!

Define standard requirements patterns per domain to be used as statement based templates bythe writer to compose his/her system requirements (patterns/boilerplates)


V4 Control V14 Authoring V16 Global Quality

NEXT STEP: From Analysis to Authoring

RQAV4

RQSV14

xQSV16

Sem

antic

s

CCC +Authoring

Syntactic +SemanticCheck

Full Qualitycontrol and

Reuse


NEXT STEP:

From Requirements Analysis to Requirements Authoring

Requirements Quality Control:Huge review effort for quality verification

My tailor is rich

I should need RAT

Requirements Writing:Working with requirements inside DOORS

Share quality responsibility between Quality Control and Development Allow a «Right the first time» principle

Whatever is produced, it has the best quality since the beginning

Guide Requirements authors to write CCC requirements on the fly Suggest Requirements structure, subjects, errors or quality measurements


REQUIREMENTS AUTHORING

So far RQA V4 was a verification tool:– Checking the quality of individual requirements once they are written

– Based on +25 metrics

– Checking the consistency of the overall specification

RQA has evolved towards the Requirements Quality Suite (RQS) in V14– Supports the CCC approach (Correctness, Consistency and Completeness)

– V15 is mainly focused on “authoring”

– RQS suite: Includes RQA, Requirements Authoring Tool (RAT) and KM

RAT: “The SMARTer* way to create requirements”:An assistant to Engineers during the authoring processIncluding a wide set of customizable patternsHelping Engineers during authoring with an intellisense system

* SMART stands for Specific, Measurable, Attainable, Realisable,Traceable

12


Requirements Quality Control:Huge review effort for quality verification

Requirements Quality Assurance:Authoring “right the first time” on top of DOORS

My tailor is rich

I should need RAT

Requirements Writing:Working with requirements inside DOORS

Requirements Quality Control:Smaller review effort for quality verification

REQUIREMENTS AUTHORING


The Requirements Quality Suite (RQS)

The Requirements Quality Suite (RQS) intends to tackle requirements quality management byoffering a set of tools and processes

Automatic measurement of requirements quality metric

Support to Requirements Authoring

RQS models requirements quality metrics using the CCC approach (Correctness, Consistencyand Completeness)

Requirements Quality Analyzer (RQA):to setup, check and manage the quality of arequirements specification

Requirement AuthoringTool (RAT):to assist authors while they are creating orediting requirements

knowledgeMANAGER:to manage knowledge around a requirementsspecification: the ontology it is based on, thestructure of the requirements to be used in theproject, the communication between authors anddomain architects


The Requirements Quality Suite

RQA – Requirements Quality Analyzer:Configures RQS with the quality policies and checklist of your organization

Checks the correctness of your requirements specification

CCC: Correctness, Consistency and Completeness Analysis

RAT – Requirements Authoring Tool:Write your requirements easily by using an assistant: pattern based

Correctness analysis on the fly

Consistency analysis on the fly

knowledgeMANAGER:Management of all the domain knowledge behind the quality analysis

Management of glossaries, taxonomies, thesauri and ontologies

Management of requirements Patterns to be used by RQA and RAT


Quality Features: CCC support in RQA V15

Correctness

Completeness

Consistency

Incompletenessby comparison

(models)

Incompleteness betweenHigh-Low levelspecifications

Redundantrequirements

Text analysismetrics

Inconsistent Units

RMSmetrics

Semanticmetrics

Structuralmetrics

Over-completeness

InconsistentProperties


Quality Functions

Correctness metrics are quantitative.

Correctness metric values are calculated counting itemsExample: Metric Text length in words => Counts the number of words.

The process is simplified by using interval quality functions

Metrics use one of the following quality functions:

textLength()Q

High

Med

Low

1 5 10 … 80 90


Pattern based Features

Patterns:Represents the structures every correct requirement should meetDifferent types of requirements different patternsCustomizable for every domain, customer and content of each requirementsdocumentLibraries available with sets of patternsRepresented as a sequential set of restrictions

When <Event> <Component> Shall <Action> <Object> Time_constraint


Summary of features

Fully customizable+60 out-of-the-box quality metrics for correctness+20 out-of-the-box quality metrics for completeness and consistencyParameterized metricsCustom-coded metricsSupport for Requirements verificationSupport for Requirements authoringRequirements identification in non-structured sourcesReporting system at different levels of detailKnowledge management and semantic approachSemantic search engine and requirements reuse


The Requirements Quality Suite

Other characteristics:Future available connectors:

Available languages:

(*)


Requirements Authoring Tool – RAT V15.1

Requirementsauthoring

topics

On-the-flyquality

checkingConsistentvocabulary

Consistencyin terms ofgrammar

Completenessin terms of

requirements

Completenessin terms ofspecification

Consistencyamong

requirements

Consistencyrequirements

vs. Models

Requirementsreuse

Support totraceability

Requirementsauthoring

topics

On-the-flyquality

checkingConsistentvocabulary

Correctness interms ofgrammar

Completenessin terms of

requirements

Completenessin terms ofspecification

Consistencyamong

requirements

Consistencyrequirements

vs. Models

Requirementsreuse

Support totraceability


CONCLUSION – KEY MESSAGES

Requirements Quality : A key element in product developmentThe need for Quality Analysis of Requirements in Product Development is no morequestionable, feedbacks on relevancy and efficiency are clear

Requirements Quality : An activity at operational level todayWithin Airbus (A320neo and A330neo regularly)

Within Airbus Defense and Space (Satellites, ARIANE 6, M51, IFF projects and SferionProgramme )

Moving from “a posteriori check” of Requirements to “on the fly check” (real time) ofRequirements

Engineers are guided in real time for Requirements Authoring to write well structured,consistent and pertinent Requirements

A new role called “Knowledge Manager” to build and maintain Ontologies is emergingSetting up and maintaining Ontologies need to define a new dedicated role in the EngineeringCompetencies


RAT Demo Video


RQA Demo Video

http://www.reusecompany.com

@ReuseCompany

[email protected]

Margarita Salas, 16 2nd FloorInnovation CenterLEGATEC Technology Park28919 Leganés – MadridSPAIN – EU

Tel: (+34) 912 17 25 96Fax: (+34) 916 80 98 26

Microsoft power point from requiremens management to requirements authoring - an experience report...

Engineering

Transcript of Microsoft power point from requiremens management to requirements authoring - an experience report...