Quality of business process models Tutorial CAiSE 2016 15...
Transcript of Quality of business process models Tutorial CAiSE 2016 15...
![Page 1: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/1.jpg)
1
Quality of business process models Tutorial CAiSE 2016
15/6-2016 John Krogstie
Professor, IDI, NTNU
Trondheim, Norway
![Page 2: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/2.jpg)
2
Q
Background on me Master and PhD in Information Systems at IDI, NTNU (1991, 1995)
Employed 9 years in Andersen Consulting (Accenture) 2000-2005 senior researcher in SINTEF ICT (Oslo) Professor at IDI, NTNU since 1.august 2005 (earlier part-time position for 7.5 years) Lead IS and SE-group (ISSE) at IDI and faculty lighthouse of Open and Autonomous
Digital Ecosystems (OADE) Previous chair of IFIP WG8.1 on design and evaluation of information systems.
(2010-2015). Current vice-chair of IFIP TC8 – Information systems
Mobile IS
Modeling
eGovernment
![Page 3: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/3.jpg)
3
Q
Overview of tutorial Characteristics of business process models
including goals of business process modeling
Overall presentation of the SEQUAL framework for assessing quality of models
Examplifying the different aspects of the framework relative to business process modeling
Examples of how the framework has been used in industrial settings
Based on
Krogstie, J: Model-based Development and Evolution of Information Systems: A Quality Approach. Springer 2012
New book 2016: Quality in Business Process Modeling
![Page 4: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/4.jpg)
4
Q
Survey on your background knowledge
Open a browser (PC or mobile) going to kahoot.it
Enter the pincode
Enter a nick-name
![Page 5: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/5.jpg)
Process modeling is a kind of conceptual modeling
Models used for representing enterprises/organizations, problem analysis, requirements and design specification
Primarily diagrammatic (2-dimensional diagrams)
The languages used for modeling have a limited vocabulary
The languages used are originally meant to be generally applicable (and not for a specific domain). Some exception e.g. using so-called domain specific modeling languages (DSL)
![Page 6: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/6.jpg)
6
Q
Business Processes
A business process is a collection of related tasks that produce a specific service or product to address one or more goals for a particular actor or set of actors with the optimal use of resources.
![Page 7: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/7.jpg)
7
Q
Main elements of a modelling activity
Persons
Means forrepresentation
Area of interest
Tools
Modelingtask
Goal ofModelling
Existing resources
Models
![Page 8: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/8.jpg)
8
Model of ideal future state
Current state
Model of current state
Current model of ideal state
Espoused model of
current state
3. Quality assurance
Reference model
8. Standardization
Perception of current state
1. Sensemaking
4. Model analysis
5. Model deployment
0. Model mapping 6. Context
of change
Perception of future state
Model of future state
Future state
2. Agreement
2. Agreement Model of possible
future state Model of possible
future state Model of possible
future state
7. Model implementation
Goals of (business process) modeling
![Page 9: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/9.jpg)
10
Q
SEQUAL – A framework for understanding and assessing quality of models based on semiotics
For models as a knowledge representation in general
Can be extended and specialised towards specific types of model and modelling languages (e.g. business process models)
Structuring existing material on quality of models and modelling languages
Differentiate between quality of different levels based on semiotic theory
Differentiate between goals of modelling (quality characteristics) and means to achieve these goals
Set-oriented definition to enable a formal discussion of the different quality levels
Takes into account that models are socially constructed, both subjective and objective aspects of quality
![Page 10: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/10.jpg)
11
Q
Sets in the quality framework G: The goals of the modelling
L: What can be expressed in the modelling language
M: What is expressed in the model
A: What actors that develops or has to relate to (parts of) the model has access to. Actors can be persons or tools (technical actors).
D: What can be expressed about the domain (area of interest) which is relevant to fulfil G (the goals of modeling)
K: The explicit knowledge of the participating persons about the domain D
I: What the participating persons interpret the model to express
T: What relevant tools interpret the model to say
All of these sets evolves as part of modelling
![Page 11: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/11.jpg)
12
Q
Sets relative to main elements of a modelling activity
Persons
Means forrepresentation
Area of interest
Tools
Modelingtask
Goal ofModelling G
L D
A K I
T
![Page 12: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/12.jpg)
13
Q
Technical actor
interpretation T
Deontic
Physical
Perceived semantic
Social
Syntactic
Pragmatic (human understanding)
Pragmatic (tool understanding)
Empirical
Semantic
Deontic (action)
Deontic (learning)
Model externalization
M
Modeling domain
D
Goal of
modeling G
Language extension
L
Social actor interpretation
I
Social actor explicit knowledge
K
Actor access A
SEQUAL – Quality of models
![Page 13: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/13.jpg)
SEQUAL-Gen
SEQUAL-EM SEQUAL-BPM
SEQUAL-ONT
SEQUAL-MDSD
SEQUAL-SRS
SEQUAL-DQ
SEQUAL-UML
SEQUAL-IM
SEQUAL-DM
SEQUAL-BPMN
Influence
Inherit
![Page 14: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/14.jpg)
15
Q
Overall structure of framework
Quality type (physical, empirical…)
One or more quality characteristics per quality type Means to achieve the quality characteristics
Beneficial existing quality
Model properties
Language properties
Modeling activities
Tool-functionality
![Page 15: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/15.jpg)
16
Q
Model example to illustrate the different quality levels
Language: BPMN
Domain: Conference organizing
Goal: Design of conference system
![Page 16: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/16.jpg)
17
Q
Physical Quality
Internalizability
Model persistence
Model availability to relevant actors
Currency (is the model up to date?)
Security
-> Database functionality (model repository) Model versioning
Model co-evolution (language model, main model, transformation models)
Model interchange
Global model management
Support for collaborative modeling
![Page 17: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/17.jpg)
18
Q
Empirical quality Look on aspects related to
Ergonomics
Graph layout
Readability (of textual parts of model) The model must be externalised (exist physically)
Modelling and tool activities
(Automatic) graph-layout, readability index, grammar checking, evaluation of use of colour
Checking adherence to modeling guidelines
![Page 18: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/18.jpg)
19
Q
Example of poor graph-layout
![Page 19: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/19.jpg)
20
Q
Aesthetics Reading direction:
From left to right
From top to bottom
Labels:
Align labels left or centered
Elements should not be significantly bigger than their labels
Highlight headlines / important elements
Relations should not obstruct text
![Page 20: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/20.jpg)
21
Q
Alignment of model elements Minimize alignment points
Arrange elements in a way that there are as few horizontal and vertical alignment points as possible.
Equidistance
If possible place all elements at the same distance to each other.
Equality
Equal elements on the same abstraction level should have the same size.
Distance
Don’t place elements and relations too close to each other.
![Page 21: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/21.jpg)
22
Q
Alignment of relations
Do not cross other relations or elements
Keep relations as short as possible
Avoid parallel relations
Don’t use too many different angles (45°, 90°, 135°)
![Page 22: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/22.jpg)
23
Q
Limited number of angles - example
![Page 23: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/23.jpg)
24
Q
Style guidelines BPM (Silver, 7PMG, Moreno-Montes and Snoeck 2014) Number of elements 1. The model contains a high number of elements (i.e., gateways,
activities and events) -> Decompose models with more than 31 elements.
2. The model contains duplicate elements (e.g., identical start events, identical end events, identical activities) or fragments, capturing the same control flow logic -> Avoid duplicate elements and fragments in the process models.
3. …………..
Composition of components 1. The model has deeply nested structured blocks -> Avoid deeply nested
structured blocks.
2. The model contains multiple cycles -> Avoid cycles in the process models if possible, especially unstructured cycles (i.e., cycles with multiple exit points).
3. ……………………..
![Page 24: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/24.jpg)
25
Q
Syntactic quality Syntactic correctness : M\L = Ø
Two types of errors
Syntactic invalidity
Syntactic incompleteness The model must be externalised
Language properties
Formal syntax, language defined in a meta-model Activities
Error prevention
Error detection
Error correction (automatically or by suggestion (”spellcheck” ) )
M L
![Page 25: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/25.jpg)
26
Q
Example of syntactic invalidity
M L
![Page 26: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/26.jpg)
27
Q
Example of syntactic incompleteness
![Page 27: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/27.jpg)
28
Q
Semantic quality Quality characteristics
Validity: M\D =Ø
Completeness: D\M = Ø
More realistic; M D
Necessary/useful that the model is externalised and is syntactically correct
Language properties: Formal semantics
Activities: Model testing (consistency checking), reuse of (reference) models, ’driving questions’, meta-model adaptation (changing the modelling language to fit the domain)
For process models (e.g. BPMN) : absence of deadlocks, reachability, no infinite recursion
For to-be models the domain here is the improved future domain. Linked to business process improvement
M D
![Page 28: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/28.jpg)
29
Q
Patterns for business process improvement
Based on wanted quality characteristic of business process (time, cost, resource usage…)
Rethink (why)
Reconfigure (what)
Reassign (who)
Resequence (when)
Relocate (where)
Reduce (how much)
Retool (how)
Concrete patterns from BPM literature (including Dumas et al. 2013, Rosemann and Recker 2015..)
![Page 29: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/29.jpg)
30
Q
Examples of resequencing patterns – Look upon relative to dimension of value to achieve (time, cost, flexibility…)
Using predicting to increase efficiency
Changing the decision moment
Increasing flexibility with postponement
Minimizing the number of interconnections and dependencies
Changing the number of alternatives
Resequencing the work
Reorganizing partial processes
![Page 30: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/30.jpg)
31
Q
Example of semantic invalidity (and incompleteness)
M D
![Page 31: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/31.jpg)
32
Q
Pragmatic quality Quality characteristics
Comprehension, do the audience understand what the model available to them express ? (I = A)
Useful that the model have high physical, empirical, and syntactic quality before evaluating pragmatic quality.
Language properties: Operational semantics Executability Explicit modelling of intention and source of part of the model
Activities: Inspection, visualization, filtering/views, explanation generation, simulation, animation, reporting, execution/prototyping, model-generated solutions
A I
A
I
![Page 32: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/32.jpg)
33
Q
Perceived semantic quality
Quality characteristics
Perceived validity I\K = Ø
Perceived completeness: K\I = Ø
Useful that the model has high physical, empirical, syntactic, and pragmatic quality before investigating perceived semantic quality
Validation techniques
K
I
s
not (s)
![Page 33: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/33.jpg)
34
Q
Trade-off semantic and pragmatic quality in metro maps
![Page 34: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/34.jpg)
35
Q
Less topographic detail, better understanding for navigation in the metro
![Page 35: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/35.jpg)
36
Q
![Page 36: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/36.jpg)
37
Q
Social quality
Quality characteristics: Agreement
Agreement in knowledge/interpretation/model
Relative vs. absolute agreement
Important first to address physical, pragmatic and perceived semantic quality
Language properties: Possibility to explicitly express inconsistencies based on disagreement.
Activities: Model integration and conflict resolution
![Page 37: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/37.jpg)
Model integration based on models from different viewpoints
![Page 38: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/38.jpg)
39
Q
Deontic quality The deontic quality of the model relates to
that all statements in the model contribute to fulfilling the goals of modelling (goal validity)
that all the goals of modelling are addressed through the model (goal completeness)
Deontic quality introduce a context that relax wanted quality for a model on the other levels (e.g. trade-of between completeness of the model relative to cost).
Expressed with the notion of feasible quality (particularly on the levels of semantic, pragmatic, perceived semantic and social quality)
Goals include often aspects relative to participant learning and domain improvement (for to-be models)
![Page 39: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/39.jpg)
40
Q
Quiz
Open a browser (PC or mobile) going to kahoot.it
Enter the pincode
Enter a nick-name
![Page 40: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/40.jpg)
41
Q
SEQUAL – language quality
Modelling domain
D
Technical actor
interpretationT
Goal of
modeling G
Language extension
L
Social actor interpretation
I
Social actor explicit knowledge
K
Ontology O
Ontological appropriateness
Tool appropriateness
Comprehensibility appropriateness
Domain appropriateness
Organizational appropriateness
Modeler appropriateness
Participant appropriateness
![Page 41: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/41.jpg)
42
Q
Example of usage of the framework Evaluation of models Methodology guidelines for developing good
models Evaluation and choice of modeling languages in
organizations (UML, BPMN, others) Guidelines for developing and evolving new
modeling languages Evaluation of a modeling language under
development and evolution Evaluation of a modeling tool/environment Evaluation of a modeling methodology
![Page 42: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/42.jpg)
43
Q
Example – Business process modeling in oil company – Evaluation of process models using SEQUAL
Oil company headquartered in Norway
More than 20.000 employees in more than 30 countries worldwide
Large resources used pn - model of the Quality System – in particular supporting the compliance of work to regulations to ensure safety of operations
Large improvement on injury-frequency since the models where introduced.
Model quality as a balance of syntactic, semantic, and pragmatic quality
![Page 43: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/43.jpg)
44
Q
Models in the company Quality system
Models in a BPMN-variant made accessible through the ARIS-tool, from which all governing documentation (GD) is accessed by the end users.
Restricted version of BPMN, with detailed guidelines for labling etc (TR0002)
Disp, a tool which supports handling applications for deviation permits
![Page 44: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/44.jpg)
45
Q
Goals of (model of) quality system Contributing to safe, reliable and efficient operations and enabling
compliance with external and internal requirements -> compliance management
Helping the company incorporating their values, people and leadership principles into everything they do
Supporting business performance through high-quality decision-making, fast and precise execution and continuous learning
![Page 45: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/45.jpg)
46
Q
Model of ideal future state
Model of future state
Current state
Espoused model of
current state
Future state
Current model of ideal state
Reference model
Model of current state
Model of possible
future state Model of possible
future state Model of possible
future state
8. Standardization
3. Quality assurance
Perception of current state
Perception of future state
1. Sensemaking
4. Model analysis
5. Model deployment
0. Model mapping
2. Agreement
6. Context
of change
2. Agreement
7. Model implementation
Usage of models in the case
![Page 46: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/46.jpg)
47
Q
Overall model-structure (in total more than 2000 diagrams on the lowest workflow level)
![Page 47: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/47.jpg)
49
Q
Simple model example on lowest level
![Page 48: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/48.jpg)
50
Q
Evaluation of existing model-solution
Based on a user survey
4828 employees took part in the survey (about half of those invited)
Many challenges were identified from the survey, related to
the management system itself,
learning processes
work practice Many of the issues can be connected to model
quality structured using the quality-levels of SEQUAL
![Page 49: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/49.jpg)
51
Q
Physical quality
More than half of the respondents are unsure that they have found all relevant documentation.
The search function often does not produce the desired result.
Many are not satisfied with the way changes to models and governing documents (GD) affecting their work are communicated
Employees are not aware of the possibility for staying updated on changes, and when they do, they experience that the reasoning behind the changes are not clearly communicated
14% of the respondents report using paper copies to access GD, so unless employees are clearly notified of changes they might keep using old versions.
![Page 50: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/50.jpg)
52
Q
Empirical quality
Graphical layout not particularly mentioned
Use of abbreviations in models noted as a problem by many
![Page 51: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/51.jpg)
53
Q
Syntactic quality
There are many guidelines on this level (TR0002)
There are many examples that these are only partly adhered to.
Still this was not explicitly mentioned as an issue.
![Page 52: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/52.jpg)
54
Q
Semantic quality
68% feel that the governing documentation has the right amount of detail
but is also often seen as too rigid to account for local needs and variations, which leads to a lot of requests for deviations.
17% of survey respondents report often seeing gaps between what is described in the GD and what is being done in practice
The process of handling improvement proposals appear to be too slow and inconsistent
![Page 53: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/53.jpg)
55
Q
Pragmatic and social quality About half of the respondents feel that governing
documentation is easy to understand. By others, governing documentation is perceived
as vague and ambiguous, especially when it comes to authorities and responsibilities.
Only 44% satisfied with the support (including coursing) they are given.
About half of the respondents have participated in organised training related to the use of GD. These have a higher score for confidence in, use of and compliance with GD than the ones who have not participated in a training program.
Good leadership support reported to have strong positive effect on use
![Page 54: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/54.jpg)
56
Q
Deontic quality
The results from the survey indicate that the models contribute a lot to high safety (as confirmed by 75% of the respondents), moderately to high reliability, but not to high efficiency (37%)).
One in five of the respondents feel that safety and efficiency is not properly balanced.
![Page 55: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/55.jpg)
57
Q
Summary of case The (model of the) quality system of Statoil is developed supporting in
particular compliance to requirements to reduce risk, an area where large improvements have been observed over the last decade.
Still one find challenges with among other things the comprehension of some of the models
SEQUAL works as an appropriate framework to identify and categorize model quality issues
Whereas the requirements given in TR0002 are quite detailed and structured, they focus mostly on empirical and syntactic quality.
Quality on these levels is also important for pragmatic quality, but are not always followed.
The use of SEQUAL to structure this discussion points to issues also on higher quality levels (semantic, pragmatic, social, and deontic) based on processes around the implementation and evolution of models
the use of modelling within the company has evolved over the years, and models and modelling practices that were regarded as good on an earlier stage might no longer be looked upon as being sufficient.
![Page 56: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/56.jpg)
58
Q
Final remarks The tutorial have provided an overview of
SEQUAL, a framework for assessing and understanding quality of models
Applied in particular to business process modeling
More on detailed techniques and methods for using the framework in the books
Please also feel free to contact me if you or your PhD-students want to use the framework : [email protected]
![Page 57: Quality of business process models Tutorial CAiSE 2016 15 ...caise2016.si/.../06/caise2016-tutorial-krogstie.pdf · Quality of business process models Tutorial CAiSE 2016 15/6-2016](https://reader030.fdocuments.in/reader030/viewer/2022040608/5ec8227b558daf2fcb345e2d/html5/thumbnails/57.jpg)
59
Quality of business process models
Questions ? John Krogstie
Professor, IDI, NTNU