Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is...

14
V0 | 2019-10-28 Software Testing TechDay – November 19, 2019

Transcript of Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is...

Page 1: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

V0 | 2019-10-28

Software Testing TechDay – November 19, 2019

Page 2: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

2

Squ

ore

Ana

lytic

s

Source Code Quality & Design

(Technical Debt Analysis)Squore Source Code Analyzer

Updating the Software AnalyticsAssembly Lines

Squore can assist in visualizing, aggregating, justifying, and delivering

high quality products to your customers. With different stakeholder

views, Squore can produce easily interpreted visualization of KPIs.

Page 3: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

3

The overall solution to optimize software projects monitoringSquore Software Analytics Platform

Improve project performance

Drive software quality

Ensure process and standard compliance

Page 4: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

4

Why using Squore?Squore Analytics: A single dashboard solution for better decisions

Unique Dashboard

Outliers Detection

Analysis Models

Report Automation

Squore

- All users

- Objectivity with consistent data

- Required by SPICE/CMMI/TUV

- Turn raw data into KPI

- Take into account project specificities (ASIL, dev/maintenance,…)

- Prove Standard/regulation compliance

- Need to share report with external stakeholder

- Efficient Quality Gate

- Focus on “elements” of the project which cumulate defects in multiple activities

Page 5: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

5

Handling heterogeneous objects from the project lifecycle with SquoreSquore Software Analytics Platform

Colle

ctan

d O

rgan

ise

Asse

ssan

d An

alys

eM

onito

r an

d Sh

are

Project monitoringDecision making

CloningISO25010

ISO26262

HIS MISRA

Standard Compliance

Source Tests Tickets Design

DO178

Complexity

Automated Reports

Role-BasedAction Plan

Milestones/Goals

Simulink

Scade

Jira

Mantis

CANoe

VCAST/QA

. . .

VCAST/C++

Self descriptiveness

Test Effectiveness

Aggregated Indicators Standards

Monitoring Features

Trend Analysis

. . .. . .

Others

Excel

SAP

. . .

SQUAN

Data

Business

BI

GitLabJenkins

Cont. Integration

Traceability

Reqs.

REQIf

Excel

. . .

Real-time

CorporateKPI

Automate

CorporateStandards

. . .

Rated, Trended

Structured

Raw

Actionable

Page 6: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

6

SQUORE Software Analytics: Collected dataSquore Software Analytics Platform

Source Code Static analyzer Standard: Available out of the box

Multi-language support: C, C++, Ada, Java, Javascript, C#, Cobol, Python, PL-SQL, SQL, VB.net, Objective-C …

Qualimetry Analytics: HIS metrics, Rule checking, Stability tracking

Architecture Analytics: Algorithmic Cloning and Textual Duplication detection

Data collected by SQUORE APIData from third party tools are aggregated:

Code Analysis: Klocwork, PCLint, QAC, …

Code Coverage: VectorCAST/QA

Test Metrics: VectorCAST/C++, CANoe, …

ALM data: Defects, Requirements, Design objects, ...

Page 7: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

7

SQUORE Software Analytics KPISquore Software Analytics Platform

Industry-proven metrics Complexity Self Descriptiveness Coverage Compliance

Test Effectiveness Cloning detection

Project monitoring indicators Completion Rate Innovation Rate

Maturity Index

Standard adherence Rule Compliance Violation Density

Page 8: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

8

Where is my relevant code complexity?Squore Software Analytics Platform

Project is too large for manual inspection

Squore Metrics

Squore control flow graph

Source code access

In a few seconds, complex code has been found,

an action can be taken

Squore Highlight

Page 9: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

9

How to consolidate reports from several checker tools and display critical findings?Squore Software Analytics Platform

A consolidated view with all findings can be shown in a few clicks,

speeding up the analysis

Violations from several tools and filter on critical findings

Page 10: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

10

What is the project’s coverage status wrt. ASILSquore Software Analytics Platform

The aggregated coverage assessment helps focus on the right components only

All functions coverage at a glance

‘Grey’ functions do not require a test

‘Colored’ functions show the aggregated coverage status

Squore allows tuning of coverage objectives wrt. ASIL level

Page 11: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

11

How to stop spending so much time on reporting?Squore Software Analytics Platform

With KPI automation, generate slides for a weekly meeting in minutes

instead of one day

Actual customer feedback

Page 12: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

12

What’s the cost of justifying MISRA violations?Squore Software Analytics Platform

Managing justifications with Squore helps save about three days per month per project

Actual 70 pages customer derogation report

Page 13: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

13

Squore: ScreenshotSquore Software Analytics Platform

Squore raises an alarm if suspicious justifications are detected

Always accessible as a filter

Suspicious status is also displayed beside the message

Page 14: Software Testing TechDay – November 19, 2019 · Squore Software Analytics Platform. Project is too large for manual inspection Squore Metrics Squore control flow graph Source code

14

Squore Software Analytics Platform

Squore: Screenshot

Synthetic Quality Assessment based on technical debt

Static Code Analysis:

- Open Findings

- Justified Findings

- Suspicious Findings

Test Results:

- Covered lines

- Statement, Branch, MCDC coverages