engineering tools for the science of estimation

& risk management

Who are our Tools for ? 1.  Board of Directors 2.  CEO’s, CIO’s, CTO’s, CPO’s 3.  TM’s, DM’s, PM’s 4.  Business Sponsors 5.  System Integrators 6.  Security Agencies 7.  Software Houses 8.  Corporations 9.  Government 10.  Military

What do our Tools do ? 1.  Estimate the QA effort for IT-Projects 2.  Apply science to generate your estimate 3.  Calculates the required number of Tests 4.  Calculates the probability of finding defects 5.  Allows Users to scale from an Historical

Solution to a Projected Solution

Value Statement

Contact us = contact@testimation.com | Ph. = +61 410 294 720

engineering tools for the science of estimation

& risk management

Why is estimation important to a client ? •  Because this is when the client sets the budget Why is estimation important to a service provider ? •  Because this is when profit or loss is defined

When can our Tools be used ? •  In any situation when a QA estimate is required, for example:

1.  Bids & Tenders 2.  Internal Projects 3.  Assessments of 3rd party Service Providers / Suppliers / Vendors 4.  Legal Matters (contractual specifications) & Litigation

engineering tools for the science of estimation

& risk management

Is the Tool accurate & reliable ? Yes ! | This Tool is Fit-for-Purpose & should be utilised because

1.  It has been Experimentally Verified to accuracy greater than 98.07% •  Evidence is to a scientific standard of proof, not just a legal standard

•  Legal proof is jurisdictional, scientific proof is Universal 2.  The Risk of relying upon this Tool for future Projects is less than 1% 3.  The Experimentally Verified results,

•  Have been compiled into a Proof-of-Concept (PoC) document •  Can be verified by any person capable of counting •  Represent physical evidence which cannot be overturned •  Represent mathematical evidence which cannot be reinterpreted

4.  It is more reliable than DNA evidence •  The Tool is capable of 99.97% Predictive Confidence

engineering tools for the science of estimation

& risk management

What does using the Tool mean for your business ? 1.  Project cost & budget reduction by forecasting accurately & efficiently 2.  Operational cost reduction by accurately auditing systems & service providers 3.  Win more business (e.g. bids, tenders, services) 4.  Design a specific QA Strategy fitting a required budget 5.  Manage & mitigate Risk properly; with % numbers 6.  Continuous (real time) re-estimation & re-evaluation of Risk 7.  Predict the probability of finding defects prior to project commencement 8.  Predict the probability of residual defects in your systems (real time) 9.  Standardisation, transparency, repeatability, objectivity 10.  Rapid response to changes in scope; minutes instead of days or weeks

engineering tools for the science of estimation

& risk management

How does using the Tool legally protect or assist your business ? 1.  It is a scientifically formulated Tool

•  To a scientific standard of proof 2.  Continuous (real time) re-estimation & re-evaluation of Risk

•  Demonstrates standardisation, transparency, repeatability, objectivity 3.  Predicts the probability of finding defects prior to project commencement

•  Demonstrates that superior measures were undertaken to minimise Risk •  Provides clear delivery targets to service providers •  Provides a contractual basis (specification) for service delivery

4.  Predicts the probability of residual defects in your systems (real time) •  Can be applied to proportion accountability for defects resulting in $ loss

5.  Can be utilised as a foundation “for or against” litigation

engineering tools for the science of estimation

& risk management

Capability Description of predictive capability offeringQuality

AssuranceMinimum number of required Test CasesMaximum number of required Test Cases

Risk Management

% Probability of finding defects% Risk exposure% Code changes covered by testing% System covered by User Acceptance Testing (UAT)% Level of Quality Assurance (QA) being provided by 3rd party providers

Project Management

Testing man-day effortProject budgeting

How can we help you ? = Predictive Capability Offering

engineering tools for the science of estimation

& risk management

DFC $ (example) Test Cases Comments 80.22(%) $100K TC’s Critical Priority TC’s 93.15(%) $200K 2 × TC’s Critical + High Priority TC’s 97.43(%) $300K 3 × TC’s Critical + High + Moderate Priority TC’s

99(%) $400K 4 × TC’s Critical + High + Moderate + Low Priority TC’s (Default) 99.6(%) $500K 5 × TC’s C, H, M, L + 25(%) Redundancy (typically negative TC’s) 99.84(%) $600K 6 × TC’s C, H, M, L + 50(%) Redundancy (typically negative TC’s) 99.93(%) $700K 7 × TC’s C, H, M, L + 75(%) Redundancy (typically negative TC’s) 99.97(%) $800K 8 × TC’s C, H, M, L + 100(%) Redundancy (typically negative TC’s)

How can we help you ? = Defect-Free Confidence (DFC) vs. Test Cases

engineering tools for the science of estimation

& risk management

Example (1) of use in Legal matters •  Problem

•  ABC is facing $1B in penalties due to IT failures (defects)

•  Outcome (in favour of ABC) •  The Tool is utilised to conduct Quality Audits on a 3rd party service provider

•  The Tool determines that the 3rd party delivered the solution to 90% Defect-Free Confidence & did not make this known to ABC •  ABC argues that the 3rd party should absorb 10% of the penalties

•  A court awards $100M to ABC

engineering tools for the science of estimation

& risk management

Example (2) of use in Legal matters •  Problem

•  ABC is facing $1B in penalties due to IT failures (defects)

•  Outcome (against ABC) •  The Tool is utilised to conduct Quality Audits on ABC

•  The Tool determines that ABC implemented public solutions to 90% Defect-Free Confidence & did not inform the public •  ABC argues that it could not have determined the level of Defect-

Free Confidence in its Systems •  A court concludes that the technology exists (by Testimation)

to determine this information, but ABC chose to ignore it, or were perhaps negligent by not knowing of its existence •  ABC is penalized accordingly

engineering tools for the science of estimation

& risk management

Example (1) of use in bid submissions •  Problem

•  DEF requires a complete IT overhaul; approximately $100M+

•  Outcome (in favour of ITS) •  The Tool is utilised by ITS to generate a bid submission, with emphasis on

the level of Defect-Free Confidence DEF is willing to pay for •  ITS offers three levels of Defect-Free Confidence (95%, 99%, 99.97%)

in their bid submission (each level = different cost) •  DEF attempts to obtain an equivalent proposal from ITS

competitors; DEF fails, this capability is exclusive to ITS •  DEF awards the contract to ITS

engineering tools for the science of estimation

& risk management

Example (2) of use in outsourcing submissions •  Problem

•  DEF requires an outsourcing solution; approximately $50M+ annually

•  Outcome (in favour of ITS) •  The Tool is utilised by ITS to assess the current level of Defect-Free

Confidence of their existing providers & / or methodologies •  ITS offers three levels of Defect-Free Confidence (95%, 99%, 99.97%)

in their outsourcing submission (each level = different cost) •  DEF attempts to obtain an equivalent proposal from ITS

competitors; DEF fails, this capability is exclusive to ITS •  DEF is astounded that ITS is able to offer Defect-Free

Confidence “as a service” •  DEF awards the contract to ITS

engineering tools for the science of estimation

& risk management

Example (3) of use in internal IT-Projects •  Problem

•  DEF requires multiple Time-Boxed IT-Projects annually

•  Outcome (in favour of ITS) •  The Tool is utilised by ITS to rapidly estimate the required test sizing &

associated levels of Defect-Free Confidence fitting the Time-Box •  DEF selects the appropriate solution; being aware of the Risk level

informed by ITS •  DEF attempts to obtain an equivalent proposal from ITS

competitors for the next financial year; DEF fails, this capability is exclusive to ITS

•  DEF awards the contract again to ITS