CRMUG UK November 2015 - Testing testing! Panel Discussion with Scott Durow, Sarah Critchley and...

Post on 16-Feb-2017

166 views 2 download

Transcript of CRMUG UK November 2015 - Testing testing! Panel Discussion with Scott Durow, Sarah Critchley and...

explore

engage

elevate

Testing, Testing!Chair: Scott Durow, MVP

Panel: Sarah Critchley and Priscilla Tse

13:45 – 14:35

explore engage elevate

Scott Durow – Dynamics CRM MVP

Solution Architect

CRMUG Committee Member

Dynamics CRM MVP

Email: scott.durow@develop1.net

Twitter: @scottdurow

Blog: http://scottdurow.develop1.net

explore engage elevate

Sarah Critchley

Developer & Consultant

Experience with CRM 2011, 2013 & 2015 in both Online and On-Premise environments

Passionate about CRM

Email: sarah.critchley@cosl.co.uk

Twitter: @DynamicCRMCat

Blog: crm.fueledbysleep.com

explore engage elevate

Priscilla Tse

Technical Team Lead, Senior CRM Technical Consultant, Technical Writer

Experienced in end-to-end implementation of Dynamics CRM4 to CRM2015/online for government agencies, health sectors and multinational cooperation.

Email: Priscilla.Tse@KPMG.co.uk

Blog: DynamicsCRMGirl.wordpress.com

LinkedIn: https://uk.linkedin.com/pub/priscilla-tse/14/9b3/a41

explore engage elevate

Bridging the gap

You are here!

Happy UsersUSER ACCEPTANCE

TESTING

………………………

Software is tested in the

"real world" by the intended

audience or business

representatives

INTEGRATION, SYSTEM &

REGRESSION TESTING

………………………

Combine software together

and ensure it meets

requirements with no

unwanted side-effects

UNIT TESTING

………………………

Isolate small pieces of

testable software and

ensure it behaves as you

expect

explore engage elevate

Let’s collaborate together and answer…

explore engage elevate

Case Study – Upgrade of CRM4 to CRM Online

explore engage elevate

Infinite Time & Budget?

100% Unambiguous Requirements?

Massive Dedicated Test Team?

Let’s be pragmaticand not

theoretical!

explore engage elevate

Unit Testing Challenges (from discussions)

Moqs and fakes working for the tests (automated testing)

Javascript is a challenge to unit test (all client side) –multiple browsers and things are difficult to control

Scalability testing (Possible performance issues)

Standardisation between developers – is everyone writing the same way? Practicing standards

Testing data migration is difficult at this stage

Commenting code/tracing and knowledge transfer (can cover all of them)

explore engage elevate

Integration, System & Regression Test Challenges (from discussions)

Developers understanding specification and not working straight away

Testing security roles

Configuration entities – testing right setup

Firewalls/infrastructure challenges (environmental readiness) – Dev -> QA -> UAT

Mobile and different applications

explore engage elevate

User Acceptance Test Challenges (from discussions)

Time Commitments and the cascade in this (time management) – scheduling in this time

Control of changes and coherent release tracking – bug tracking which things have been fixed and which things haven’t

The above point if is particular for retesting also

Positive test evidence

Data and how this is relevant to the user

Differences between test and live and mismatches

Good representation of tests

The difference between training and testing (chicken and egg) and avoiding bias

Representative users to do representative things/roles – replicating a normal and a non-typical day

Feedback being sent back e.g. what did it do to not work, what are the replication steps.

explore

engage

elevate

5 minutes of…

Unit TestingScott Durow

explore engage elevate

explore engage elevate

AAA

ASSEMBLE

ACT

ASSERT

explore engage elevate

AAA

ASSEMBLE

ACT

ASSERT

explore engage elevate

Reasons why Unit Testing fails to deliver value…

explore engage elevate

Top Reason Unit Testing fails to deliver value…

explore

engage

elevate

5 minutes of…

QA & Formal TestingSarah Critchley

explore engage elevate

Sarah’s Top tips - QA & Formal Testing

Know what your testing

Business Processes vs Documented Functionality

WHAT are you doing?! WHY are you doing it?!

explore engage elevate

Sarah’s Top tips - QA & Formal Testing

What are you testing? Why are you testing it?

• Business Process

• Documented Functionality

explore engage elevate

Sarah’s Top tips - QA & Formal Testing

Formal testing techniques

Shooting for and around the goal

Positive & Negative Testing

explore engage elevate

Sarah’s Top tips - QA & Formal Testing

Exploratory testing

Testing without an Ego

Benefits and Challenges

explore

engage

elevate

5 minutes of…

User Acceptance TestingPriscilla Tse

explore engage elevate

User Acceptance Testing (UAT) … Involves …

UAT

Testers

Test System

Test Scripts

explore engage elevate

Test Scripts: Start Early and Iterate

Test Scripts

explore engage elevate

Test System: Is Built By …

Test System

Dev Team

Data Migration Team

Deployment Team

Collaboration

explore engage elevate

Testers: Support UAT Testers

Testers / End Users

Quality Feedback

Product Champion

explore

engage

elevate

Call to action: Accept and expect bugs and work

together to find them as early as possible.

explore

engage

elevate

Final thoughts?

explore

engage

elevate

Please fill in your feedback forms for this session!