Going Cloudy? How to test SaaS? with Kees Blokland
-
Upload
eurostar-conference -
Category
Technology
-
view
249 -
download
1
description
Transcript of Going Cloudy? How to test SaaS? with Kees Blokland
![Page 1: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/1.jpg)
Welcome to the 2013
www.eurostarconferences.com
This webinar is presented by Kees Blokland and he will discuss:
‘Going Cloudy? How to test SaaS?’
Join us on Twitter! @esconfs #esconfs
![Page 2: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/2.jpg)
Going Cloudy?
How to test SaaS?
Kees Blokland
Polteq Test Services BV
The Netherlands
![Page 3: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/3.jpg)
3
ISBN 978-1-937538-38-5
![Page 4: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/4.jpg)
![Page 5: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/5.jpg)
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
analyzing, transmitting, learning, controlling,
purchasing, testing, alarming, changing, updating,
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
mailing, communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching, saving,
accelerating, enhancing, creating, growing, checking
in, checking out, finding out, reaching, denying,
talking, designing, making, verifying, measuring
![Page 6: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/6.jpg)
6
Surf
Transfer
Develop and Test
Operate and Manage Store
![Page 7: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/7.jpg)
7
Surf
Transfer
Develop and Test
Operate and Manage Store
storage claim
80% unused
redundancy, proliferation limitations
environmentally unfriendly
![Page 8: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/8.jpg)
8
Surf
Transfer
Develop and Test
Operate and Manage Store
standard software bandwidth
internet technology
virtualization
SOA
![Page 9: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/9.jpg)
9
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
analyzing, transmitting, learning, controlling,
purchasing, testing, alarming, changing, updating,
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
mailing, communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching, saving,
accelerating, enhancing, creating, growing, checking
in, checking out, finding out, reaching, denying,
talking, designing, making, verifying, measuring
Surf
Transfer
Develop and Test
Operate and Manage Store
![Page 10: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/10.jpg)
![Page 11: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/11.jpg)
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service
Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models
Software as a Service
Platform as a Service
Infrastructure as a Service
![Page 12: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/12.jpg)
Continuity
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
Standards
143
![Page 13: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/13.jpg)
Continuïty
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
StandardsPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 14: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/14.jpg)
14
Other customers
YOUR
Operational Profile
YOUR
Operational Profile
PLUS
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 15: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/15.jpg)
15
Everything over the web
The idea:
“it’s safe”
Home ground for
hackers
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 16: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/16.jpg)
16
Bring Your Own Device
No free choice of
device.
No control.
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 17: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/17.jpg)
17
Updates, patches, fixes, …
Planned and
controlled
Do I have a
choice?
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 18: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/18.jpg)
18
Where is my data?
And is that OK?
In house.
Somewhere…
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 19: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/19.jpg)
19
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 20: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/20.jpg)
20
Testing?
Check
Review
Trial
Interview
Proof of concept
![Page 21: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/21.jpg)
21
Testing!
Check
Review
Trial
Interview
Proof of conceptTestenProefIntake
InterviewProof of concept
![Page 22: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/22.jpg)
22
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
TestenProefIntake
InterviewProof of concept
![Page 23: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/23.jpg)
23
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 24: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/24.jpg)
24
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 25: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/25.jpg)
25
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 26: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/26.jpg)
26
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
Architecture
From “individual” risks
to
“individual” test measures
![Page 27: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/27.jpg)
27
Selection
Implementation
Production
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 28: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/28.jpg)
28
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 29: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/29.jpg)
29
Selection Criteria
Proof of Concept
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 30: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/30.jpg)
30
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 31: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/31.jpg)
31
Known measures
tuned and tweaked
New measures developed
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 32: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/32.jpg)
32
Load Testing
YOUR
Operational Profile
YOUR
Operational Profile
PLUS
ACTUAL MOMENT
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 33: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/33.jpg)
33
Elasticity
Load and stress.
Load and elasticity.
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 34: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/34.jpg)
34
load
load test – ‘up’
extend?
200
charged100
charged
no
yes
path test
4
99
100
101
boundary values
‘up’
tc 1: use=99, pay 100
tc 2: use=100, pay 100
tc 3: use=101, pay 200
‘down’
tc1: use=101, pay 200
tc2: use=100, pay 100
tc3: use=99, pay 100
boundary values
load test – ‘down’
![Page 35: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/35.jpg)
35
Any device – any platform
Multiplatform
testing.
Multiplatform
testing.
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 36: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/36.jpg)
36
3997 distinct Android devices
http://opensignal.com/reports/fragmentation.php
![Page 37: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/37.jpg)
37
Internet Explorer 6
Internet Explorer 7
Internet Explorer 8
Firefox 3.5
Firefox 3.6
Firefox 4
Safari 4
Safari 5
Chrome11
Opera11
Windows XP
Windows Vista
Windows 7
Windows 2003 Server
Windows 8
Windows CE
Linux
Unix
Mac OS Lion
Mac OS Snow Leopard
iOS
Android
Operating systems
Browsers
Multi-platform testing
Devices
Computer
Mobile phones
Tablet
PC
Macintosh
SUN
NOKIA …
Samsung …Windows Mobile
iPhone ...
…
MOTOROLA …
Blackberry …
ASUS ...
…
![Page 38: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/38.jpg)
38
Any device – any platform
Multiplatform
testing.
Multiplatform
testing.
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 39: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/39.jpg)
39
Legislation + Regulations
=
Test basis
Incidental testing.
Compliancy testing.
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 40: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/40.jpg)
40
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
![Page 41: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/41.jpg)
41
Continuous
End-to-End Test
Functionals
and
non-functionals
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
![Page 42: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/42.jpg)
Continuity
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
Standards
Check
Intake
Trial
Interview
Proof of concept
![Page 43: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/43.jpg)
43
Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
Suppliers and outsourcing
risks
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
Testing during selection
Architecture
From “individual” risks
to
“individual” test measures
Testing starts earlier
Testing scope is widened
Testing will never stop
![Page 44: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/44.jpg)
44
ISBN 978-1-937538-38-5
![Page 45: Going Cloudy? How to test SaaS? with Kees Blokland](https://reader034.fdocuments.in/reader034/viewer/2022042714/554a07ffb4c905507a8b564f/html5/thumbnails/45.jpg)
Thanks for listening!
@esconfs#esconfs
www.eurostarconferences.com
Go to www.eurostarconferences.com for more information