EuroStar Webinar Testing Cloud Services Kees Blokland
-
Upload
kees-blokland -
Category
Technology
-
view
59 -
download
1
description
Transcript of EuroStar Webinar Testing Cloud Services Kees Blokland
![Page 1: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/1.jpg)
Welcome to the 2013
www.eurostarconferences.com
This webinar is presented by Kees Blokland and he will discuss:
‘Going Cloudy? How to test SaaS?’
Join us on Twitter! @esconfs #esconfs
![Page 2: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/2.jpg)
Going Cloudy?How to test SaaS?
Kees BloklandPolteq Test Services BV
The Netherlands
![Page 3: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/3.jpg)
3
ISBN 978-1-937538-38-5
![Page 4: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/4.jpg)
![Page 5: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/5.jpg)
searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, talking, designing, making, verifying, measuring
![Page 6: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/6.jpg)
6
EmailSurfTransfer
Develop and Test
Operate and Manage Store
![Page 7: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/7.jpg)
7
EmailSurfTransfer
Develop and Test
Operate and Manage Store
storage claim
80% unused
redundancy, proliferation limitations
environmentally unfriendly
![Page 8: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/8.jpg)
8
EmailSurfTransfer
Develop and Test
Operate and Manage Store
standard software bandwidth
internet technology
virtualization
SOA
![Page 9: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/9.jpg)
9
searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring
EmailSurfTransfer
Develop and Test
Operate and Manage Store
![Page 10: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/10.jpg)
![Page 11: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/11.jpg)
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service
Deployment models– private cloud– community cloud– public cloud– hybrid cloud
Service Models
Software as a Service
Platform as a Service
Infrastructure as a Service
![Page 12: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/12.jpg)
Security
Continuity
Costs
Integration
Performance
Privacy
Testability
Multi platform Migration
Legislation
Vendor lock-in
Location
B.Y.O.D.
Cyber crime
User experience
Elasticity
Offline vs Online
Backup & recovery
Energy saving
Anywhere, anytimeMulti vendor
HostingImpact organisation
Standards
143
![Page 13: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/13.jpg)
Security
Continuïty
Costs
Integration
Performance
Privacy
Testability
Multi platform Migration
Legislation
Vendor lock-in
Location
B.Y.O.D.
Cyber crime
User experience
Elasticity
Offline vs Online
Backup & recovery
Energy saving
Anywhere, anytimeMulti vendor
HostingImpact organisation
StandardsPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 14: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/14.jpg)
14
Other customers
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
YOUROperational Profile
YOUROperational Profile
PLUS
![Page 15: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/15.jpg)
15
Everything over the web
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
The idea:“it’s safe”
Home ground for hackers
![Page 16: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/16.jpg)
16
Bring Your Own Device
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
No free choice of device.
No control.
![Page 17: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/17.jpg)
17
Updates, patches, fixes, …
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
Planned and controlled
Do I have a choice?
![Page 18: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/18.jpg)
18
Where is my data?
And is that OK?
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
In house.
Somewhere…
![Page 19: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/19.jpg)
19
Performance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 20: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/20.jpg)
20
Testing?
Check
Audit
IntakeSimulation
Inspections
Review
Assessment
Trial
Validate
Interview
Proof of concept
Test
Shadow run
……
![Page 21: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/21.jpg)
21
Testing!
Check
Audit
IntakeSimulation
Inspections
Review
Assessment
Trial
Validate
Interview
Proof of concept
Test
Shadow run
……
TestenAuditReview
SimulatieInspectiesProef
AssessmentIntakeToetsen
InterviewProof of conceptControleSchaduwdraaien……
![Page 22: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/22.jpg)
22
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
TestenAuditReview
SimulatieInspectiesProef
AssessmentIntakeToetsen
InterviewProof of conceptControleSchaduwdraaien……
![Page 23: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/23.jpg)
23
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 24: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/24.jpg)
24
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 25: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/25.jpg)
25
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 26: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/26.jpg)
26
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
Architecture
From “individual” risksto
“individual” test measures
![Page 27: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/27.jpg)
27
Selection
Implementation
Production
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
![Page 28: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/28.jpg)
28
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 29: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/29.jpg)
29
Selection Criteria
Proof of Concept
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
![Page 30: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/30.jpg)
30
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 31: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/31.jpg)
31
Known measurestuned and tweaked
New measures developed
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
![Page 32: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/32.jpg)
32
Load Testing
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
YOUROperational Profile
YOUROperational Profile
PLUSACTUAL MOMENT
![Page 33: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/33.jpg)
33
Elasticity
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
Load and stress.
Load and elasticity.
![Page 34: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/34.jpg)
34
load
load test – ‘up’
extend?
200 charged
100charged
no
yes
path test
5-4
99
100
101
boundary values‘up’tc 1: use=99, pay 100tc 2: use=100, pay 100tc 3: use=101, pay 200‘down’tc1: use=101, pay 200tc2: use=100, pay 100tc3: use=99, pay 100
boundary values
load test – ‘down’
![Page 35: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/35.jpg)
35
Any device – any platform
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
Multiplatform testing.
Multiplatform testing.
![Page 36: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/36.jpg)
36
3997 distinct Android devices
http://opensignal.com/reports/fragmentation.php
![Page 37: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/37.jpg)
375-18
Internet Explorer 7
Internet Explorer 8
Firefox 3.6
Firefox 4
Safari 4
Safari 5
Chrome11
Opera11
Windows XP
Windows Vista
Windows 7
Windows 2003 Server
Windows 8
Windows CE
Linux
Unix
Mac OS Lion
Mac OS Snow Leopard
iOS
Android
Operating systems
Browsers
Multi-platform testing
Devices
Computer
Mobile phones
Tablet
PC
Macintosh
SUN
NOKIA …
Samsung …
Windows Mobile
iPhone ...
MOTOROLA …
Blackberry …
ASUS ...
![Page 38: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/38.jpg)
38
Legislation + Regulations
=
Test basis
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
Incidental testing.
Compliancy testing.
![Page 39: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/39.jpg)
39
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
![Page 40: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/40.jpg)
40
ContinuousEnd-to-End Test
Functionalsand
non-functionals
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selection
![Page 41: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/41.jpg)
Security
Continuity
Costs
Integration
Performance
Privacy
Testability
Multi platform Migration
Legislation
Vendor lock-in
Location
B.Y.O.D.
Cyber crime
User experience
Elasticity
Offline vs Online
Backup & recovery
Energy saving
Anywhere, anytimeMulti vendor
HostingImpact organisation
Standards
Check
Audit
Review
Simulation
Inspections
Intake
Assessment
Trial
Validate
Interview
Proof of concept
Test
Shadow run
……
![Page 42: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/42.jpg)
42
Performance testing
Security testing
Testing for manageability
Availability and continuity testing
Functional testing
Migration testing
Testing caused bylegislation and regulations
Testing in production
Testing during selectionPerformance risks
Security risks
Availability and continuity risks
Functionality risks
Maintainability risks
Legislation and regulations risks
Suppliers and outsourcing risks
Architecture
From “individual” risksto
“individual” test measures
Testing starts early: in selection
Scope of testing is widened
Testing continues in production
![Page 43: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/43.jpg)
43
ISBN 978-1-937538-38-5
![Page 44: EuroStar Webinar Testing Cloud Services Kees Blokland](https://reader033.fdocuments.in/reader033/viewer/2022051413/554a06d7b4c905e56c8b571d/html5/thumbnails/44.jpg)
Thanks for listening!
@esconfs#esconfs www.eurostarconferences.com
Go to www.eurostarconferences.com for more information