Testing cloud computing - wenku.uml.com.cn
43
Transcript of Testing cloud computing - wenku.uml.com.cn
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Self service provisioning, pay-per-use
No human interaction
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Standard mechanisms over networks
“Any” client
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Multi-tenant
Storage, processing, memory, virtual machines, …
Location independent
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Rapid scale in and out
“Any quantity” at any time
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service
Controlled resource use
Transparency, pay-per-use
US: National Institute of Standards and Technologyhttp://www.nist.gov
Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Measured service
Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models
Software as a Service
Platform as a Service
Infrastructure as a Service
Continuity
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
Standards
143
Continuïty
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
StandardsPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
11
Other customers
YOUR
Operational Profile
YOUR
Operational Profile
PLUS
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
12
Everything over the web
The idea:
“it’s safe”
Home gound for
hackers
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
13
Bring Your Own Device
No free choice of
device.
Endless
possibilities.
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
14
Backup and recovery
Taken care of.
Who will support
me?
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
15
Updates, patches, fixes, …
Planned and
controlled
Do I have a
choice?
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
16
Where is my data?
And is that OK?
In house.
Somewhere…
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
17
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
18
Testing?
Check
Intake
Trial
Interview
Proof of concept
19
Testing!
Check
Intake
Trial
Interview
Proof of conceptTestenProefIntake
InterviewProof of concept
20
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
TestenProefIntake
InterviewProof of concept
21
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
22
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
23
Performance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
24
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Architecture
From “individual” risks
to
“individual” test measures
25
Selection
Implementation
Production
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
26
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
27
Selection Criteria
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
28
Proof of Concept
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
29
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
30
Known measures
tuned and tweaked
New measures developed
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
31
Load Testing
YOUR
Operational Profile
YOUR
Operational Profile
PLUS
ACTUAL MOMENT
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
32
Online – Offline
Use case testing.
Global testing.
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
33
Any device – any platform
Multiplatform
testing.
Multiplatform
testing.
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
34
Internet Explorer 6
Internet Explorer 7
Internet Explorer 8
Firefox 3.5
Firefox 3.6
Firefox 4
Safari 4
Safari 5
Chrome11
Opera11
Windows XP
Windows Vista
Windows 7
Windows 2003 server
Windows 8
Windows CE
Linux
Unix
Mac OS Lion
Mac OS Snowleopard
iOS
Android
Operating Systems
Browsers
Multiplatform
Devices
Computer
Mobile
Tablet
PC
Macintosh
SUN
NOKIA …
Samsung …Windows Mobile
iPhone ..
Xxx …
MOTOROLA…
Blackberry…
ASUS..
Xxx …
35
Any device – any platform
Multiplatform
testing.
Multiplatform
testing.
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
36
Legislation + Regulations
=
Test basis
Incidental testing.
Compliancy testing.
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
37
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
38
Continuous
End-to-End Test
Functionals
and
non-functionals
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
s
Continuity
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
Standards
Check
Intake
Trial
Interview
Proof of concept
Continuity
Privacy
Multi platform
Legislation
Cyber crime
Impact organisation
Standards
Check
Intake
Trial
Interview
Proof of concept
41
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Architecture
From “individual” risks
to
“individual” test measures
Test starts earlier
Test scope is widened
Test will never stop
42
Performance Testing
Security Testing
Manageability Testing
Availability & Continuity
Testing
Functional Testing
Migration Testing
Testing caused by
Legislation & Regulations
Testing in Production
Testing during SelectionT
es
t Me
as
ure
sPerformance
Security
Availability & Continuity
Functionality
Manageability
Legislation & Regulations
Suppliers & OutsourcingRis
ks
Questions?
Details (Dutch):
Questions:[email protected]
Thank you!
43
About the speaker
Jeroen MengerinkPolteq Test Services, The Netherlands
[email protected] - http://www.polteq.com
Jeroen works as a test consultant for Polteq. Next to his work for
clients, he is involved in various test innovations. His main area of
expertise is Agile, for which he is the person to talk to within
Polteq. Jeroen teaches several test courses, e.g. about Agile, SOA
and Cloud. He has recently finished the book and approach
Cloutest® on how to test when cloud computing is involved.
