Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important...
Transcript of Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important...
![Page 1: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/1.jpg)
Integration of Cloud Computing and Cloud Storage
Chief Scientist ,Renaissance Computing InstituteAdjunct Prof. Computer Science, NC State University
IEEE Mass Storage Conference TutorialMay 3, 2010
![Page 2: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/2.jpg)
Outline
• Introduction to Cloud Computing
• Building a cloud computing architecture– Properties for a cloud
– Types of clouds
– Building images in a cloud
– Designing a cloud system
• Large data sets and analysis requirements
• Cloud Computing Demo
• Closing remarks
![Page 3: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/3.jpg)
Level of General Interest in Cloud Computing
![Page 4: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/4.jpg)
So many choices…
![Page 5: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/5.jpg)
“The interesting thing about cloud computing is that we've redefined cloud computing to include everything that we already do…. I don't
understand what we would do differently in the light of cloud computing other than change the wording of some of our ads.”
Larry Ellison CEO Oracle
![Page 6: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/6.jpg)
Some Important Characteristics in Building Cloud Computing Architectures
![Page 7: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/7.jpg)
Start with Basic General Design GoalsFor Any System
• Rapid efficient delivery of IT services
• Reliable, secure, and fault-tolerant
• Data and process aware services
• Secure dropped-session recovery
• More efficient delivery to remote users
• System is cost-effective to operate and maintain• On-demand or batch processing capabilities
• Removal of conflicts among supported software applications– Incompatible versions
– Inconsistent upgrade patterns among different locations
– User issues with obtaining and using the software
![Page 8: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/8.jpg)
Add Basic General Design GoalsFor A Cloud Computing System
• Ability for users to request specific HW platforms to build, save, modify, run virtual computing environments and applications that are: – Reusable
– Sustainable
– Scalable
– Customizable
• Timely inclusion of new software images
• Root privileges (as required/authorized)
• Time and place independent access
• Full functionality via consumer devices and platforms
![Page 9: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/9.jpg)
A List of Some Important CharacteristicsFor a Cloud Computing System
• An operational paradigm allowing the users to seamlessly and securely provision and/or combine– Computer hardware– Operating systems– Application software– Storage– Rich set of customizable services
• As a system that is scalable up, down, in, and out– With resources accessible over a network– Based on a service-oriented architecture
• With users controlling the options to purchase, lease or reserve each equipment and service capability on a mix-n-match component or unit basis
![Page 10: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/10.jpg)
A List of Some Important CharacteristicsFor a Cloud Computing System
• An operational paradigm allowing the users to seamlessly and securely provision and/or combine– Computer hardware– Operating systems– Application software– Storage– Rich set of customizable services
• As a system that is scalable up, down, in, and out– With resources accessible over a network– Based on a service-oriented architecture
• With users controlling the options to purchase, lease or reserve each equipment and service capability on a mix-n-match component or unit basis
![Page 11: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/11.jpg)
Some Definitions -- Cloud Types• Public Cloud is a system where hardware, software and/or
application services are accessible to the general publicover the Internet with access usually purchased on some type of a pay-as-you-go per component usage basis
• Private Cloud is a system where computational hardware, software, and/or applications and software services are only accessible internally within an organization or educational institution
• Hybrid Cloud is a private cloud that scales up service availability by externally provisioning resources from a public cloud when there are rapid workload fluctuations or hardware failures.
![Page 12: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/12.jpg)
Cloud Computing Images -A Key Concept
• The combination of the operating system, applications and customizable software forms an “image”
• An “image” is a tangible abstraction of a software stack
• Ingredients needed to create an image
– Any base-line operating system
– If virtualization is needed for scalability, a hypervisor layer
– Any desired middleware or application that runs on that operating system
– Any end-user access solution that is applicable
![Page 13: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/13.jpg)
Some Metadata Describing an Image– Identifier
– Location
– Name
– Owner
– Memory footprint
– Speed of access information
– Licensing information
– Hardware requirements
– Loading time
– Access permissions
![Page 14: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/14.jpg)
Some Image Properties
• Images can be associated into logical image groups
– Mapped onto a particular logical resource (“hardware”) groups
– Mapped onto individual computers
• Association of the meta-data with an image is made primarily via a data-base
![Page 15: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/15.jpg)
Types of Images • Simple Virtual or Bare Metal Images
– Simple Virtual Image: image loaded into an operating system/application virtual environment of choice
– Bare-metal image: operating system and application stack loaded straight onto the hardware without any other software layer between the image and that target hardware.
• Composite Images– Composite images are aggregates of two or more
images that are loaded synchronously (called environments)
– Composite images can construct “virtual clouds” and cloud services
![Page 16: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/16.jpg)
Traditional Versus Cloud ComputingSome Comparisons of Technical Characteristics
Traditional
• Control of resource use managed by the site
• Site-specific environment
• Site defines modes of access
• Site-driven prioritization
• Ease of deployment for provider, constraints on user
• Site controls the technology
Cloud
• Control of resource use managed by the user
• User defines site environment
• User defines modes of access
• Explicit user choices for service level options & prioritization
• More difficult deployment for provider, ease of use for user
• Users control the technology
![Page 17: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/17.jpg)
Clouds Grouped by Services • Hardware as a Service (HaaS) – On demand access to a specific
equipment configuration possibly at a particular site• Infrastructure as a service (IaaS) – On demand access to user
specified hardware capabilities, performance and services which may run on a variety on hardware products
• Platform as a Service (PaaS) - On-demand access to user specified combination of hypervisors, operating systems and middleware that enables applications and services
• Application as a Service (AaaS) - On-demand access to user specified application(s)
• Software as a Service (SaaS) - may encompass anything from PaaS through AaaS
• Cloud as a Service – On demand ability to construct a local cloud within an overall cloud service
• Security as a Service – On-demand use of cloud configuration for security of applications and systems
![Page 18: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/18.jpg)
Cloud Services and Cloud Architectures
• Cloud architecture abstracts resources at several levels– Application and operating system level via images
and hypervisors
– Hardware location level via compute manager and compute nodes
– Network level (via virtual networks, VLANs, VPNs)
• Each cloud service type needs an architecture that will optimize that type of service delivery
![Page 19: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/19.jpg)
IaaS PaaS
SaaS
![Page 20: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/20.jpg)
Managing server handles •User requests•Resource scheduling•Authorization•Security•Multi-site coordination•Performance monitoring•Virtual network mgt•Software licensing etc.,
Database Web software ApacheProvisioning engineCustom CC codes
Utilities
Infrastructure as a Service (IaaS)Hardware as a Service (HaaS)
![Page 21: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/21.jpg)
X-Win
RDP
Client apps
Workflow
Operating System (Win, Linux)
Virtual layer VMWare KVM Xen
Applications
Operating System (Win, Linux)
Applications
IaaS/HaaS Logical Architecture
Image Repository
Database Web software ApacheProvisioning engineCustom CC codes
Utilities
![Page 22: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/22.jpg)
Scheduler finds a server with the requested application or has management node load requested application on a server
Image Repositories
Management nodes
Operating systemImage repositories ComputationStorageNetworking
![Page 23: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/23.jpg)
![Page 24: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/24.jpg)
![Page 25: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/25.jpg)
![Page 26: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/26.jpg)
![Page 27: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/27.jpg)
![Page 28: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/28.jpg)
High Performance Computing Option
28
![Page 29: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/29.jpg)
HPC Configuration
• In the education and research space it is possible to design dynamic hardware reconfiguration of a cloud computing system
• Identify sporadic usage patterns and re-purpose cloud hardware between distributed and HPC usage
![Page 30: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/30.jpg)
Image RepositoriesHPC cluster
Login node
Storage
![Page 31: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/31.jpg)
Image RepositoriesHPC cluster
Login node
Storage
![Page 32: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/32.jpg)
Image RepositoriesHPC cluster
Login node
Storage
![Page 33: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/33.jpg)
Integrating Cloud Computing and HPC
![Page 34: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/34.jpg)
Periodic Sporadic Usage North Carolina State – Student system Usage Patterns 9/04 – 9/09
![Page 35: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/35.jpg)
NC State HPC Usage patterns 5/08 – 5/09
![Page 36: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/36.jpg)
Dynamic Blade – Server Re-Configuration
• Insert multiple NICs in the blades or servers
• Build multiple VLANs (non-routing IPs) to – Control the out of band management network
– Access/load images from the image repository
• Create either – A public (routable) IP connection
– VLAN together a cluster of blades / servers
– Block reserve group of machines for HPC (depending on IB, Myrinet, or 10 GigE config)
![Page 37: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/37.jpg)
Platform as a Service (PaaS)Characteristics
• Computing platform and solution stack as a service
• Program the cloud, but at a relatively high level, such as Web Services and delivery of web-based applications
• development platforms with the development tool itself hosted in the cloud and accessed through a browser
![Page 38: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/38.jpg)
Platform as a Service (PaaS)Software as a Service (SaaS)
Application as a Service (AaaS)
![Page 39: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/39.jpg)
Compute Storage
Fabric
Platform as a Service (PaaS)Architecture
![Page 40: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/40.jpg)
Platform as a Service(PaaS)
Applications User Data
Data Center
![Page 41: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/41.jpg)
Other Cloud Services
• Application as a Service and Software as a Service– Both specific cloud services focused on particular
software application(s)
– Extension of existing application stack already running on the local site (more toward business applications)
• Cloud as a Service – construction of entire cloud architecture within a larger cloud computing system
![Page 42: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/42.jpg)
Data Sets and Repositories
• Computational capability needed to process and analyze the data
• Transform data into useful information
• Two options
– Push the data to the computational system
– Bringing the computational system to the data
![Page 43: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/43.jpg)
Large Data Sets and Analysis Requirements
• Data set itself
– Location
– Size
• Multiple dimensions to consider
– Technical
– Operational
– Economic
![Page 44: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/44.jpg)
LocationBalancing Storage and Computation
• Where should the data be located and where should the computations be performed?
• Two potential options
– Option 1 - traditional approach is to move all/part of the data to the computational system
– Option 2 –move the computation near the data repository
![Page 45: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/45.jpg)
Size of the Data Sets
• Number and size of data repositories are expanding
– Rate of data collection increasing
– Aggregate expansion of the total size of the data
• Compare the network bandwidth growth to the growth in the size of data repositories
![Page 46: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/46.jpg)
Aug 1990100
GBy/mo
Oct 1993
1 TBy/mo Jul
199810
TBy/mo
Nov 2001100
TBy/mo
Apr 2006
1 PBy/m
o
ESnet Traffic Increases by10X Every 47 Months, on Average
Observation of Current and Historical ESnet Traffic PatternsTe
rab
ytes
/ m
on
th
Log Plot of ESnet Monthly Accepted Traffic, January 1990 – June 2009
Courtesy of William Johnston, LBL
Actual volume for Jun 2009: 4.3 Petabytes/month
Projected volume for Jun 2010: 8.6 Petabytes/month
![Page 47: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/47.jpg)
y = 2.3747e0.5714x
y = 0.4511e0.5244x
y = 0.1349e0.4119x
y = 0.8699e0.6704x
0
1
10
100
1000
10000
100000
1000000
10000000
100000000Ja
n, 9
0
Jan
, 91
Jan
, 92
Jan
, 93
Jan
, 94
Jan
, 95
Jan
, 96
Jan
, 97
Jan
, 98
Jan
, 99
Jan
, 00
Jan
, 01
Jan
, 02
Jan
, 03
Jan
, 04
Jan
, 05
Jan
, 06
Jan
, 07
Jan
, 08
Jan
, 09
Jan
, 10
Jan
, 11
Jan
, 12
Jan
, 13
Jan
, 14
Jan
, 15
ESnet traffic
HEP exp. data
ESnet capacity
Climate modeling data
Expon. (ESnet traffic)
Expon. (HEP exp. data)
Expon. (ESnet capacity)
Expon. (Climate modeling data)
2010 value
xx
40 Pby
xx
4 Pby
Network Traffic, Science Data, and Network Capacity
Long-term trends
HistoricalProjection
All
Fou
r D
ata
Seri
es
are
No
rmal
ize
d t
o “
1”
at J
an. 1
99
0 2010 value
--
40 PBy
--
4 PBy
(HEP data courtesy of Harvey Newman, Caltech, and Richard Mount, SLAC. Climate data courtesy Dean Williams, LLNL, and the Earth Systems Grid Development Team.)
Courtesy of William Johnston, LBL
![Page 48: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/48.jpg)
Size of the Data Sets
• Best performance from the current ESnet traffic patterns is approximately 8.6 Pbytes/month (total throughput)
• Single user may get 20% sustained bandwidth or approximately 1.75 Pbytes/month
• Moving a full data repository of 100 Pbytes may take on the order of 57 months!
• Moving only 1% may take several weeks!• Size of a fully constructed cloud computing image
may be approximately several Gbytes and take fractions of a second to transfer between locations
![Page 49: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/49.jpg)
“Instead of pushing the data to the cloudBring the cloud to the data
What is needed to make this happen?
![Page 50: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/50.jpg)
Desirable Cloud Computing and Storage Technical Properties
• Portability – ability to move cloud computing job among different computational systems
• Interoperability – ability to run cloud job among different computational systems
• Scalability– Up and down – ability to have cloud computing hob
access different generations of similar hardware architecture
– In and out – ability to expand or contract the size of a cloud computing job on a specific hardware generation architecture
![Page 51: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/51.jpg)
Cloud Computing and StorageSome Operational Issues/Observations
• Software licensing agreements at each cloud computing location– Multi-institution
– Multi-site cloud installations
• Service Level Agreements
• Security - privacy and sensitive data
• Data and application audits
• Terms and conditions (Master Service Agreement, click-wrap EULAs, distribution of risks)
![Page 52: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/52.jpg)
Demo
• Cloud computing demonstration
– User interface
– Access to the image repository
– Computation options
– Example session
![Page 53: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/53.jpg)
Some Closing RemarksCloud Computing and Storage
• Cloud computing (CC) is a disruptive paradigm in several dimensions– Technical– Economic – Education– Research
• There is an intertwining among these dimensions that must be observed when constructing cloud computing
• CC is actually having the largest impact in the business and commercial sector
• The majority of cloud services developed are directed to business applications – not STEM projects and research
![Page 54: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/54.jpg)
Some Closing RemarksCloud Computing and Storage
• Not everything is best optimized by migrating a cloud computing image to the data repository
• What are the proper decision criteria when and where to locate computation and storage
• Which leads to the second part of the tutorial
Policy-based Data Management – Reagan Moore
![Page 55: Integration of Cloud Computing and Cloud Storage...Larry Ellison CEO Oracle Some Important Characteristics in Building Cloud Computing Architectures Start with Basic General Design](https://reader033.fdocuments.in/reader033/viewer/2022053118/609e5a582ef80b144f71d155/html5/thumbnails/55.jpg)
Questions