An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An...
Transcript of An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An...
![Page 1: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/1.jpg)
An Industrial View of Storage,
Cloud Computing, and Big Data Cloud Computing, and Big Data
Development
Version: 1.5
12/11/2013 1
![Page 2: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/2.jpg)
Cloud Computing Looking Back (2011–2013) Looking Back (2011–2013)
12/11/2013 2
![Page 3: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/3.jpg)
Back In Beginning of 2011
� Amazon AWS dominated the public cloud world, with some
second tiers like Rackspace, GoGrid, competing
� Open (Web) Cloud camp, Cloudstack (Citrix), Openstack, etc.,
came on scene and thought they will dominate the world
� Big Data will be every where and storage vendors will
benefit big time from Big Data adoptionbenefit big time from Big Data adoption
� Storage cloud became popular with Dropbox service and
new entries from big and small vendors just showing up
12/11/2013 3
![Page 4: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/4.jpg)
Now End Of 2013
� Amazon AWS dominated the public cloud world
� AWS continues dominating the public cloud space
� Big guns such as Google and VMware are moving in to compete
� Second tiers SP’s such as Rackspace, GoGrid are in danger of loosing ground
due to economics of scale
� Not many public cloud service providers, including new entries from Telco’s,
based on incumbent technologies are making moneybased on incumbent technologies are making money
� Open/Web Cloud camp, Cloudstack (Citrix), Openstack, etc.,
came on scene and thought they will dominate the world
� Open/Web cloud has made significant inroads in public cloud for new wave
applications such as Web and mobile (Baidu, Sina, etc.)
� Some incumbents such as VMware, ATT, and HP, are betting on two horses,
their proprietary and Open/Web clouds (all Openstack based)
� Adoption of Open/Web cloud for enterprise applications has been slow.
Incumbents continue their dominance within enterprise
12/11/2013 4
![Page 5: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/5.jpg)
Now End Of 2013
� Big Data will be every where and storage vendors will
benefit big time from Big Data
� The adoption of Big Data has been relatively slow
� Storage vendors still try to find a way to make storage relevant to Big
Data
� Storage cloud became popular with Dropbox service and
new entries from big and small vendors just showing upnew entries from big and small vendors just showing up
� Dropblox becomes an analogy of storage cloud and continues its
dominance; 50M users in 2011, 100M users in 2012, and 200M users
in 2013
� Google Drive, Microsoft SkyDrive, Apple iCloud are sharing smaller
piece of pie
� Smaller storage cloud service providers are loosing ground and
struggling
� All SP’s are moving to look for opportunity in business space 12/11/2013 5
![Page 6: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/6.jpg)
Recent Technology And Market MovementsMarket Movements
12/11/2013 6
![Page 7: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/7.jpg)
Technology Advancements
�Commodity hardware pooling resources
�Virtualization abstracting the resources
�Automation with policy-driven provisioning and
service-level agreement
SDN/SDS – Software Defined Network and Storage
12/11/2013 7
![Page 8: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/8.jpg)
Technology AdvancementSDN – Software Defined Networks
IDS/IPS
SLB
FW
Switch
IDS/IPS
SLB
FW
Switch
Switch
SLB
Virtual Network 2
Virtual Network 1
12/11/2013 8
Spine Switch
Leaf SwitchLeaf Switch
Storage
ServerNetwork Services
ServerServer Server
Storage Storage
Servers ServersSwitch
ServersFW
Physical Network
![Page 9: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/9.jpg)
Technology AdvancementSDS – Software Defined Storage
MemoryCPU
High Performance
VDC with all SSD drives
SSD
MemoryCPU
SATA
Medium Performance
VDC with all SATA drives
High Performance
VDC with mixed drives
MemoryCPU
Mixed
12/11/2013 9Physical Storage Pool
![Page 10: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/10.jpg)
Technology AdvancementsSDDS – Software Defined Data Center)
Cloud Federation
Various Application Clouds
Software-defined Dada Center•All virtualized data center resources
•Virtual server
Private Cloud• Government cloud
• Enterprise cloudPublic Cloud
• Web application
• Mobile application
• Media application
• Storage cloud
• Compute cloud
12/11/2013 10
•Virtual server
•Virtual network
•Virtual storage
Physical Data Center•All x86 commodity hardware
![Page 11: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/11.jpg)
SDDC Example - Media Cloud
Media
Feed
Media
Ingest
Service
Streaming
ServiceVideo
Service
Storage subsystem
Media
Applications Big Data Analytics cloud
12/11/2013 11
Physical
Data
Center
Storage
Virtualization
SDDC
Abstraction
LayerNetwork
Virtualization Server
Virtualization
SDDC Abstraction
MSO
SDDC2
MSO
SDDC1 SDDC3
App
Store
SDDC5
Development/Testing
SDDC4
![Page 12: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/12.jpg)
Incumbent vs. Open/Web Cloud
12/11/2013 12
Source: Cloudscaling
![Page 13: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/13.jpg)
Incumbent and Open/Web Clouds Can Co-
exist Peacefully
12/11/2013 13Source: Cloudscaling
![Page 14: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/14.jpg)
Matching Apps to Infrastructure
12/11/2013 14
Source: Cloudscaling
![Page 15: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/15.jpg)
Big Data And StorageBig Data And Storage
12/11/2013 15
![Page 16: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/16.jpg)
Driving Forces
Social
Networking
Internet of
Web/Mobile
12/11/2013 16
Internet of
Things
Structured
• Database
• Spreadsheet
• File in record format
Semi-structured
• XML Docs
• Logs
• Click-stream
• Equipment/ Device, RFID tag
Unstructured
• Web Pages
• Multimedia
• Instant Messages
• Documents
![Page 17: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/17.jpg)
Challenges And Obstacles
Huge amount of space, both on-
line and second tier storageStorageStorageStorageStorage
Different processing model and
capability with time constrain
ProcessProcess
inging
ProcessProcess
inging
Breaking existing IT infrastructure
Lack of domain expertise and
knowledge
12/11/2013 17
capability with time constraininginginging
New infrastructure setup and
needs management skill and
expertise
ManageManage
mentment
ManageManage
mentment
New tools/workflow for analysisAnalysisAnalysisAnalysisAnalysisIntroducing new business model
and workflow
High CAPEX with uncertain return
knowledge
![Page 18: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/18.jpg)
To Accelerate The Adoption
Public Cloud Solution Need Public Cloud Solution Need To Happen FirstTo Happen First
• Experiment it without high CAPEX investment
• Better understanding of technologies, practice, and potential returns
• More solutions are showing up, including AWS, VMware vCloud, and others
Give time to enterprise for Give time to enterprise for • Most enterprise IT infrastructure still
12/11/2013 18
Give time to enterprise for Give time to enterprise for transitioning IT transitioning IT infrastructureinfrastructure
• Most enterprise IT infrastructure still based on legacy setup; server virtualization along doesn’t cut it
• Storage infrastructure is a big part of it; it is not just for on-line compute; regulation/compliance practice need to be part of movement
Deeper integration solution Deeper integration solution with lower TCO need to with lower TCO need to
happenhappen
• Deeper hardware and software, including platform, analysis, and application, integration
• Much lower TCO
![Page 19: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/19.jpg)
Architecture Questions To Be Answered
� Big Data To Virtualized Environment
� Dedicated Physical Compute Resource
� Low latency and high performance
� Hard to manage and provisioning when offered in public cloud setup
� Virtualized Compute Resource
� Higher latency and lower performance
� Easier to manage and provisioning when offered in public cloud setup� Easier to manage and provisioning when offered in public cloud setup
� DAS or Shared Storage For Big Data
� Direct Attached Storage
� Lower latency and higher performance
� Hard to share raw data and need to duplicate data
� Governance and compliance issues
� Shared Storage
� Higher latency and lower performance
� Easier to share raw data and no need to duplicate data
� Generally fit into existing IT infrastructure for governance and compliance
12/11/2013 19
![Page 20: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/20.jpg)
ConclusionConclusion
12/11/2013 20
![Page 21: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/21.jpg)
Summary
� Multiple Cloud Architectures Will Co-Exist
� Incumbent (Enterprise) cloud for legacy applications
� Open/Web cloud for Web/Mobile applications
� Software defined data center will play a key role, but not the only
solution
� Big Data Will Shine Eventually
� Enterprise IT infrastructure needs to catch up
� Fully integrated solution, from infrastructure to analysis
tools/applications, need to happen
� Storage will be a key factors to lower the cost and accelerate adoption
� Storage Cloud Needs To Move Beyond Storage Space And
Basic File Service
� Provide multiple services, file access, backup, archiving, etc.
� Need to Targeting at Business Opportunity
12/11/2013 21
![Page 22: An Industrial View of Storage, Cloud Computing, and Big ... › 2013cssi_cloud › pm_04.pdf · An Industrial View of Storage, Cloud Computing, and Big Data Development Version: 1.5](https://reader034.fdocuments.in/reader034/viewer/2022042308/5ed409b88d46b66d226354a0/html5/thumbnails/22.jpg)
Thanks & QuestionsThanks & Questions
PROMISE Technology., 2013 22