Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next...
Transcript of Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next...
PRESENTATION TITLE GOES HERE
Next Generation Data Centers: Hyperconverged Architectures Impact On Storage
Mark O’Connell Distinguished Engineer
EMC
2 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Abstract
A modern data center typically contains a number of specialized storage systems which provide centralized storage for a large collection of data center applications. These specialized systems were designed and implemented as a solution to the problems of scalable storage, 24x7 data access, centralized data protection, centralized disaster protection strategies, and more. While these issues remain in the data center environment, new applications, new workload profiles, and the changing economics of computing have introduced new demands on the storage system which drive towards new architectures, and ultimately towards a hyperconverged architecture. After reviewing what a hyperconverged architecture is and the building blocks in use in such architectures, there will be some predictions for the future of such architectures.
3 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Learning Objectives What is a hyperconverged architecture How hyperconverged architectures differ from traditional architectures What technologies are being used to build hyperconverged architectures What workloads are appropriate for hyperconverged architectures
4 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Definition
Hyper-convergence (hyperconvergence) is a type of infrastructure system with a software-centric architecture that tightly integrates compute, storage, networking and virtualization resources and other technologies from scratch in a commodity hardware box supported by a single vendor
http://searchvirtualstorage.techtarget.com/definition/hyper-convergence
5 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Converged vs Hyperconverged
Converged infrastructures Multi-protocol NAS boxes Combined block/file with iSCSI
Hyperconverged SW defined Client and server run together
6 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Why Hyperconverged
If it’s so good, why haven’t we been
using it all along?
7 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Classical architecture
Source: http://www.snia.org/education/storage_networking_primer/san/what_san
8 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Classical architecture
Source: http://www.snia.org/education/storage_networking_primer/san/what_san
9 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Classical architecture
Speed limited Scaling SPs expensive Inefficient at small scale DR makes overall utilization worse
10 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Scale-out storage architecture
Commodity nodes, commodity drives Failure impact? Need to go faster?
11 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Enterprise scale-out systems
2002 2008 2014 2011 2007
12 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Scale-out systems: Internal architecture
12
Acc Stor A S A S A S A S A S ETH/IB
13 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Scale-out systems: Expansion
13
Acc Stor A S A S A S A S A S
A S A S A S A S A S A S
ETH/IB
14 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Scale-out systems: 2nd expansion
14
A S A S A S A S A S A S
Acc Stor A S A S A S A S A S
A S A S A S A S A S A S
ETH/IB
15 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
There’s more than just storage
Source: http://www.snia.org/education/storage_networking_primer/san/what_san
16 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Evolution of the application platform
16
17 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Evolution of the application platform
17
18 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app app app app app app app app app app app app
Virtualized application farm
18
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
ETH/IB
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
VM VM VM VM VM VM VM VM VM VM VM VM
19 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app app app app app app
Virtualized application farm
19
app
VM
app
VM
app
VM
ETH/IB
app
VM
app
VM
app
VM
VM VM VM VM VM VM
Storage
20 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app app app app app app
Application farms with Scale-out storage
20
app
VM
app
VM
app
VM
ETH/IB
app
VM
app
VM
app
VM
VM VM VM VM VM VM A S A S A S
A S A S A S
A S A S A S
Application farm Scale-out storage
21 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
app
VM
app
VM
app
VM
app
VM
app
VM
app
VM
app app app app app app
Why two server farms? Hyperconverge!
21
app
VM
app
VM
app
VM
ETH/IB
app
VM
app
VM
app
VM
VM VM VM VM VM VM A S A S A S
A S A S A S
A S A S A S
Application farm Scale-out storage
22 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Early Hyperconverged system
22
ETH/IB
Task HDFS Task HDFS Task HDFS
Task HDFS Task HDFS Task HDFS
Task HDFS Task HDFS Task HDFS
Scale-out storage
JVM JVM JVM
JVM JVM JVM
JVM JVM JVM
23 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Effects of Hyperconverged systems: Elasticity
Elasticity in scaling overall environment
4U 60 DISKS
2U 4 NODES
MIXED BLOCK
2U 4 NODES
2U 4 NODES
4U 60 DISKS
4U 60 DISKS
4U 60 DISKS
4U 60 DISKS
2U 4 NODES
DENSE BLOCK
APP BLOCKS
HIGHER IOP
LOWER IOP
24 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Effects of Hyperconverged systems App management
ETH/IB
A S A S A S
A S A S A S
A S A S A S
25 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Effects of Hyperconverged systems: Storage provisioning
Application frameworks will provision for apps Drive adoption of standard provisioning mechanisms Pure service architecture for storage
26 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Effects of Hyperconverged systems: Hybrid cloud enablement
Apps are now a self-describing bundle Storage is a dynamically bound service Enable movement on-prem/off-prem
27 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Summary
Hyperconvergence is the result of ongoing industry trends Hyperconvergence will drive
Application management frameworks Standardized provisioning Hybrid cloud
27
28 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Questions?
29 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Backup slides
30 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
What’s coming?
Scale and multi-sized building blocks Elasticity of building systems
App management Containers Kubernetes etc More complex app farms
OpenStack, containers, provisioning – standard provisioning Service architecture across B, F, O Hybrid cloud bridge? 30
31 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 31
A Stor A S A S A S A S A S
Acc S A S A S A S A S A S ETH/IB
32 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 32
app
A Stor
app
A S
app
A S
app
A S
app
A S
app
A S
app
Acc S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
app
A S
ETH/IB
33 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Enterprise scale-out systems
2002 2008 2014 2011 2007
34 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Enterprise scale-out systems
2002 2008 2014 2011 2007
35 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.
Enterprise scale-out systems