Slashing the Cost of data storage with high performance NFS based solution for mission critical...
-
Upload
ipexpo-online -
Category
Technology
-
view
486 -
download
5
Transcript of Slashing the Cost of data storage with high performance NFS based solution for mission critical...
Ravi ChalakaSr. Director, Solutions Marketing
Ravi ChalakaSr. Director, Solutions Marketing
Accelerating and Simplifying Storage for vSphere and VMware View
Accelerating and Simplifying Storage for vSphere and VMware View
Traditional
Data Center EvolutionData Center Evolution
Well Understood High Performance Low Utilization
and High Cost
Slide: 2 © 2010 BlueArc Corp. Proprietary and Confidential
Traditional Virtualization Cloud
Consolidation, Flexibility & Low TCO
Pay for what you use
Storage
Network
Servers
Apps
While 57% of organizations have already deployed virtualization, 49% plan to do so - according to an ESG survey in 2009
Storage complexity & performance is one of the major limitation
Challenges with Data Center EvolutionChallenges with Data Center Evolution
Low Utilization and high Cost
Slide: 3 © 2010 BlueArc Corp. Proprietary and Confidential
Storage
Network
Servers
Apps
Security concern & application performance
Traditional Virtualization Cloud
Only 46% of virtualization users currently run “Tier 1 applications” due to user concerns - ESG survey in 2009
Top Challenges related Storage for Virtual Server EnvironmentsTop Challenges related Storage for Virtual Server Environments
4 © 2010 BlueArc Corp. Proprietary and Confidential
Performance
Complexity & Cost
What if You Could …?What if You Could …?
…provide expected user experience for all business critical applications
…simplify scaling storage for VMware vSphere deployments
… deliver horsepower to support millions of random I/Os for 100’s of VMs running mixed workloads
…attain lowest TCO for network storage
…accelerate VMware deployments for higher ROI
5 © 2010 BlueArc Corp. Proprietary and Confidential
wetaDIGITAL
StarBreeze AB
Traditional Storage Architectures have Limited CapabilitiesTraditional Storage Architectures have Limited Capabilities
Traditional storage… … uses manually-intensive operations and makes dynamic environment
difficult to support … is unable to deliver high random I/O performance required by real-
world VMware vSphere mixed workloads … requires specialized storage skills to support SLAs … requires high costs to scale
6 © 2010 BlueArc Corp. Proprietary and Confidential
PhysicalEnvironment
VirtualEnvironment
Why is the problem so hard to fix?Why is the problem so hard to fix?
7
• It’s complex • Complexity exponentially
increases with number of VMware servers
It’s uncertain:• How's performance going
to degrade with 8-10 VMs on single disk I/O queue?
• What if we use RDM instead & later run out of LUNs?
It’s costly:• Expanding touch points
require too many FC SAN specialists
Network
Storage
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VMVM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VMVM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN
HBAs VMFSHBAs
HBAsVMFS
VMFS
RDM IO Queue LUN IDs MultipathRDM
RDMIO Queue
IO QueueMultipath
MultipathLUN IDs
LUN IDs
FC Switches Zones MultipathFC Directors
7 © 2010 BlueArc Corp. Proprietary and Confidential
33% of FC SAN users are considering changing protocols - Global Virtual Server Survey by Forrester Research, Inc.
VMware Storage OptionsVMware Storage Options
8 © 2010 BlueArc Corp. Proprietary and Confidential
LocalStorage
NFS(For NAS)
NetworkStorage
VMFS(For SAN)
RDM(For SAN)
© 2010 BlueArc Corp. Proprietary and Confidential
Storage Options ComparedStorage Options Compared
VMware over SAN
VMware over NAS
VMFS RDM NFSMost common Yes No No
Enables VMware functions Yes No Yes
High scalability per system No No Yes
Avoid manually intensive operations No No Yes
Sustained Performance No Yes Yes
Recommended for 1000s of VMs No Yes Yes
Storage system enabled data protection No Yes Yes
9
10 © 2010 BlueArc Corp. Proprietary and Confidential
Provisioning Storage with SAN vs. NFSProvisioning Storage with SAN vs. NFS
• Set up LUN• Set up RAID set• Assign LUN to VMFS• Virtualize LUN• Assign virtual LUNs to VMs• Thin provision virtual LUNs• Set up FC or iSCSI multi-pathing
• Set up FC switch zones• Set up FC switch hard zones• Set up duplicate SAN & Zones for load balancing & change mgt.• Use Storage
• Set up NFS datastore on NAS• Assign to vCenter • Add network switch• Use Storage
NFS StorageSAN Storage
11 © 2010 BlueArc Corp. Proprietary and Confidential
Capacity Expansion is Simpler with NFSCapacity Expansion is Simpler with NFS
• Increase storage on SAN side
• Increase datastore size
• Including underlying partition
• Rescan each VM connected
individual LUNs to SAN storage
• Resume IO to LUN
• Use newly provisioned storage
• Increase storage on NFS side• Refresh each VM’s storage• Use newly provisioned storage
NFS StorageSAN Storage
Data Center Modernization and Gearing up for cloudData Center Modernization and Gearing up for cloud
NFS is much Simpler than SAN
But is NFS suited for VMware?
12 © 2010 BlueArc Corp. Proprietary and Confidential
Slide: 13 © 2010 BlueArc Corp. Proprietary and Confidential
BUSTEDVMware supported NFS since ESX 3.0
A single NFS system can reach 194K IOPS
NFS is the fastest growing VMware storage
No difference in NFS vs. VMFS loads
8 datastores is default, configurable to 64
Some file systems are 256TB - 16X greater
True in ESX but false in vSphere 4
VMware masks NFS. Windows doesn’t know it is using NFS
Myths About NFS StorageMyths About NFS Storage
MYTHSVMware doesn’t support all functions of NFS
NFS is too slow
No one uses NFS for VMware
NFS CPU load is heavier
VMware limited to 8 NFS datastores
NFS datastores limited to 16TB
NFS thin provisioned VMDKs auto-rehydrate when moved
Windows VMs can’t use NFS
“VMware is making NFS mainstream and BlueArc is one of the best at NFS” – Tony Asaro, Sr. Analyst, INI Group
Data Center EvolutionData Center Evolution
VMware Supports NFS for Enterprise
But what about Performance?
14 © 2010 BlueArc Corp. Proprietary and Confidential
Real World VMware Environment Requires I/O Operations (IOPS)
Real World VMware Environment Requires I/O Operations (IOPS)
Email, OLTP, Web apps with 1000s of files generate 1000s of random I/O
Slide: 15 © 2010 BlueArc Corp. Proprietary and Confidential
Network Storage
Virtualization
VDI
OLAP
OLTP Web
Backup
R&D
Bus Intel
Creative
Virtualization
Backup
OLAP
OLTPVDI
Web
R&D
Bus Intel
Creative
Virtualization
Backup
OLAP
OLTPVDI
Web
R&D
Bus Intel
Creative
Virtualization
Backup
OLAP
OLTPVDI
Web
R&D
Bus Intel
Creative More Virtual Machines
mean exponential increase in random I/Os
IOPS (I/O Operations per sec) is more critical than I/O throughput
ESX 4.x can drive over 300,000 IOPS
Slide: 16
Not All NFS (NAS) Systems are EqualNot All NFS (NAS) Systems are Equal
Shortcomings of traditional NAS– Some file systems limit NFS datastores to 16TB
– Manually-intensive storage tiering
– Scalability requires more NFS servers
– Software-based NFS severely limits IOPS performance
© 2010 BlueArc Corp. Proprietary and Confidential
Highest Performing NAS Server in the Industry
6th Generation Product
Proven in the most demanding environments
Headquarters in San Jose, CA
Patented Silicon based Accelerated Architecture
© 2009 BlueArc Corp. Proprietary and Confidential
BlueArc – Not Your Typical NAS VendorBlueArc – Not Your Typical NAS Vendor
17
BlueArc Silicon Accelerated ArchitectureBlueArc Silicon Accelerated Architecture
Generations
1st & 2nd 3rd
4th
5th
• 140 MBps• 140 MBps
• 400 MBps• 50,000 IOPs• 400 MBps• 50,000 IOPs
• 800 MBps• 100,000 IOPs• 800 MBps• 100,000 IOPs
Industry Leadership
Proven doubling of performance with every generation of high end platform
• 1900 MBps• 200,000 IOPs • 1900 MBps• 200,000 IOPs
BlueArc NAS Platforms Increased Capacity At All LevelsBlueArc NAS Platforms Increased Capacity At All Levels
© 2010 BlueArc Corp. Proprietary and Confidential
Mercury 50 Mercury 100 Titan 3100
Product Class Mid-range Mid-range High End
Cluster Nodes 2 Up to 4 Up to 8
Max Storage Capacity 4 PB 8 PB 8 PB
Max File System Size 256 TB 256 TB 256 TB
NFS Throughput 700 MB/s 1100 MB/s 1200 MB/s
Performance (Ops/Sec -1 node ) 40,137 SPECsfs 2008 72,921 SPECsfs 2008 96,428 SPECsfs ‘97
Storage Options Multiple options from several manufacturers are available with each platform
Sotfware / File Services All software and file system options (NFS, CIFS, iSCSI) available
Titan 3200
High End
Up to 8
16 PB
256 TB
194,909 SPECsfs ‘97
1500 MB/s
What is SPECsfs?What is SPECsfs?
Standard Performance Evaluation Corp (SPEC) publishes benchmark
“SPECsfs2008” is a storage server benchmark that measures IOPS– Results posted in SPECsfs.org
website– Results are peer-reviewed by a
committee– Includes full disclosure of
– Tested system components– Conditions– A uniform workload
20 © 2010 BlueArc Corp. Proprietary and Confidential
Mercury100 (2)
FAS6080 (2)
Mercury 50 (2)
Mercury 100 (1)
FAS3160 (2P)
FAS3160 (2)
IQ5400 (10)
Mercury 50 (1)
FAS3140 (2P)
FAS3140 (2)
40K 80K 120K 160KIOPS
“SPECsfs2008” BenchmarksCompetitive Comparison
(by number of nodes)
NAS Nodes Compared for PerformanceNAS Nodes Compared for Performance
0
10
20
120
600,000 SPECsfs IOPS Configuration
3Nodes
8Nodes
10Nodes
129 Nodes
18Nodes
Mercury 100
Titan 3200
NetApp6080
Other NAS Servers
NetApp3170
High-End
Mid-Range
Traditional NAS Sprawl
Consolidate dozens of traditional NAS to fewer
BlueArc NAS systems
BlueArc NAS
No More NAS System SprawlNo More NAS System Sprawl
© 2010 BlueArc Corp. Proprietary and Confidential
23 © 2010 BlueArc Corp. Proprietary and Confidential
BlueArc is the Optimal Architecture for New Generation Data Centers
VMware Endorses NFS
NFS known for Simplicity
World’s Fastest mid-range NAS* at 73K IOPS per Node
Scale without NAS Sprawl
BlueArc NFS Storage For VMwareServers
Storage
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VMVM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VMVM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM
LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN LUN
Network
Std NICs NFS
IP Network
* BlueArc Mercury 100 SPECsfs test results
24
Starbreeze Studios AB – A Major Video Game DeveloperStarbreeze Studios AB – A Major Video Game Developer
Explosive data growth I/O performance bottlenecks,
lower developer productivity System sprawl – adding
systems as quickly as possible to keep up
More sys admin time to manage environment
Backups beginning to exceed backup window
Challenges
Consolidated to 32 servers and 3 storage systems using VMware + BlueArc
Eliminated manually intensive tasks freeing up sys admin time
Results
Jon Johansson - “BlueArc’s performance over NFS is just fantastic no matter the size of the virtual server or the number of virtual servers. We
managed to cut build delivery times by up to 67%.”
25Restricted and Confidential
Helphire Group – Giles Ogram Sr. Engineer
• “They were able to offer us the performance and also the storage capacity that we required and that’s why we went with BlueArc.”
• “Since migrating our virtual machines onto BlueArc storage, they are able to do snapshots and restores seventy-five percent quicker than on our previous SAN infrastructure.”
• “…on our previous SAN, they would take nearly forty to fifty minutes to clone and deploy a machine from a template. On a BlueArc system, it’s ten minutes at the most.”
• “With the implementation of Mercury, we were able to get the cost per terabyte down considerably.”
• “…more than happy to recommend BlueArc products to anybody that wants to get more performance for less money.”
BlueArc Products for VMware SolutionBlueArc Products for VMware Solution
Mercury™ – Mid-Range Storage System Titan™ – High-End Storage System SiliconFS™ – Intelligent File System JetCenter™ – vCenter integrated Backup Manager JetClone™ – Space Efficient Writeable Snapshots JetMirror™ – High Speed Object Replication Data Migrator™ – Policy based data migration Cluster Name Space™ – Global name space file system Storage Virtualization – Virtualized storage & file system VMware Certified – Platforms & Software are ESX certified
Slide: 26 © 2010 BlueArc Corp. Proprietary and Confidential
NEW
NEW
NEW
Simplifying Snapshot Backup & RestoreSimplifying Snapshot Backup & Restore
Slide: 27 © 2010 BlueArc Corp. Proprietary and Confidential
BlueArc JetCenter allows VM Admins to easily protect or clone data
NEW
Slide: 28 © 2010 BlueArc Corp. Proprietary and Confidential
JetClone: Space Efficient and Flexible ClonesJetClone: Space Efficient and Flexible Clones
Rapid creation of writable snapshots– Uses same source data as an existing
volume
– Make many copies for testing Highly space-efficient read/write volumes
– Contain only pointers to shared blocks from the original container file - Reduces disk space
– User adds only the unique data to a clone
More flexible
– Clone only container files, not whole file system
– A single FS holds thousands of container files
VMDK-1 VMDK-2
VMDK-1’ VMDK-2’
VMDK-1’
VMDK-1’
VMDK-1’
VMDK-2’
VMDK-2’
VMDK-2’
VMDK-3
VMDK-3’
VMDK-3’
VMDK-3’
VMDK-3’
VMDK-1’4TB
BlueArc 256 TB File System (aggregate )
NEW
29 © 2009 BlueArc Corp. Proprietary and Confidential
Policy-Based Data MigratorPolicy-Based Data Migrator
VMware Server Infrastructure
NAS Cluster
Tier 1High Performance
Disks
Tier 2High Capacity
Disks
Tier 3Existing NAS
Improves performance by moving infrequently accessed data off high performance storage tier
Conserves disk space on expensive high-performance tier
Transparent data migration and recall between tiers
Automates migration process with rules based policy engine
Integrates third-party NAS servers with Cross Volume Links
Seamless migration of files across storage tiers eases management and cuts costs
Tier 0Solid State
Drives
Modernize your Data Center withModernize your Data Center with
Fastest NFS Storage,
Simpler than SAN
30 © 2010 BlueArc Corp. Proprietary and Confidential
Now You Can…Now You Can…
…provide expected user experience for all business critical applications
…simplify scaling storage for VMware deployments
… deliver horsepower to support millions of random I/Os for 100’s of VMs running mixed workloads
…attain lowest TCO for network storage
…accelerate VMware deployments for higher ROI
31 © 2010 BlueArc Corp. Proprietary and Confidential
wetaDIGITAL
StarBreeze Studios
Thank You
Visit BlueArc at Booth 872Thank You
Visit BlueArc at Booth 872