SolidFire Technical Deep Dive (M2)
Transcript of SolidFire Technical Deep Dive (M2)
![Page 1: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/1.jpg)
SolidFirePetr Slačík
Systems Engineer NetApp
27.3.2017
© 2017 NetApp, Inc. All rights reserved. 1
![Page 2: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/2.jpg)
© 2017 NetApp, Inc. All rights reserved. 2
SolidFire Introduction
Element OS
System Architecture
Scale-out Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Data PathConnectivityNodes
1
2
3
![Page 3: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/3.jpg)
© 2017 NetApp, Inc. All rights reserved. 3
SolidFire Introduction
Element OS
System Architecture
1
2
3
Scale-out Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Data PathConnectivityNodes
![Page 4: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/4.jpg)
© 2017 NetApp, Inc. All rights reserved. 4
Builtfor dynamic
infrastructure
Bornout of the cloud
Designedfor consolidation
of mixed workloads
Enablesa next generation
datacenter
![Page 5: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/5.jpg)
© 2017 NetApp, Inc. All rights reserved. 5
SolidFire Introduction
Element OS
System Architecture
1
2
3
Scale-out Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Data PathConnectivityNodes
![Page 6: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/6.jpg)
Element OS
© 2017 NetApp, Inc. All rights reserved. 6 Element OS | Overview
Node
Node
Node
Node
Node
ELEMENT
ELEMENT
ELEMENT
ELEMENT
ELEMENT
Global
Efficiencies
Scale-out Automated
Management
Guaranteed
Performance
Data
Assurance
ELEMENT™ OS
![Page 7: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/7.jpg)
Element OS
Scale-out
© 2017 NetApp, Inc. All rights reserved. 7
Scale-out Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
1 2 3
![Page 8: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/8.jpg)
Scale-Out Platform
© 2017 NetApp, Inc. All rights reserved. 8
Mix, match, and add new
nodes as demand dictates
Start with a 4-node cluster with
desired performance/capacity mix
Element OS | Scale-out
![Page 9: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/9.jpg)
Capacity & PerformanceNodes
© 2017 NetApp, Inc. All rights reserved. 9 Element OS | Scale-out
SITE 1 S ITE 2
4805
9605
19210
Future
9605
CAPACITY PERFORMANCE
MEMORYCPU
Non-disruptive
Granular
Mix Nodes
Scale Out /
Scale Back
No Forklift
Upgrades
CAPACITY PERFORMANCE
MEMORYCPU
![Page 10: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/10.jpg)
Capacity & PerformanceNodes
© 2017 NetApp, Inc. All rights reserved. 10 Element OS | Scale-out
SITE 1 S ITE 2
4805
9605
19210
9605
CAPACITY PERFORMANCE
MEMORYCPU
Non-disruptive
Granular
Mix Nodes
Scale Out /
Scale Back
No Forklift
Upgrades
19210
CAPACITY PERFORMANCE
MEMORYCPU
![Page 11: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/11.jpg)
Capacity & PerformanceNodes
© 2017 NetApp, Inc. All rights reserved. 11 Element OS | Scale-out
SITE 1 S ITE 2
9605
CAPACITY PERFORMANCE
MEMORYCPU
Non-disruptive
Granular
Mix Nodes
Scale Out /
Scale Back
No Forklift
Upgrades
CAPACITY PERFORMANCE
MEMORYCPU
SITE 3
CAPACITY PERFORMANCE
MEMORYCPU
9605
19210
4805
9605
![Page 12: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/12.jpg)
Benefits SummaryElement OS | Scale-out
© 2017 NetApp, Inc. All rights reserved. 12
✓ Simplify capacity planning
✓ Seamless generational upgrades
✓ Instant resource availability
✓ Defer capital expenditures
✓ Eliminate continual architecture of point solutions
✓ Requires…. no manual intervention, no reconfiguration, and no server, client or application changes
✓ Eliminate “Hot Spots”
![Page 13: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/13.jpg)
Element OS
Guaranteed Performance
© 2017 NetApp, Inc. All rights reserved. 13
Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Scale-out
1 2 3
![Page 14: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/14.jpg)
How QoS Works
© 2017 NetApp, Inc. All rights reserved. 14 Element OS | Guaranteed Performance
APP BEHAVIOR
Burst
Max
Min
![Page 15: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/15.jpg)
QoS in Practice
© 2017 NetApp, Inc. All rights reserved. 15 Element OS | Guaranteed Performance
PE
RF
OR
MA
NC
E
T IME
SYSTEM PERFORMANCE
BEFORE QoS
AFTER QoS
BOOT STORM
3
1
2
BOOT STORM
3
1
2
BOOT STORM
PE
RF
OR
MA
NC
EP
ER
FO
RM
AN
CE
![Page 16: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/16.jpg)
Benefits SummaryElement OS | Guaranteed Performance
© 2017 NetApp, Inc. All rights reserved. 16
✓ Allocate storage performance independent of capacity
✓ Manage performance real-time without impacting other volumes
✓ Guarantee performance to every volume with fine-grain QoS settings
✓ Enable multiple databases or applications to coexist on the same storage
✓ Reduce time spent managing performance issues
Element OS | Guaranteed Performance
![Page 17: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/17.jpg)
Element OS
Automated Management
© 2017 NetApp, Inc. All rights reserved. 17
Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Scale-out
1 2 3
![Page 18: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/18.jpg)
Simplified Management
© 2017 NetApp, Inc. All rights reserved. 18 Element OS | Automated Management
API
User Interface
Active IQ
VMware vCenter
OpenStack
CloudStack
PowerShell
SDKs
Self-service Portals
Homegrown Apps
INTERFACES PLUG-INS TOOLSCUSTOM
INTEGRATIONS
![Page 19: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/19.jpg)
TIME YOUR BUSINESS
DESIGN
Initial size (GB or IOPS)
INSTALLATION OPERATING
GB and IOPS required
Account Creation
SCALING
GB and IOPS needed
UPGRADEDESIGN
Initial size (GB or IOPS)
Anticipated growth over lifecycle of array
IOPS required lifetime of product
Node size selection
RAID type, RAID grouping
Drive type (FC, NL, Flash)
Drive quantities and ratio
Cache requirements
Drive Sparing
Aggregate/CPG
MetaLUN and Bin file layout
INSTALLATION
Bin File/RAID Layout
Aggregate/MetaLUN creation
Snapshot spare spacing
Vol0/quorum drive layout
Aggregate snapshot frequency
Snapshot growth limits
OPERATING
GB and IOPS required
Account Creation
Host to HBA assignment and tracking
Host initiator count limits
RAID type required
Primary Control Node assignment
IOPS limitation concerns
Snapshot growth policy
Thin Provisioning (or not)
Aggregate/CPG assignment
40% CPU limit considerations
SCALING
GB and IOPS needed
Drive Shelves required
Power/floor space restrictions
Control node limitations (CPU storage)
UPGRADE
HBA compatibility list
CPU utilization on control nodes
Maintenance window
Mitigate risk during node outage
Storage System TasksOther Vendors
© 2017 NetApp, Inc. All rights reserved. 19 Element OS | Automated Management
![Page 20: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/20.jpg)
Comprehensive Monitoring
© 2017 NetApp, Inc. All rights reserved. 20 Element OS | Automated Management
CLUSTER
REAL-TIME
TELEMETRY
Real-Time UI
• Easy
integration
customer traps
SNMP Logging
• Support Access
• Upgrades
• Phone Home
M Node
M
• Proactive
Support
• 5 – 60 Seconds
• Events/Logging
• 5 year Historical
Reporting
Active IQ
TIER 3 SUPPORT
• Per Volume
Performance
• Efficiencies
• Alerts
• Running Tasks
• System States
• API Generation
– Latency
– IOPS
– Bandwidth
– Queue Depth
![Page 21: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/21.jpg)
Maintenance Windows | Non-DisruptiveAutomated Management
© 2017 NetApp, Inc. All rights reserved. 21 Element OS | Automated Management
M Node
M
FirewallActive Support
ELEMENT OS UPDATES - OS RESTART
KERNEL UPDATES - NODE REBOOT
NODE RE-IMAGING - NODE REMOVAL
REVERSE-SSH
MULTIPLE
UPGRADE
PATHS
![Page 22: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/22.jpg)
Benefits SummaryElement OS | Automated Management
© 2017 NetApp, Inc. All rights reserved. 22
✓ Rapidly deploy applications & services to meet business needs
✓ Automated data distribution & load balancing eliminates downtime, reduces administrative tasks
✓ Complete REST based APIs reduces automation development time
✓ Reduce risk of human error
![Page 23: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/23.jpg)
Element OS
Global Efficiencies
© 2017 NetApp, Inc. All rights reserved. 23
Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Scale-out
1 2 3
![Page 24: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/24.jpg)
All Efficiencies Are Global
© 2017 NetApp, Inc. All rights reserved. 24 Element OS | Global Efficiencies
Efficiencies Tied to
Individual Arrays
Compression
Deduplication
No Scaling Thin Provisioning
OTHERS
Stranded
Capacity
Stranded
Capacity
Isolated Efficiency
Missed Dedupe Opportunities
Wasted Capacity
Always On Global No Impact
Array 1
Array 2
![Page 25: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/25.jpg)
© 2017 NetApp, Inc. All rights reserved. 25
SolidFire Introduction
Element OS
System Architecture
1
2
3
Scale-out Guaranteed Performance
Automated Management
Data Assurance
Global Efficiencies
Data PathConnectivityNodes
![Page 26: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/26.jpg)
SolidFire Environmental Diagram
© 2017 NetApp, Inc. All rights reserved. 26 System Architecture | Introduction
10 GbE NETWORK iSCSI
SVIP
HOSTSADMINISTRATOR
NETWORK
1/10 GbE NETWORK
MVIPM-NODE
NODES
INTERNET
ACTIVE CLOUD MONITORING
ACTIVE SUPPORT
![Page 27: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/27.jpg)
SolidFire Scale OutAdd New Nodes to Scale Capacity and Performance
© 2017 NetApp, Inc. All rights reserved. 27
* SolidFire's Effective Capacity calculation accounts for Helix data protection, system overhead and global efficiencies including compression, deduplication and thin provisioning. SolidFire
customers typically achieve an effective capacity range of 5x to 10x the (usable) capacity depending on application workloads. The above capacity calculations show 5x efficiency gains
4805▪ 10TB effective capacity*
▪ 50,000 guaranteed IOPS
9605▪ 20TB effective capacity*
▪ 50,000 guaranteed IOPS
19210▪ 40TB effective capacity*
▪ 100,000 guaranteed IOPS PerformanceC
apacity
Start with four 9605 nodes
Adding 4805 nodes scales performance faster than capacity
Scale linearly by adding 9605 nodes
Scale faster by adding 19210 nodes
![Page 28: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/28.jpg)
Building Blocks of SolidFire PlatformNodes
© 2017 NetApp, Inc. All rights reserved. 28 System Architecture | Nodes
4805
✓ (10) 480GB SSD
✓ 10 – 20TB (effective)
✓ 50,000 IOPS
✓ 128GB shared memory
✓ 2x6-core 2.1GHz
19210
✓ (10) 1.92TB SSD
✓ 40 to 80TB (effective)
✓ 100,000 IOPS
✓ 384GB shared memory
✓ 2x14-core 2.6GHz
9605
✓ (10) 960GB SSD
✓ 20 – 40TB (effective)
✓ 50,000 IOPS
✓ 256GB shared memory
✓ 2x6-core 2.1GHz
1U Form Factor
10 SSD Drives
![Page 29: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/29.jpg)
System Architecture
Connectivity
© 2017 NetApp, Inc. All rights reserved. 29
Connectivity Data PathNodes
1 2 3
![Page 30: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/30.jpg)
iSCSI Physical ConnectivityPutting the Pieces Together
© 2017 NetApp, Inc. All rights reserved. 30 System Architecture | Connectivity
– 10 GbE
– Network Vendor Agnostic
– LACP Bonding
– iDRAC Enterprise Support Included
OPTIONAL 1 GBE OUT OF
BAND MANAGEMENT INCLUDED
Nodes
Scale-Out Nodes
To Hosts or Trunked to Core
Redundant 10GbE switches(Customer switch, Core or TOR)
Dedicated Management Network
![Page 31: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/31.jpg)
FC ConnectivityPutting the Pieces Together
© 2017 NetApp, Inc. All rights reserved. 31 System Architecture | Connectivity
To Hosts or Trunked to Core
Nodes
Scale-Out Nodes
Redundant FC switches(Customer switch, Core or TOR)
Redundant 10GbE switches(Customer switch, Core or TOR)
FC Nodes
PLACE NODES ANYWHERE
FC node
– Receives FC traffic, does a SCSI pass-through to storage nodes
– Full active-active across ports
– 4x16G ports, 4x10G ports
– 2 or 4 FC nodes per cluster
Storage node– Receives data from FC node and sends acknowledgement
– 2x10G ports, delivers either 50k or 100k IOPS
Shared nothing HA
- Hot swappable FC nodes and Storage Nodes
- WWN’s of ports on FC nodes for zoning determined
by cluster as a whole
- LUN masking used for multi-tenancy
Scale-out to 40-node cluster
Full SolidFire functionality
Dedicated Management Network
![Page 32: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/32.jpg)
Major Users So l idF ire Successes
![Page 33: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/33.jpg)
was able to drop a development build from:
…by deploying SolidFire® as Cinder block storage in its OpenStack environment
HOURSto
MINUTES
![Page 34: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/34.jpg)
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
3 segments, 5 targets, many programs
All-Flash Array for the Next-Gen Data Center
The Digital Enterprise
Transforming
DigitalsNative Digitals
Service Providers
Cloud and
Hosting
Cable and
Telco
SaaS
![Page 35: SolidFire Technical Deep Dive (M2)](https://reader031.fdocuments.in/reader031/viewer/2022030116/621cee74ff5f376c8d20b745/html5/thumbnails/35.jpg)
© 2017 NetApp, Inc. All rights reserved. 35
Questions?