StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has...

29
Product Announcement Webinar and Live Demonstration Mark Christie – Senior Systems Engineer StorMagic SvSAN 6.1

Transcript of StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has...

Page 1: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Product Announcement Webinar and Live Demonstration

Mark Christie – Senior Systems Engineer

StorMagic SvSAN 6.1

Page 2: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Introducing StorMagic

What do we do?StorMagic SvSAN eliminates the need for physical SANs by exposing the storage of an industry

standard server as a virtual SAN thereby dramatically reducing CAPEX and OPEX.

How does SvSAN achieve this?StorMagic’s virtual SAN converts the internal disk, flash and memory of industry standard servers

into robust, cost effective and flexible shared-storage.

Where is this most applicable?SvSAN is deployed for hyperconverged infrastructure for multi-site enterprises and SMEs and server-

based storage arrays as an alternative to a traditional physical SAN.

Page 3: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

1 to Thousands

of Sites

Large and small deployments

from enterprises with 1000s of

sites to SMEs with a single site

Global Customer

Adoption

Within 72 countries, organisations

depend on StorMagic for sever

and storage infrastructure

Global Partner

Network

Wherever you are, StorMagic has

resellers, integrators, and server

partners to meet your needs

Across Many

Verticals

Retail, health, government,

industrial, education, finance,

pharma and many more

Introducing StorMagic

Page 4: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

What is a S torage Array ?

A disk array is a hardware element that contains a large group of

hard disk drives (HDDs). It may contain several disk drive trays and

has an architecture which improves speed and increases data

protection. The system is run via a storage controller, which

coordinates activity within the unit.

Wikipedia Definition:

Page 5: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Storage Array Components

• SAN Presentation iSCSI

Fibre Channel

• SAN Switch Ethernet (iSCSI)

Fibre channel

• Physical Storage Controller CPU

Memory

Dedicated Storage Hardware

• Enterprise Drives 10K or 15K SAS

SSDSSD

Storage Controller

Page 6: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Utilise industry standard server as a Virtual SAN

SSD

Storage Controller

SSD

Virtual Storage Appliance

Hypervisor

Page 7: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Use Cases: Hyperconverged or Server -based Storage Array

• Hyperconverged

Shared storage and compute platform

Possible appliance compute/storage scale lock-in

Simplified management & scale-out

• Server -based Storage Array

Dedicated shared storage

Always scale compute & storage independently

Flexible/cost effective physical SAN alternative

Page 8: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

StorMagic SvSAN: Overview

“SvSAN turns the internal

disk, SSD and memory of

industry standard servers

into highly available shared

storage”

Page 9: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

• Tie-breaker service for SvSAN mirrors

• Prevents data inconsistency AKA ‘split brain’

• This ensures In the event of a single failure there is no interruption in service

In the event of multiple failures there is no corruption or loss of data

• Local or Remote Supported as Windows service, Linux daemon, packaged VM,

Raspbian (Raspberry Pi)

Withstands 3000ms latency

Up to 20% packet loss

9kbs bandwidth required per SvSAN mirror

• Single NSH instance for 1000s of mirrors across clusters

SvSAN - Neutral Storage Host (witness)

Page 10: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

• Tie-breaker service for SvSAN mirrors

• Prevents data inconsistency AKA ‘split brain’

• This ensures In the event of a single failure there is no interruption in service

In the event of multiple failures there is no corruption or loss of data

• Local or Remote Supported as Windows service, Linux daemon, packaged VM,

Raspbian (Raspberry Pi)

Withstands 3000ms latency

Up to 20% packet loss

9kbs bandwidth required per SvSAN mirror

• Single NSH instance for 1000s of mirrors across clusters

SvSAN - Neutral Storage Host (witness)

Page 11: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

• Tie-breaker service for SvSAN mirrors

• Prevents data inconsistency AKA ‘split brain’

• This ensures In the event of a single failure there is no interruption in service

In the event of multiple failures there is no corruption or loss of data

• Local or Remote Supported as Windows service, Linux daemon, packaged VM,

Raspbian (Raspberry Pi)

Withstands 3000ms latency

Up to 20% packet loss

9kbs bandwidth required per SvSAN mirror

• Single NSH instance for 1000s of mirrors across clusters

SvSAN - Neutral Storage Host (witness)

Page 12: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN - Management & Integration

• Centralized Management & Monitoring from the Datacenter

• vCenter StorMagic Integration StorMagic Dashboard

Single/Multi VSA Deploy

NSH Deploy

VSA Restore

Create, expand and migrate storage

• Hyper -V Integration StorMagic Deployment Wizard

• Monitoring SNMP v2 & v3

SMTP

System Center Operations Manager

• Scripting tool box Powershell module

Deployment, configuration, firmware upgrades

Plugin script generation

Page 13: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Introducing SvSAN 6.1

Robust

Any Site, Any Network

Cost Effective

Lightest Footprint, Lowest Cost

Flexible

Today’s Needs, Future Proofed

I/O Performance statisticsCrucial I/O statistics now at your finger-tips to better understand your workloads.

Multiple VSA GUI deployment & upgradeDeploy and upgrade multiple VSAs through a single wizard and Out-of-the-box Experience

PowerShell Auto -script generationDeploy VSAs through a GUI and automatically generate a custom PowerShell script.

SSD Read/Write cachingEnable hybrid storage configurations combining the performance of SSDs with the capacity of HDDs.

Memory -based read cachingBlazing fast for most common reads. Modes: most frequently used, read ahead and data pinning.

Predictive auto -tieringData dynamically cached between storage tiers depending on frequency of access.

Page 14: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SSDSSD

Host architecture flexibility

• Underlying RAID configuration RAID 0,1,5,6,10

• Create multiple storage pools for shared storage NL-SATA, NL-SAS, SAS, SSD, NVMe

RDM, VMDK, VHDX

• Local storage for Hypervisor and VSA Hypervisor system files

VSA system drives

• SSD Caching – Read Write Optional, Advanced Feature

1 or more SSD per server for SSD Caching

• Memory Caching - Read Optional, Advanced Feature

As little as 1GB RAM per server

Hypervisor

SvSAN

Page 15: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Host architecture flexibility

• Underlying RAID configuration RAID 0,1,5,6,10

• Create multiple storage pools for shared storage NL-SATA, NL-SAS, SAS, SSD, NVMe

RDM, VMDK, VHDX

• Local storage for Hypervisor and VSA Hypervisor system files

VSA system drives

• SSD Caching – Read Write Optional, Advanced Feature

1 or more SSD per server for SSD Caching

• Memory Caching - Read Optional, Advanced Feature

As little as 1GB RAM per server

LUN3

600GB

Local DS

50GB

RAID Pool Storage

(0,1,5,6,10)

Cache Storage

(0,1,5,6,10)

LUN1

50GBLUN2

5.95TB

RDM, VMDK

600GB

RDM,VMDK

5.95TB

SSDSSD

Hypervisor

SvSAN

Page 16: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Host architecture flexibility

Synchronous Mirror

LUN3

600GB

Local DS

50GB

RAID Pool Storage

(0,1,5,6,10)

Cache Storage

(0,1,5,6,10)

LUN1

50GBLUN2

5.95TB

RDM, VMDK

600GB

RDM,VMDK

5.95TB

SSDSSD

Hypervisor

SvSAN

100,000+ IOps with 2x industry standard servers!

SSDSSD

Hypervisor

SvSAN

Page 17: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN – SSD Caching

SSD Read/Write Caching• Data acknowledged once written to Flash storage enabling for high random IO

performance• Sequentially written back to magnetics at a later time to minimize disk head

movements

Hot Blocks• Clean flushed data persists until space is required enabling read performance increase

Increase Performance and Efficiency • IO tracked to promote into cache tiers over time• Less workload on spinning disks enables greater efficiency

Sizing and Configuration• Single SSD or hardware and software RAID for protection• Recommended cache capacity 10% of pool storage• Example - 200GB cache, 2TB pool storage.

Page 18: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN 6: Memory based caching

Modern servers now have vast amounts of memory• Additional memory can be used to dramatically improve

storage performance• Frequently read data is cached in memory• Read operations are served from memory without ever

accessing a disk drive

Read-ahead mode• Detects sequential read streams to allow read ahead• i.e. when this block is read it is highly likely adjacent

blocks will be read• Enable for targeted workloads

Most frequently used mode (default)• SvSAN algorithm identifies and stores data based on

access patterns• Frequently accessed data blocks are stored in memory• Default mode benefits all workloads

Data pinning mode• Enter learning to create identical access pattern• Delivers most efficient read performance• Enable for targeted workloads

Page 19: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN - Predictive automated read caching & tiering

Intelligent read caching algorithm• All read I/Os are monitored and analyzed• Most frequently used data – “Hot” data • Cache tiers are populated based on access frequency

Tiering• RAM: Most frequently accessed data• SSD/Flash: Next most frequently accessed data• HDD: Infrequently accessed data – “Cold” data

Sizing• Assign cache sizes to meet requirements• Grow caches as working sets change• Use any combination of Memory, SSD/Flash and Disk

Play to the strengths• Play to the strengths of all mediums• Memory Highest IOPS• SSD/Flash Magnetic drives providing lower price per GB

Page 20: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SSD

3x1.2TB in RAID52.13TB VD1 & 50GB VD0

200GBSSD

SSD

3x1.2TB in RAID52.13TB VD1 & 50GB VD0

200GBSSD

2.13TBShared mirrored datastore

32GBSD

32GBSD

SvSANSvSAN

SvSAN – Demo Hardware Configuration

Page 21: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Customer data analysis: On -demand consumer service (US)

Read Write

Read/Write Ratio 40% 60%

Average Per Day 9GB 13GB

Average Block Size 30KB 11KB

Average IOPS 5 15

Workloads

• Network monitoring for on-demand service

• Back office apps

Challenge

• Customer was evaluating hyperconverged solutions

• Was considering full flash

StorMagic analysis

• Enabled I/O meta-data collection of a period of time in a live POC

Distribution of I/O sizes

Throughput and IOPS

Locality of access

0

50

100

150

200

250

300

350

400

16

:13

16

:53

17

:33

18

:13

18

:53

19

:33

20

:13

20

:53

21

:33

22

:13

22

:53

23

:33

00

:13

00

:53

01

:33

02

:13

02

:53

03

:33

04

:13

04

:53

05

:33

06

:13

06

:53

07

:33

08

:13

08

:53

09

:33

IOP

S

Time of Day (UTC)

Throughput IOPS

Read

Write

0.001

0.01

0.1

1

10

100

1000

10000

0

42

GB

87

GB

13

2 G

B

17

7 G

B

22

2 G

B

26

7 G

B

31

2 G

B

35

7 G

B

40

2 G

B

44

7 G

B

49

2 G

B

53

6 G

B

58

1 G

B

62

6 G

B

67

1 G

B

71

6 G

B

76

1 G

B

80

6 G

B

85

1 G

B

89

6 G

B

94

1 G

B

98

6 G

B

Nu

mb

er

of

acc

ess

es

Th

ou

san

ds

Locality of access

Read

Write

Page 22: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Estimates• SSD & memory: 94% of I/O being satisfied from read cache, when using 2GB

memory and 120GB SSD• Memory only: 94% of I/O being satisfied from read cache when using 2GB of

memory

Testing• Replay the exact workload collected from live environment• No best guess synthetic workload but exact patterns from data collection

Conclusion • Environment sufficient for workloads• Allocate a small amount of memory to satisfy almost all reads

6%

94%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Read Data Serviced by Tiers

Memory

SSD

Disk

0.37GB

67.85GB

0.00GB

10.00GB

20.00GB

30.00GB

40.00GB

50.00GB

60.00GB

70.00GB

80.00GB

% of Read Data Serviced by Tiers

Customer data analysis: On -demand consumer service (US)

Page 23: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN 6: Management

Multiple VSA GUI deployment Deploy multiple VSAs through a single wizard Incremental naming and IP addressing

Auto PowerShell script generation Deploy VSAs through a GUI and automatically generate a custom

PowerShell script Script variables clearly marked to enable easy editing Scale custom scripts for mass deployments

VSA OOBE (Out -of -box Experience) Stage VSA deployments on hardware Configure VSAs when installed onsite Configure through GUI or scripting

Upgrade multiple VSAs through GUI- Use a repository for VSA firmware's- Select multiple VSAs through the StorMagic dashboard for upgrading- Upgrade VSAs immediately or stage firmware for overnight upgrade- StorMagic handles VSA health check to not impact environment

Page 24: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN 6.1: Standard & Advanced Editions

Minimum cluster size 2

Synchronous Mirroring/High Availability ✔Stretched/Metro Cluster Support ✔Volume Migration ✔VSA Restore

1 ✔VMware vSphere Storage API (VAAI) Support ✔Centralized management and monitoring ✔Remote shared quorum ✔I/O performance statistics ✔Multiple VSA GUI deployment & upgrade ✔PowerShell Shell script generation ✔SSD Caching -

Memory -based caching - most frequently used mode -

Memory -based caching - read ahead mode -

Memory -based caching - data pinning mode -

Predictive cached tiering -

2

✔✔✔✔✔✔✔✔✔✔✔✔✔✔✔

1 Vmware vSphere only

Standard Edition• Rich features for Software-Defined Storage

Advanced Edition• Adds powerful cached auto-tiering

• Disk, Flash and Memory

License, Maintenance & Support (M&S)• Perpetual License based on capacity

• 1 year M&S mandated

• M&S can be extended to 3 or 5 years

Capacity Levels• 2TB

• 6TB

• 12TB

• Unlimited TB

Page 25: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN - Hardware Requirements

Hardware Requirements

VMware vSphere

Microsoft Hyper-V (2012R2 and 2016)

Any x86 hardware platform supported by the chosen hypervisor

SATA, SAS, SSD

Hypervisor supported storage controller

Flexible RAID configuration

Switched traffic or direct connection

SSD

Page 26: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN - VSA Requirements

VSA – Virtual Storage Appliance

Linux Kernel

500MB Boot Drive 20GB Journal Drive

1 vCPU

1GB RAM (Standard) 2GB RAM (Advanced) Up to 32GB per VSA for Memory Caching

1Gb, 10Gb, 40Gb networking

Page 27: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

SvSAN 6.1 Predictive Cached Tiering Deployment Examples

• I am selecting a new server and storage solution

Consider 3 tier architecture or hyperconverged and the best balance of storage tiers for capacity and performance

Solution 1: Hyperconverged with tiering across HDD, SSD and Memory.

Solution 2: Server-based storage array with tiering across HDD, SSD and Memory and separate compute

• I am considering an all flash array

Know your actual IOps requirement and decide how important low latency is

Solution 1: Memory caching with HDDs for lower capacity and lowest cost

Solution 2: Memory and SSD caching with HDDs for higher capacity and balanced cost

Solution 3: Memory caching with a full Flash array for highest performance and highest cost

• I am an existing SvSAN user with only HDD

Minimal invasive upgrade for maximum ROI

Solution 1: Leverage spare memory for Memory caching

Solution 2: Upgrade memory for Memory caching

• I am an existing SvSAN user with SSD caching or all Flash

Increase IOps and reduce latency with SSD and memory read/write caching

Solution 1: Add SSD read caching.

Solution 2: Add SSD and Memory read caching through spare memory or a minor upgrade

Page 28: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

What’s the scoop on General Availability?

StorMagic SvSAN 6.1 will be on or before the 27 th April 2017.

However, you can get your hands on it next week!

Second technical preview window now open:http://stormagic.com/6-1-tech-preview/

Page 29: StorMagic SvSAN 6€¦ · hard disk drives (HDDs). It may contain severaldisk drive trays and has an architecture which improves speed and increases data protection. The system is

Q&A and Next Steps

SvSAN Product Information

Product Options

SvSAN license 2, 6, 12 and unlimited TBs

License entitlement 2 mirrored servers

Maintenance and support Platinum - 24x7 / Gold - 9x5

For further information, please contact: [email protected]

Further Reading:

An overview of SvSAN - http://stormagic.com/svsan/

SvSAN Data Sheet - http://stormagic.com/svsan-data-sheet/

SvSAN White Paper - http://stormagic.com/svsan-6/

Download your free trial of SvSAN

stormagic.com/trial