Module 02_Data ONTAP
Transcript of Module 02_Data ONTAP
-
7/31/2019 Module 02_Data ONTAP
1/98
-
7/31/2019 Module 02_Data ONTAP
2/98
2008 NetApp. All rights reserved. 2
Module Overview
In this module, we will cover the following:
NetApp core software technology
Specific on-box and off-box features of DataONTAP
NVRAM functionality
NetApp SnapShot technology
Describe NetApp RAID-DP implementation
-
7/31/2019 Module 02_Data ONTAP
3/98
2008 NetApp. All rights reserved. 3
Module Objectives
By the end of this module, you should be able to:
Identify NetApp core software
On-box features of Data ONTAP
Off-box features of Data ONTAP
Describe the functionality of NVRAM
Describe the values of NetApp RAID 4 andRAID-DP technology
Demonstrate NetApp Snapshot whiteboard
-
7/31/2019 Module 02_Data ONTAP
4/98
2008 NetApp. All rights reserved. 4
Core SoftwareTechnology
-
7/31/2019 Module 02_Data ONTAP
5/98
-
7/31/2019 Module 02_Data ONTAP
6/98
2008 NetApp. All rights reserved. 6
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
ProtocolSupport
On-boxvalue
addedsoftware
Off-Box StorageManagement
Off-Box AdministrationTools
Core Software Technology
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
-
7/31/2019 Module 02_Data ONTAP
7/98 2008 NetApp. All rights reserved. 7
Data ONTAP Components:WAFL Versus Traditional File Systems
WAFL Traditional File Systems
File data location Anywhere on disk Most of disk
Metadata location Anywhere on disk (exceptroot inode)
Dedicated regions
Updates to existing data /metadata?
Put in unallocated blocks(originals intact)
Overwrite existing data
File system consistency? Guaranteed by design Careful ordering of all writesrequired
Crash recovery? Reboot, ready to go Slow, complicated fsck
Interaction with RAID Can write full stripes, utilizingbandwidth
Has to seek for all updates
Snapshot copies /
versions?
By design Requires extra copy on write
-
7/31/2019 Module 02_Data ONTAP
8/98 2008 NetApp. All rights reserved. 8
NVRAM / RAID-DP
-
7/31/2019 Module 02_Data ONTAP
9/98 2008 NetApp. All rights reserved. 9
NVRAM Operation
Client Storage System
Dual-attached FC
GbE
-
7/31/2019 Module 02_Data ONTAP
10/98 2008 NetApp. All rights reserved. 10
NVRAM Operation (Cont.)
Client
Operation is logged in battery-
backed RAM and is now safefrom controller failure
Operation is also placed incontrollers main memory
where further processing will
occur
Storage System
Client free to forget about it
its done! Purely electronic, memory-to-
memory path
NIC = Network Interface Card
NIC MainMemory
NVRAM
BATT+
-
NICMainMemory
Operation
ack
-
7/31/2019 Module 02_Data ONTAP
11/98 2008 NetApp. All rights reserved. 11
Client
Activities involving theoperation consume mainmemory
Up to 10 seconds can elapsebetween CPs while many
other ops arrive (not shown)
Storage System
The organized data from theoperations are written to disk
NVRAM is zeroed
NVRAM Operation (Cont.)
NIC MainMemory
NVRAM
BATT+
-
NICMainMemory
-
7/31/2019 Module 02_Data ONTAP
12/98 2008 NetApp. All rights reserved. 13
NVRAM Benefits for Both SAN and NASEnvironments
Battery life after shutdown
Clean
Weeks
Dirty
3 to 7 days
Partial to full charge
NVRAM6
IB CFOConnectors
512-MB/2-GB DIMM 3-Cell Battery
2-Cell Battery(Added into 2GB version only)
NVRAM5Blinking LED Memory
ClusteredFailover
Ports
Tavor 4x (10 Gb/s)
InfiniBand
5.1Ah Battery
(Dirty shutdown life3-7 days)
-
7/31/2019 Module 02_Data ONTAP
13/98 2008 NetApp. All rights reserved. 14
Data ONTAPComponents:Data Layout RAID 4
Tetris writes
Try to fill stripes
Recalculate parity
RAIDStripe
WriteChain
Parity Drive
-
7/31/2019 Module 02_Data ONTAP
14/98 2008 NetApp. All rights reserved. 15
RAID-DP is dual / diagonal parity data protection
NetApp RAID-DP is an implementation of the industry standardRAID 6 as defined by SNIA
SNIA definition recently updated to include NetApp RAID-DP
http://www.snia.org/education/dictionary/r/
Data ONTAP Components:RAID-DP
RAID-DPprotects againstany two-disk failure
D
3
D
1
D
2
2
D
3
2
P
9
7
DP
12
http://www.snia.org/education/dictionary/r/http://www.snia.org/education/dictionary/r/ -
7/31/2019 Module 02_Data ONTAP
15/98 2008 NetApp. All rights reserved. 16
NetApp Snapshot
-
7/31/2019 Module 02_Data ONTAP
16/98 2008 NetApp. All rights reserved. 17
Core Software Technology
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAIS-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
ProtocolSupport
On-boxvalue
addedsoftware
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
-
7/31/2019 Module 02_Data ONTAP
17/98 2008 NetApp. All rights reserved. 18
NetApp Greatest Hits
RAID-DP
95% SnapMirror
81%
FlexClone
95% SnapVault
76%
Snapshot
technology 94% FlexVol performance 73%
Single OS 89% SnapManager
69%
SnapRestore
89% Data ONTAP benefits 68%
WAFL integration 86% FlexVol provisioning 68%
Multi-protocol 86% V-Series 64%
Data ONTAP simplicity 85% FlexVol priorities 61%
WAFL file system 85% SnapDrive software 60%
FlexVol virtualization 85% LockVault
60%iSCSI leadership 85% NAS Leadership 59%
SnapLock
83% Forced disk consistency 40%
-
7/31/2019 Module 02_Data ONTAP
18/98 2008 NetApp. All rights reserved. 19
A
B
C
A
B
C
A
B
C
NetApp Snapshot Technology
Take snapshot 1
Copy pointers only
No data movement
Blockson the Disk
A
B
C
A
B
C
Blocks inLUN or File
Snap 1
-
7/31/2019 Module 02_Data ONTAP
19/98 2008 NetApp. All rights reserved. 20
A
C
B
A
C
B
Blocks inLUN or File
Blockson the Disk
NetApp Snapshot Technology
Take snapshot 1
Continue writing data
Take snapshot 2
Copy pointers only
No data movement
A
B
C
B1
B1
A
B
C
Snap 2Snap 1
-
7/31/2019 Module 02_Data ONTAP
20/98 2008 NetApp. All rights reserved. 21
A
B
C
A
B1
C
A
B
C
Blocks inLUN or File
Blockson the Disk
NetApp Snapshot Technology
Take snapshot 1
Continue writing data
Take snapshot 2
Copy pointers only
No data movement
Continue writing data
Take snapshot 3
Simplicity of model
Best disk utilization Fastest performance
Unlimited snapshots
A
B
C
B1
C2
C1
B1
A
Snap 3Snap 2Snap 1
-
7/31/2019 Module 02_Data ONTAP
21/98 2008 NetApp. All rights reserved. 22NetApp Confidential -- Do Not Distribute
Snapshot Performance
Snapshots Point-in-time copy
Created in a few seconds
No performance penalty
TPC-C publishedwith 5 activesnapshots
-
7/31/2019 Module 02_Data ONTAP
22/98
2008 NetApp. All rights reserved. 23NetApp Confidential -- Do Not Distribute
Competitors Snapshots
-
7/31/2019 Module 02_Data ONTAP
23/98
2008 NetApp. All rights reserved. 24
Blocks inLUN or File
Blockson the Disk
Others Snapshots
Take snapshot 1
Create copy-outregion 1
Create pointers to oldblocks and copy-out
A
B
C
A
B
C
A
B
C
A
B
C
CopyOut 1
A
B
C
Snap 1
-
7/31/2019 Module 02_Data ONTAP
24/98
2008 NetApp. All rights reserved. 25
Blocks inLUN or File
Blockson the Disk
B
Others Snapshots
Take snapshot 1
Continue writing data
Block changes
Read old block; write tocopy-out region
Updates snap pointer tocopy-out region
Update block on disk
One write requires:
1 read (old data)
1 write (old data)
1 write (new data)
A
C
A
C
CopyOut 1
BBB1
A
B
C
Snap 1
B1
-
7/31/2019 Module 02_Data ONTAP
25/98
2008 NetApp. All rights reserved. 26
A
B
C
Snap 1
A
B
C
Snap 1
copyout 1
A
B1
C
Snap 2
CopyOut 2
Blocks inLUN or File
Blockson the Disk
Others Snapshots
Take snapshot 1
Continue writing data
Take snapshot 2
Create copy-outregion 2
Create pointers to oldblocks and copy-out
A
B
C
A
C
B1
CopyOut 1
CopyOut 2
B1
B
-
7/31/2019 Module 02_Data ONTAP
26/98
2008 NetApp. All rights reserved. 27
Blocks inLUN or File
Blockson the Disk
Snap 2
A
B
C
A
B1
C
CopyOut 2
Others Snapshots
Take snapshot 1
Continue writing data
Take snapshot 2
Continue writing data
Block changes
Old block written to allcopy-out regions
Update all snap pointersto copy-out regions
Update block on disk
One write requires:
1 read
3 writes
A
B
C
A
B1
CopyOut 1
CopyOut 2
B1
A
B
C
Snap 1
A
B
C
Snap 1
CopyOut 1
B
C2 CCCC2
-
7/31/2019 Module 02_Data ONTAP
27/98
2008 NetApp. All rights reserved. 28
Snapshot Comparison
The NetApp Approach
Absolute minimumoverhead
Guarantees disk spaceefficiency
No data movement Guarantees disk
performance
Enables more
snapshots
Space on disk is betterPerformance is better
Number of snapshots is better
UsedDisk
Space
Side-by-sidecomparison aftertwo snapshots
NetApp Others
A
B1
B
C
C
C2
A
B
C
B1
C2
C
C2
-
7/31/2019 Module 02_Data ONTAP
28/98
2008 NetApp. All rights reserved. 29
C2
A
B1
Snap 3
A
B1
C
Snap 2
Using Snapshot Copies to Restore Data
Block C2 is bad
A
B
A
B
C
B1
B1
C2
C2
A
B
C
Snap 1
C2
C2
C2
Blockson the Disk
Blocks inLUN or File
-
7/31/2019 Module 02_Data ONTAP
29/98
2008 NetApp. All rights reserved. 30
Using Snapshot Copies to Restore Data
Block C2 is bad
Let users self-restorefrom .snapshot directoryin NAS environments
A
B1
Snap 3
A
B1
C
Snap 2
A
B
C
A
B
C
B1
B1
C2
C2
C2
A
B
C
Snap 1
C2
C2
C2
Blockson the Disk
Blocks inLUN or File
.snapshotdirectory
-
7/31/2019 Module 02_Data ONTAP
30/98
2008 NetApp. All rights reserved. 31
A
B1
C
Using Snapshot Copies to Restore Data
Block C2 is bad
Let users self-restorefrom .snapshot directoryin NAS environments
Restore from snapshot
with SnapRestore Move pointers from
good snapshot to filesystem
Single File SnapRestore Allows restoration of a
single file from asnapshot
Can take secs. To mins.
depending on file size
SnapRestore
Snap 3
A
B1
C
Snap 2
B
C
A
B
C
B1
C2
A
B
C
Snap 1
A
B1
C2C2
A
B1
C2
C2
Blockson the Disk
Blocks inLUN or File
-
7/31/2019 Module 02_Data ONTAP
31/98
2008 NetApp. All rights reserved. 32NetApp Confidential -- Do Not Distribute
Snapshot Performance
Snapshot Technology Point-in-time copy
Created in a few seconds
No performance penalty
TPC-C publishedwith five activesnapshot copies
-
7/31/2019 Module 02_Data ONTAP
32/98
2008 NetApp. All rights reserved. 33NetApp Confidential -- Do Not Distribute
Competitors Snapshots
-
7/31/2019 Module 02_Data ONTAP
33/98
2008 NetApp. All rights reserved. 34
Blocks inLUN or File
Blockson the Disk
Others Snapshots
Take snapshot 1
Create copy-outregion 1
Create pointers to oldblocks and copy-out
A
B
C
A
B
C
A
B
C
A
B
C
CopyOut 1
A
B
C
Snap 1
-
7/31/2019 Module 02_Data ONTAP
34/98
2008 NetApp. All rights reserved. 35
Blocks inLUN or File
Blockson the Disk
B
Others Snapshots
Take snapshot 1
Continue writing data
Block changes
Read old block; write tocopy-out region
Updates snap pointer tocopy-out region
Update block on disk
One write requires:
1 read (old data) 1 write (old data)
1 write (new data)
A
C
A
C
CopyOut 1
BBB1
A
B
C
Snap 1
B1
-
7/31/2019 Module 02_Data ONTAP
35/98
2008 NetApp. All rights reserved. 36
A
B
C
Snap 1
A
B
C
Snap 1
copyout 1
A
B1
C
Snap 2
CopyOut 2
Blocks inLUN or File
Blockson the Disk
Others Snapshots
Take snapshot 1
Continue writing data
Take snapshot 2
Create copy-outregion 2
Create pointers to oldblocks and copy-out
A
B
C
A
C
B1
CopyOut 1
CopyOut 2
B1
B
-
7/31/2019 Module 02_Data ONTAP
36/98
2008 NetApp. All rights reserved. 37
Blocks inLUN or File
Blockson the Disk
Snap 2
A
B
C
A
B1
C
CopyOut 2
Others Snapshots
Take snapshot 1
Continue writing data
Take snapshot 2
Continue writing data
Block changes
Old block written to allcopy-out regions
Update all snap pointersto copy-out regions
Update block on disk
One write requires:
1 read
3 writes
A
B
C
A
B1
CopyOut 1
CopyOut 2
B1
A
B
C
Snap 1
A
B
C
Snap 1
CopyOut 1
B
C2 CCCC2
-
7/31/2019 Module 02_Data ONTAP
37/98
2008 NetApp. All rights reserved. 38
Snapshot Comparison
The NetApp Approach
Absolute minimumoverhead
Guarantees disk spaceefficiency
No data movement Guarantees disk
performance
Enables more snapshot
copiesSpace on disk is betterPerformance is better
Number of snapshot copies isbetter
UsedDisk
Space
Side-by-sidecomparison after
two snapshotcopies
NetApp Others
A
B1
B
C
C
C2
A
B
C
B1
C2
C
C2
-
7/31/2019 Module 02_Data ONTAP
38/98
2008 NetApp. All rights reserved. 39
C2
A
B1
Snap 3
A
B1
C
Snap 2
Using Snapshot Copies to Restore Data
Block C2 is bad
A
B
A
B
C
B1
B1
C2
C2
A
B
C
Snap 1
C2
C2
C2
Blockson the Disk
Blocks inLUN or File
Using Snapshot Copies to Restore Data
-
7/31/2019 Module 02_Data ONTAP
39/98
2008 NetApp. All rights reserved. 40
Using Snapshot Copies to Restore Data(Cont.)
Block C2 is bad
Let users self-restorefrom .snapshot directoryin NAS environments
A
B1
Snap 3
A
B1
C
Snap 2
A
B
C
A
B
C
B1
B1
C2
C2
C2
A
B
C
Snap 1
C2
C2
C2
Blockson the Disk
Blocks inLUN or File
.snapshotdirectory
Using Snapshot Copies to Restore Data
-
7/31/2019 Module 02_Data ONTAP
40/98
2008 NetApp. All rights reserved. 41
A
B1
C
Using Snapshot Copies to Restore Data(Cont.)
Block C2 is bad
Let users self-restorefrom .snapshot directoryin NAS environments
Restore from snapshot
with SnapRestore Move pointers from
good snapshot to filesystem
Single File SnapRestore Allows restoration of a
single file from asnapshot
Can take secs. to mins.depending on file size
SnapRestore
Snap 3
A
B1
C
Snap 2
B
C
A
B
C
B1
C2
A
B
C
Snap 1
A
B1
C2C2
A
B1
C2
C2
Blockson the Disk
Blocks inLUN or File
-
7/31/2019 Module 02_Data ONTAP
41/98
Exercise
Module 2: Snapshot Whiteboard
Estimated Time: 20 minutes
-
7/31/2019 Module 02_Data ONTAP
42/98
2008 NetApp. All rights reserved. 43NetApp Confidential -- Do Not Distribute
Snapshot Whiteboard Exercise
The next exercise is a script of how to demonstrate
Snapshot on the whiteboard
Take 10 minutes to study the method of presentation
Volunteers will come to the whiteboard and deliver theSnapshot presentation to the class
Be ready to:
Walk through how NetApp Snapshot technology
works and explain what happens on changes ofdata
Explain how competitors do snapshots and whathappens to them on changes
-
7/31/2019 Module 02_Data ONTAP
43/98
2008 NetApp. All rights reserved. 44
Core SoftwareTechnology
-
7/31/2019 Module 02_Data ONTAP
44/98
2008 NetApp. All rights reserved. 45
Core Software technology
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
P
rotocolSupport
On-boxvalue
addedsoftware
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
-
7/31/2019 Module 02_Data ONTAP
45/98
2008 NetApp. All rights reserved. 46
NOW-site Software Download Page
http://now.netapp.com/NOW/cgi-bin/software/
http://now.netapp.com/NOW/cgi-bin/software/http://now.netapp.com/NOW/cgi-bin/software/http://now.netapp.com/NOW/cgi-bin/software/http://now.netapp.com/NOW/cgi-bin/software/ -
7/31/2019 Module 02_Data ONTAP
46/98
2008 NetApp. All rights reserved. 47
Data ONTAP 7.0 Release Model
http://now.netapp.com/NOW/products/ontap_releasemodel/post70.shtml
P1 Pn... P1 Pn... P1 Pn... P1 Pn...
GD
GARC1 RCn...
7.0RC1 7.0RCn 7.0 7.0.1 7.0.2 7.0.3
MaintenanceReleases
Patch Releases(bi-weekly)
Release Candidate Initial posting to NOW
General Availability Key certifications required
for solution sets Basic client compatibility Tier 1 partner certification
General DeploymentAdoption metrics Full solution sets Full client compatibility
Time
1-2 months before GA GA date 3-4 months after GA 6-7 months after GA
http://now.netapp.com/NOW/products/ontap_releasemodel/post70.shtmlhttp://now.netapp.com/NOW/products/ontap_releasemodel/post70.shtml -
7/31/2019 Module 02_Data ONTAP
47/98
2008 NetApp. All rights reserved. 48
Release Metrics
http://now.netapp.com/NOW/cgi-bin/metrics
http://now.netapp.com/NOW/cgi-bin/metricshttp://now.netapp.com/NOW/cgi-bin/metricshttp://now.netapp.com/NOW/cgi-bin/metricshttp://now.netapp.com/NOW/cgi-bin/metrics -
7/31/2019 Module 02_Data ONTAP
48/98
2008 NetApp. All rights reserved. 49
Data ONTAP Convergence
2007
2008
2009
2010
7.2 GordonBiersch 10.0 Tricky
7.3 Iron City
Boilermaker
Rolling Rock
Rolling Rock +1
10.1 Whirlwind
7.4 Kingfisher10.2 Stormking
10.0.x Tricky.x
Challenges in High-Performance
-
7/31/2019 Module 02_Data ONTAP
49/98
2008 NetApp. All rights reserved. 50
Challenges in High PerformanceComputing
Insatiable demand forperformance
Storage consumptionhard to predict
Must providecontinuous operations
Recover rapidly fromerrors and disasters
Get the most from ITinvestments
Reduce complexity ofhigh performanceapps
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
client code
client codeclient code
client code
ClientCode
Performance demands stress traditional storage
Linux Cluster
MgmtI/F 2
Data Loss
x
CPU100%
!! ERROR !!Disk Full
MgmtI/F 1
HardwareFailure
xIdle
ZZZ
-
7/31/2019 Module 02_Data ONTAP
50/98
2008 NetApp. All rights reserved. 51
Projects
A B C
A2 A3 B1 B2 C1 C2 C3A1
Servers
GlobalName -Space
Data ONTAP GX-Global Namespace
Simplicity
All clients see all data
Simplifies managingmount points
No client changes
Transparency Expansion
FlexVol move
Failover
Scalability Grow namespace to
Petabytes
Manageability
A
B
C
A1
A2A3
B1
B2C1
C2 C3
Virtual
Server
Flexible scalable storage system
-
7/31/2019 Module 02_Data ONTAP
51/98
2008 NetApp. All rights reserved. 52
Projects
A B C
A2 A3 B1 B2 C1 C2 C3A1
Servers
Data ONTAP GX-Striped Flexible Volumes
Customer Benefits
Scalability andperformance
Flexible volumes thatspan many controller
nodes Performance to multi-
GBps throughput
Scale FlexVol size tohundreds of terabytes
High levels of performance and scalability
B1
C1
B B2
A1 C3
C
A3 C2A2
StripedVolume X
GXCluster
9 10
11 12
1 2
3 4
5 6
7 8
GlobalName -Space
D ONTAP GX T E i
-
7/31/2019 Module 02_Data ONTAP
52/98
2008 NetApp. All rights reserved. 53
Projects
A B C
A2 A3 B1 B2 C1 C2 C3A1
Servers
Data ONTAP GX-Transparent Expansion
Customer Benefits
Rapidly/seamlesslydeploy new storageand/or applications
No downtime required
Transparent to computefarm, namespace isunchanged
A
CA1
A2
A3 B1
B2
C1
C2
C3
BB
GlobalName -Space
D ONTAP GX L d B l i
-
7/31/2019 Module 02_Data ONTAP
53/98
2008 NetApp. All rights reserved. 54
Projects
A B C
A2 A3 B1 B2 C1 C2 C3A1
Servers
Data ONTAP GX Load Balancing
Customer Benefits
Optimize performance
Maximize disk utilization
No disruption toapplication
No need to touch clientsbecause namespace isunchanged
Example
Optimize project Aresponse time
A
B
C
A1
A2A3
B1
B2C1
C2 C3
Project A gets dedicated resources
GlobalName -Space
O B V l Add d S f
-
7/31/2019 Module 02_Data ONTAP
54/98
2008 NetApp. All rights reserved. 55
On-Box Value-Added Software
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
P
rotocolSupport
On-boxvalue
addedsoftware
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
Data ONTAP On Box Technology
-
7/31/2019 Module 02_Data ONTAP
55/98
2008 NetApp. All rights reserved. 56
Data ONTAP On-Box Technology
Snapshot
Instant self-service file recovery for end users.
SnapRestoreInstant volume recovery, or large individual files.
SnapMirrorAsync and sync remote replication over inexpensiveIP. FC now also supported.
SnapVault
Heterogeneous super-efficient hourly disk-basedonline archiving with versioning up to weeks or
months.
SyncMirrorSynchronous RAID-1 local mirroring via disk shelfplexes. RAID-1 remote mirroring product for DR isMetroCluster.
SnapLockSEC-compliant disk-based WORM technology
LockVault
Heterogeneous data retention solution forunstructured data.
Location of the Quick Reference Guides:http://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.html
SnapSuite Quick Reference Guide
$ No License Fee
$ License Fee
plex0 plex1
IP
WindowsLinuxSolarisHP-UXAIX
WindowsLinux
SolarisHP-UXAIX
$
$
$
$
$
$
$
Oth O B T h l i
http://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.htmlhttp://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.htmlhttp://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.htmlhttp://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.html -
7/31/2019 Module 02_Data ONTAP
56/98
2008 NetApp. All rights reserved. 57
FlexVol
FlexClone
FlexCache
FlexShare
Other On-Box Technologies
Priority
FlexVols
Aggregate
Disks DisksDisks
$
$
$
$
Oth O B T h l i
-
7/31/2019 Module 02_Data ONTAP
57/98
2008 NetApp. All rights reserved. 58
SyncMirror
(SnapMirror vs. SyncMirror)
Clustering
MetroCluster
MultiStore/Vfiler vs. V-Series/gFiler
Other On-Box Technologies
plex0 plex1
Vfiler A
$
$
$
$
FC d Eth t C ti it
-
7/31/2019 Module 02_Data ONTAP
58/98
2008 NetApp. All rights reserved. 59
FC and Ethernet Connectivity
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
P
rotocolSupport
On-boxvalue
addedsoftwar
e
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
Data ONTAP Components:
-
7/31/2019 Module 02_Data ONTAP
59/98
2008 NetApp. All rights reserved. 60
pThe Network Stack
Storage System/Data ONTAPClient
Client
Client
Client
Client
Disks
Network
Cluster Partner
Cluster
Interconnect
StorageRAID
WAFL
ProtocolsNetwork
Stack
NVRAM
Clustering
Data ONTAP Protocol S pport
-
7/31/2019 Module 02_Data ONTAP
60/98
2008 NetApp. All rights reserved. 61
Data ONTAP Protocol Support
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
P
rotocolSupport
On-boxvalue
addedsoftwar
e
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStore Data ONTAP 7.X for V-Series
Data ONTAP GX 10.X
Data ONTAP Components:
-
7/31/2019 Module 02_Data ONTAP
61/98
2008 NetApp. All rights reserved. 62
pProtocols
Filer/DataONTAPClient
Client
Client
Client
Client
Disks
Network
Cluster Partner
Cluster
Interconnect
StorageRAID
WAFL
ProtocolsNetwork
Stack
NVRAM
Clustering
Data ONTAP Components:
-
7/31/2019 Module 02_Data ONTAP
62/98
2008 NetApp. All rights reserved. 63
pData Access Protocols
The four core data access protocols:
$ CIFS (Common Internet File System, developedby Microsoft)
$ NFS (Network File System, developed by Sun
Microsystems, v2, v3, v4)$ FCP (Fibre Channel Protocol)
$ iSCSI [SCSI over TCP/IP]
$ No License Fee$ License Fee
Data ONTAP Components:
-
7/31/2019 Module 02_Data ONTAP
63/98
2008 NetApp. All rights reserved. 64NetApp Confidential -- Do Not Distribute
pOther Protocols
HTTP, HTTPS
Not a full-fledged HTTP server
FTP
Full FTP and TFTP implementation
NDMP
SNMP
SMTP
Telnet, RSH, SSH, RPC
Off Box Storage Management
-
7/31/2019 Module 02_Data ONTAP
64/98
2008 NetApp. All rights reserved. 65
Off-Box Storage Management
Data ONTAP
WAFL- Core technology
NVRAM
RAID 4 or RAID-DP
Snapshot
FlexVol
FC and Ethernet NetworkConnectivity
P
rotocolSupport
On-boxvalue
addedsoftwar
e
Off-Box StorageManagement
Off-Box AdministrationTools
Data ONTAP 7.X for FAS/NearStoreData ONTAP 7.X for V-Series
Data ONTAP GX 10.X
External to Data ONTAP Products
-
7/31/2019 Module 02_Data ONTAP
65/98
2008 NetApp. All rights reserved. 66NetApp Confidential -- Do Not Distribute
External to Data ONTAP - Products
SnapDrive
SnapManager
SnapManager for Exchange
SnapManager for Oracle
SnapManager for SAP
SnapManagerfor SharePoint
SnapManagerfor SQL Server
External to Data ONTAP Products
-
7/31/2019 Module 02_Data ONTAP
66/98
2008 NetApp. All rights reserved. 67NetApp Confidential -- Do Not Distribute
External to Data ONTAP - Products
Open System SnapVault
VFM (Virtual File Manager)
NetApp DataFort
IS1200
External to Data ONTAP Products
-
7/31/2019 Module 02_Data ONTAP
67/98
2008 NetApp. All rights reserved. 68NetApp Confidential -- Do Not Distribute
External to Data ONTAP - Products
File Storage Resource Manager
VTL
NearStore Personality License
External to Data ONTAP Administration
-
7/31/2019 Module 02_Data ONTAP
68/98
2008 NetApp. All rights reserved. 69NetApp Confidential -- Do Not Distribute
External to Data ONTAP - Administration
Operations Manager
Protection Manager
Storage Manager
Appliance Watch
MOM
OpenView
TSM
CommandCentral
Storage (Symantec)
Storage Layout Agenda
-
7/31/2019 Module 02_Data ONTAP
69/98
2008 NetApp. All rights reserved. 70NetApp Confidential -- Do Not Distribute
Storage Layout Agenda
Aggregate review
Volume creation and management
MultiStore
Competitive layout
Data ONTAP 7.0 Storage Terminology:
-
7/31/2019 Module 02_Data ONTAP
70/98
2008 NetApp. All rights reserved. 71
Aggregate
Aggregate collection of physical disk space used as acontainer to support one or more flexible volumes
Aggregates are the physical layer
RG 0
RG 1
RG 2
Aggregate
Basic Aggregate Attributes
-
7/31/2019 Module 02_Data ONTAP
71/98
2008 NetApp. All rights reserved. 72NetApp Confidential -- Do Not Distribute
Basic Aggregate Attributes
Default RAID type = RAID-DP
One or more RAID groups
RAID group size definable
Supports SyncMirror
Aggregate snapshot support (default enabled)
Target all flexible volumes contained withinaggregate
Aggregate Status Information: FilerView
-
7/31/2019 Module 02_Data ONTAP
72/98
2008 NetApp. All rights reserved. 73
Aggregate Status Information: FilerView
To get aggregate properties click on aggregate name
Aggregate Status Information:
-
7/31/2019 Module 02_Data ONTAP
73/98
2008 NetApp. All rights reserved. 74
FilerView Aggregate Properties Screen
Get to other details about the aggregate from
the buttons at the bottom of this screen
Data ONTAP 7.0 Storage Terminology:
-
7/31/2019 Module 02_Data ONTAP
74/98
2008 NetApp. All rights reserved. 75
RG 0
RG 1
RG 2
Aggregate
Traditional Volume
Traditional volume collection of physical disk space that is usedto support a single volume
Traditional volumes are directly tied to an aggregate
Traditional volumes are both the physical layer and the logical layer
Data ONTAP 7.0 Storage Terminology:
-
7/31/2019 Module 02_Data ONTAP
75/98
2008 NetApp. All rights reserved. 76
Flexible volume collection of disk space allocated as a subsetof the available space within an aggregate
Flexible volumes are loosely tied to their aggregate
Flexible volumes are the logical layer
RG 0
RG 1
RG 2
Aggregate
Flexible Volume
FlexVol1
FlexVol1
FlexVol1
FlexVol2
FlexVol2
FlexVol2
Flexible Volume Creation:
-
7/31/2019 Module 02_Data ONTAP
76/98
2008 NetApp. All rights reserved. 77
FilerView Example
Basic Flexible Volume Status Information:
-
7/31/2019 Module 02_Data ONTAP
77/98
2008 NetApp. All rights reserved. 78
FilerView
Flexible volume information is provided via FilerView
from Volumes Manage and Volume Properties screens
Click on volume name forvolume properties
If aggregate name,flexible volume
Filter by: Volume Type
Volume Information Commands
-
7/31/2019 Module 02_Data ONTAP
78/98
2008 NetApp. All rights reserved. 79
Volume Information Commands
NetApp> vol status
Volume State Status Options
vol0 online raid4, trad root, nosnap=on
flex1 online raid_dp, flex
NetApp> vol status flex1
Volume State Status Optionsflex1 online raid_dp, flex
Containing aggregate: 'aggr1'
NetApp> vol container flex1
Volume 'flex1' is contained in aggregate 'aggr1'
NetApp> vol size flex1
vol size: Flexible volume 'flex1' has size 10g.
Both traditional and flexible volumes are visible
If it is a flexible volume, theaggregate name appears
Support commands
unique to flexiblevolumes
Aggregate: Flexible / Traditional VolumeI i i l S All i (NAS D f l )
-
7/31/2019 Module 02_Data ONTAP
79/98
2008 NetApp. All rights reserved. 80
Initial Space Allocation (NAS Defaults)
WAFL Overhead
WAFL Traditional
volume
10%
90%
80%
snapshot Reserve
(20% Adjustable)
WAFL Overhead
WAFL AggregateSpace
10%
90%95%
Aggregate Space
FlexVol Space
Aggregate snapshot Reserve
FlexVol1
FlexVol#n
.snapshot 20% Adj.
80%
.snapshot 20% Adj.
80%
(5% Adjustable)
Flexible Volume CreationS G T
-
7/31/2019 Module 02_Data ONTAP
80/98
2008 NetApp. All rights reserved. 81
Space Guarantee Types
Flexible volume creation can be performed
using CLI command or FilerViewAllocated from containing aggregates file
systems space
Controlled by flexible volumes spaceguarantee option
Three types of space guarantee types available
Volume None File
X
Space Guarantee - Volume
-
7/31/2019 Module 02_Data ONTAP
81/98
2008 NetApp. All rights reserved. 82
Flexible Volume = 10GbUsed Space = 1Gb
Total Physical Space= 49 cups of water
Flexible Volume = 10GbUsed Space = 0Gb
Space Guarantee Volume
Space guarantee set to volume Space allocated from aggregate at creation for entire size of volume Space allocated within volume does not affect aggregate space
Total Physical Space= 50 Cups of Water
50 empty cupsavailable for filling
Available water reduced by 10cups immediately to guarantee
the cups needed to fill the bucket
40 empty cupsavailable for filling
Space is not used, but the abilityto take that space is reserved
Aggregate = 50Gb
Space Guarantee - None
-
7/31/2019 Module 02_Data ONTAP
82/98
2008 NetApp. All rights reserved. 83
Flexible Volume = 10GbUsed Space = 1Gb
Total Physical Space= 49 cups of water
Flexible Volume = 10GbUsed Space = 0Gb
Space Guarantee None
Guarantee = none Space allocated from aggregate as used Does not support file and LUN space reservations May run out of aggregate space before achieving volume size
Total Physical Space= 50 Cups of Water
50 empty cupsavailable for filling
49 empty cupsavailable for filling
A new volume requests 10 cups,however no real space is taken
until it is needed by the volume
Aggregate = 50Gb
Space Guarantee - None
-
7/31/2019 Module 02_Data ONTAP
83/98
2008 NetApp. All rights reserved. 84
Flexible Volume = 80GbUsed Space = 0Gb
Flexible Volume = 79GbUsed Space = 1Gb
Flexible Volume = 78GbUsed Space = 2Gb
Total Physical Space= 50 Cups of Water
Total Physical Space= 49 cups of water
49 empty cupsavailable for filling
48 empty cupsavailable for filling
Space Guarantee None
It is possible to have many flexible volumes that can possibly exceed thelimit the aggregate has available
This is because they are empty and not taking any real space until
needed by the volume
Aggregate = 50Gb
50 empty cupsavailable for filling
Total Physical Space= 48 cups of water
Space Guarantee - File
-
7/31/2019 Module 02_Data ONTAP
84/98
2008 NetApp. All rights reserved. 85
Flexible Volume = 8GbUsed Space = 2Gb
Total Physical Space= 48 cups of water
Flexible Volume = 10GbUsed Space = 0Gb
Space Gua a tee e
It is possible to have many flexible volumes that can possibly exceed thelimit the aggregate has available
This is because they are empty and not taking any real space until
needed by the volume
Total Physical Space= 50 Cups of Water
50 empty cupsavailable for filling
48 empty cupsavailable for filling
Aggregate = 50Gb
Flexible Volume Resizing:CLI C d
-
7/31/2019 Module 02_Data ONTAP
85/98
2008 NetApp. All rights reserved. 8686NetApp Confidential -- Do Not Distribute
CLI Command
vol size command is used to resize a flexible
volume
Syntax:
vol size [[+|-][k|m|g|t]]
Command Result
vol size FlexVol 50m FlexVol will now be 50M
vol size FlexVol +50m FlexVol will be increased 50M to 100M
vol size FlexVol -25m FlexVol will be decreased 25M to 75M
Aggregate and Flexible Volume Removal
-
7/31/2019 Module 02_Data ONTAP
86/98
2008 NetApp. All rights reserved. 87NetApp Confidential -- Do Not Distribute
gg g
Aggregates cannot be removed until all flexiblevolumes on the aggregate are removed
Both flexible volumes and aggregates can be removed
using CLI commands and FilerView
For flexible volumes, use CLI commands:
vol offline andvol destroy
For aggregates, use CLI commands:
aggr offline andaggr destroy
What is FlexShare?
-
7/31/2019 Module 02_Data ONTAP
87/98
2008 NetApp. All rights reserved. 88NetApp Confidential -- Do Not Distribute
Allows administrators to prioritize how systemresources are used
Standard with Data ONTAP 7.2
No license required
Provides workload prioritization
Prioritizes resource availability for higher priority tasks
No guarantees on performance or resource availability
FlexShare Key Features
-
7/31/2019 Module 02_Data ONTAP
88/98
2008 NetApp. All rights reserved. 89NetApp Confidential -- Do Not Distribute
y
Relative priority of different volumes
Per-volume user vs. system priority
Per-volume cache policies
Administration using CLI or Manage ONTAP API
Dynamic updates of configuration changes
MultiStore
-
7/31/2019 Module 02_Data ONTAP
89/98
2008 NetApp. All rights reserved. 90NetApp Confidential -- Do Not Distribute
MultiStore is an optional software product available
with Data ONTAP
Allows partitioning of the storage system and networkresources into separate storage containers
These storage containers are called virtual filers
Sometimes referred to as Vfilers
Each virtual filer offers file services to the clients
NOT the same as V-Series
Benefits of MultiStore
-
7/31/2019 Module 02_Data ONTAP
90/98
2008 NetApp. All rights reserved. 91NetApp Confidential -- Do Not Distribute
Virtualization Provides a logical view of the storage and computing
resources
Hides complexity
Consolidation and ease of management Each virtual storage controller appears as a separate
physical storage with a unique IP address
Security Delegation of management
Data owned by a virtual storage controller cannot beaccessed by other virtual storage controllers
Competitive Layout: Static (Them)
-
7/31/2019 Module 02_Data ONTAP
91/98
2008 NetApp. All rights reserved. 92
p y ( )
All tier-1 competitors
offer only static/manualvirtualization technology
TagmaStore
IBM SVC
EMC Invista Start-ups
DataCore
FalconStor
NO disk optimization
Users and Applications
File System
Composite Disk
Storage Consumer(e.g. file systems, databases, etc.)
Static Virtualization System(creates composite disk object by striping datathrough underlying physical storage)
Physical Disks or LUNs(fed from an array or JBOD)
Users and Applications
File System
Composite Disk
Storage Consumer(e.g. file systems, databases, etc.)
Static Virtualization System(creates composite disk object by concatenatingdata underlying physical storage)
Physical Disks or LUNs(fed from an array or JBOD)
Competitive Layout: Dynamic (Us)
-
7/31/2019 Module 02_Data ONTAP
92/98
2008 NetApp. All rights reserved. 93
Only NetApp offers
dynamic/automaticvirtualization technology
FAS
NearStore
V-Series Continuous disk
optimization
Most efficient capacity
utilization Best price/performance
Minimal management
Source: http://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htm
Users and Applications
Composite LUNs(striped or concatenatedphysical LUNs)
Physical Disks or LUNs(fed from an array or JBOD)
Volume Manager
File System
Composite Disk
File System
Composite Disk
File System
Composite Disk
Users and Applications
Aggregate(Advanced IntellegentData Container)
Physical Disks or LUNs(fed from an array or JBOD)
FlexVol Volumes
Advanced WAFLLayout Heuristics
RAID-DPData Protection
Rapid RAIDRecovery
DataChecksums
NVRAM AcceleratedLogging
p y y ( )
Competitive Layout: NetApp ProvisioningAdvantages
http://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htmhttp://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htmhttp://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htmhttp://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htm -
7/31/2019 Module 02_Data ONTAP
93/98
2008 NetApp. All rights reserved. 94
Advantages
MetaLUNs and
MetaVolumes MetaLUN performance
limited by number ofdisks spanned
Hot MetaLUNs cant
be helped by disks onother MetaLUNs
Resistant to change
NetApp FlexVol volumes
Spindle sharing makestotal aggregateperformance available toall volumes
Competitive Layout: Quick Comparisons
-
7/31/2019 Module 02_Data ONTAP
94/98
2008 NetApp. All rights reserved. 95
NetApp FAS EMC CLARiiON
Aggregate 100 per system Min disks = 2 Max disks = 16 TB RAID-DP
Disk Groups / RAID CX300 - 60 disks / 16.4 TB CX500 - 120 disks / 35.8 TB CX700 - 240 disks / 74.4 TB RAID 0/1/3/5/10 (RAID 6 talk no delivery)
Flexible Volume Create LUN within a FlexVol 200 per system 20 MB min, 16 TB max Spread across all disks in aggregate
MetaLUN (FLU/Flare LUN) Two or more FLUs joined as one = MetaLUN Theoretical limit of 2048 Cannot shrink without destroying data Manually sized
Snapshot technology Patented technology w/o COW overhead User restore capable
SnapView Copy-on-write = performance impact snapshots cannot mount on originating server
SnapMirror Synchronous, semi-sync, and asynchronous
MirrorView Synchronous or limited asynchronous
SnapVault BCV / Backup to ATA
-
7/31/2019 Module 02_Data ONTAP
95/98
Exercise
Module02: Aggregate and Volume
Creation DemoEstimated Time: 30 minutes
-
7/31/2019 Module 02_Data ONTAP
96/98
Volume and
Aggregate CreationDemo
References
-
7/31/2019 Module 02_Data ONTAP
97/98
2008 NetApp. All rights reserved. 98NetApp Confidential -- Do Not Distribute
Competitive Layout Informationhttp://mktg-web.netapp.com/products/launches/
PartnerCenter- Solutionshttp://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.html
Capacity Calculatorhttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xls
Thin-provisioning and FlexVolhttp://www.netapp.com/mycommunities/PartnerCenter/10245
MultiStorehttp://www.netapp.com/mycommunities/PartnerCenter/10251
Module Summary
http://mktg-web.netapp.com/products/launches/http://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.htmlhttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/mycommunities/PartnerCenter/10245http://www.netapp.com/mycommunities/PartnerCenter/10251http://www.netapp.com/mycommunities/PartnerCenter/10251http://www.netapp.com/mycommunities/PartnerCenter/10245http://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/seef/mycomm/partnercenter/solutions/roi-tei/downloads/capacity-calculator.xlshttp://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.htmlhttp://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.htmlhttp://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.htmlhttp://mktg-web.netapp.com/products/launches/http://mktg-web.netapp.com/products/launches/http://mktg-web.netapp.com/products/launches/ -
7/31/2019 Module 02_Data ONTAP
98/98
In this module, you should have learned to:
Identify NetApp core software On-box features of Data ONTAP
Off-box features of Data ONTAP
Describe the functionality of NVRAM Describe the values of NetApp RAID 4 and
RAID-DP technology
Demonstrate NetApp Snapshot whiteboard