M12-SpaceManagement

7/27/2019 M12-SpaceManagement

1/41

Space Management

Module 12

Data ONTAP 8.0 7-Mode

Administration


2/41

2009 NetApp. All rights reserved.

Module Objectives

By the end of this module, you should be able to:

List the factors that impact space consumption

in Data ONTAP

Describe how and when a volume consumes

space from its containing aggregate

Explain how to guarantee writes for a file

Discuss how Data ONTAP can provide more

space to a full volume State deduplication techniques available in

Data ONTAP


3/41


Factors


4/41


Space Management Factors

Administrators have flexibility to manage their storage

systems by allocating volumes as:

Full provisioned volumes (Space guarantee)

Requires reserving space within the aggregate for the

volume at volumes creation

Default allocation Cannot over-commit an aggregate

Simple storage management

Thin provisioned volumes (Non-space guarantee)

Does not require reserving space within the aggregate forthe volume at the volumes creation

Allows more aggressive allocation

May over-commit an aggregate

Complex storage management


5/41


Space Management Factors (Cont.)

Within a volume, whether full or thin provisioned, all

files, whether a LUN or a NAS file, may:

Have space reservations (default for LUNs)

Requires reserving space within the volume so the entire file

may be overwritten even if blocks are retained by a

Snapshot copy Writes to the file will succeed

Simpler management

Not have space reservations (default for NAS file)

Does not require reserving space within the volume

Writes to the file might fail

Active space monitoring required

See the SAN Administration on Data ONTAPcoursefor more information on LUN reservations


6/41


Volume SpaceGuarantee


7/41 2009 NetApp. All rights reserved.

Space Guarantees

Space guarantee is an attribute of a volume that reserved or set

aside out of the containing aggregate Space guarantee parameters:

volume (default): Reserves the FlexVol total size within its

containing aggregate and allows for space reserved or non-

space reserved files

file: Allow the creation of a space guaranteed file total size

within its containing FlexVol volume

none: Does not reserves any space for the FlexVol volume

within its containing aggregate and allows only for non-space

guaranteed files

Space guarantee may be set:

At the volumes creation:vol create -s volume vol1 aggr1 5GB

On existing volumes:

vol options vol1 guarantee none



System Manager: Space Guarantees

To configure

volumes



Icon Description

aggr1

72-GB disk

Create a five-disk aggregate:aggr create aggr1 5

df -Ag aggr1

Space Guarantee Example

aggr1

Total Used Avail

AFS (95%)85 0 85

SSR (5%) 4 0 4



Create a 30 GB volume:vol create vol1 aggr1 30g

df -Ag aggr1

df -g vol1

Space Guarantee Example (Cont.)

aggr1

Default is volume

space guarantee

vol1

Icon Description

aggr1

72-GB disk

Total Used Avail

AFS (95%)85 30 54

SSR (5%) 4 0 4

Total Used Avail

AFS (80%) 24 0 24SSR (20%) 6 0 6



Icon Description

aggr1

72-GB disk

Create a 30 GB vol2:vol create vol2 -s none aggr1 30g

df -Ag aggr1

df -g vol2


aggr1

With none

space guarantee

vol2

vol1

Total Used Avail

AFS (95%)85 30 54

SSR (5%) 4 0 4

Total Used Avail

AFS (80%) 24 0 24SSR (20%) 6 0 6



Icon Description

aggr1

72-GB disk

Write 24 GB to vol2 Space taken from aggregate when written

df -Ag aggr1

df -g vol2


aggr1

With none

space guarantee

vol2

vol1

Total Used Avail

AFS (95%)85 54 30

SSR (5%) 4 0 4

Total Used Avail

AFS (80%) 24 24 0SSR (20%) 6 0 6



File Types

Files, within volumes, may be either:

Normal: The size of the file represents the

amount of data within the file

Sparse: The size of the file is greater than the

amount of data within the file

foo

foo2

Physical data



Create a 30 GB vol3:system> vol create vol3 -s file aggr1 30g

df -Ag aggr1

df -g vol3

File Type Example

aggr1

With file

space guarantee

vol2

vol1

vol3

Total Used Avail

AFS (95%) 85 54 30

SSR (5%) 4 0 4

Total Used Avail

AFS (80%)24 0 24

SSR (20%) 6 0 6

Icon Description

aggr1

72-GB disk



Create a 10 GB file:# dd if=/dev/zero of=foo bs=1000 count=10000000

df -Ag aggr1

df -g vol3

File Type Example (Cont.)

aggr1

With file

space guarantee

vol2

vol1

vol3

Total Used Avail

AFS (95%) 85 64 20

SSR (5%) 4 0 4

Total Used Avail

AFS (80%)24 10 14

SSR (20%) 6 0 6

Icon Description

aggr1

72-GB disk

foo



Create a 10 GB sparse file:# dd if=/dev/zero of=foo2 bs=1 count=0 seek=10000000

df -Ag aggr1

df -g vol3

File Type Example (Cont.)

aggr1

With file

space guarantee

vol2

vol1

vol3

Total Used Avail

AFS (95%) 85 74 10

SSR (5%) 4 0 4

Icon Description

aggr1

72-GB disk

foo2foo

Total Used Avail

AFS (80%)24 10 14

SSR (20%) 6 0 6



Solutions to FullVolumes



Solutions for Full Volumes

If a volume fills up, because of Snapshot

copies, active file system data, or both

Then administrators can:

Delete Snapshot copies manually or

automatically Expand the volume

Delete active file system data if the blocks are

not part of a Snapshot copy



Snapshot Automatic Delete

Snapshot automatic delete determines when (if)

Snapshot copies will be automatically deleted

Set at volume level

snap autodelete vol[on|off|show|reset]

If autodelete is enabled, then options:

snap autodelete vol options option val

Options Value

commitment try, disrupt

trigger volume, snap_reserve, space_reserve

target_free_space 1-100

delete_order oldest_first, newest_first

defer_delete scheduled, user_created, prefix, none

prefix



Volume Autosize

Might want to grow the volume

vol autosize determines if a volume should

grow when nearly full

Set at volume level

Possible values: ON

Increment size (default 5% of original size)

Maximum size (default 120% of original size)

OFF vol autosize vol_name [-m size[k|m|g|t]]

[-i size[k|m|g|t]] [on|off|reset]



Administrators Choice

Administrators may choose which procedure to

employ first:

snapshot auto delete

vol autosize

Use the volume option: try_first

Possible values: snap_delete

volume_grow (default)

Example: vol options vol_name try_first snap_delete


22/41


Deduplication


23/41


Deduplication

Before After

NetApp Deduplication NetApp deduplication

20:1 or greater for backup Integrated with Data

ONTAP General-purpose volume

deduplication

Identifies and removesredundant data blocks

Application agnostic Primary storage

Backup data

Archival data Service

Runs as a backgroundprocess and is transparentto any client


24/41


presentation.ppt

Identical file

20 blocks

presentation.ppt

Original file

20 blocks

presentation.ppt

Edited file

10 blocks added

= Identical blocks

Deduplication in Action

Without NetApp deduplication

70 total blocks

With NetApp deduplication

30 total blocks


25/41


NetApp Deduplication: Internals

Gathering

Initialization (only necessary

on pre-existing volume)

Gatherer File

Gather

Sorting

qsort qsort qsort...

Merge Sort

Fingerprint

File


26/41


NetApp Deduplication: Internals (Cont.)


Merge Sort

Fingerprint

File

Byte-by-byte comparisonCount file update

Update inode

Duplicate

Entry File

Block Ref

Count File

Sort by Inode Update Inode


27/41



Block Write

Log New FPs

Change

Log File

Change

Log File

Fingerprint

File


28/41




Merge Sort

Block Write

Log New FPs

Change

Log File

Change

Log File

Fingerprint

File


29/41




Merge Sort

Block Write

Log New FPs

Change

Log File

Change

Log File

Fingerprint

File


Update inode

Duplicate

Entry File

Block Ref

Count File



30/41



SIS CheckFingerprint

File

Block Write

Log New FPs

Change

Log File

Change

Log File


31/41


NetApp Deduplication: Stages

Gathering

Initialization (only necessary

on pre-existing volume)

Gatherer File

Gather

Checking

Deduplicating


Update inode

Sorting


Merge Sort

Block Write

Log New FPs

Change

Log File

Change

Log File

Duplicate

Entry File

Block Ref

Count File


SIS CheckFingerprint

File


32/41


Configuration Overview

License it:

system> license add

Turn it on:system> sis on

Deduplicates existing data:

system> sis start -s Schedule when to deduplicate or run manually:

system> sis config [-s schedule]

system> sis start

For maintenance:

system> sis status [-l]

system> sis check

View the space savings:system> df s


33/41


Configuring Deduplication

system> sis on /vol/vol1SIS for "/vol/vol1" is enabled.

Already existing data could be processed by running

"sis start -s /vol/vol1".

system> sis start -s /vol/vol1

The file system will be scanned to process existingdata in /vol/vol1.

This operation may initialize related existingmetafiles.

Are you sure you want to proceed with scan (y/n)? yFri Nov 10 11:42:58 EST [wafl.scan.start:info]:Starting SIS volume scan on volume vol1.

The SIS operation for "/vol/vol1" is started.


34/41


Configuring Deduplication (Cont.)

system> sis status /vol/vol1

Path State Status Progress/vol/vol1 Enabled Active 12 GB Scanned

...

system> sis status /vol/vol1Path State Status Progress

/vol/vol1 Enabled Idle Idle for 00:01:26

system> df -s /vol/vol1

Filesystem used saved %saved

/vol/vol1 20568268 3768732 15%


35/41


Path State Status Progress

/vol/vol1 Enabled Active 40MB (20%) done


/vol/vol1 Enabled Active 30MB Verified

OR

/vol/vol1 Enabled Active 10% Merged

system> sis status


/vol/vol1 Enabled Active 25 MB Scanned


/vol/vol1 Enabled Active 25 MB Searched

Gathering

Sorting

Deduplicating

Checking

sis status Progress and Stages


36/41


Scheduling Deduplication

Default schedule:

system> sis on /vol/vol1

system> sis status

/vol/vol1 sun-sat@0

To configure a schedule:system> sis config -s - /vol/vol1

system> sis config -s 23@sun-fri /vol/vol1

system> sis config s auto /vol/vol1

system> sis config s sat@6 /vol/vol1


37/41


Other Commands

vol status command

SISkeyword will be listed in the output for deduplicationvolumes

system> vol status

Volume State Status OptionsVol0 online raid_dp, flex root

Vol1 online raid_dp, flex sis


38/41


System Manager: Deduplication

Deduplication

license was added

Start the dedupe


39/41


Module Summary

In this module, you should have learned to:

List the factors that impact space consumption

in Data ONTAP

Describe how and when a volume consumes

space from its containing aggregate Explain how to guarantee writes for a file

Discuss how Data ONTAP can provide more

space to a full volume State deduplication techniques available in

Data ONTAP


40/41

Exercise

Module 12: Space Management

Estimated Time: 45 minutes


41/41

Check Your Understanding

What is a fully provisioned volume?

A volume where space is taken from the

containing aggregate at the moment of volume

creation

What is a thin provisioned volume? A volume where space is taken from the

containing aggregate at the moment space is

allocated to files

Why would you use thin provisioned volumes? Allocating space to users that may use it is not

efficient; use to over-allocate an aggregate to

maximum space usage

M12-SpaceManagement

Documents

Transcript of M12-SpaceManagement