M13 Writes-Reads FINAL
-
Upload
subhrajitm47 -
Category
Documents
-
view
224 -
download
0
Transcript of M13 Writes-Reads FINAL
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 1/22
Write and ReadRequest Processing
Module 13
Data ONTAP® 7.3 Fundamentals
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 2/22
© 2008 NetApp. All rights reserved. 2
Module Objectives
By the end of this module, you should be able to:
Describe how data is written from and read to
a WAFL file system on a volume
Describe the WAFL file system, including
consistency points, RAID management, andstorage levels
Describe how RAID is used to protect disk data
Describe how the WAFL file system processeswrite and read requests
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 3/22
© 2008 NetApp. All rights reserved. 3
Data ONTAP Simplified
StorageRAIDProtocolsNetwork
Client
Disks
N e t w o r k
Data ONTAP
NVRAM
Client
Client
Client
Client
WAFL ®
Physical
Memory
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 4/22
© 2008 NetApp. All rights reserved. 4
Write Requests
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 5/22
© 2008 NetApp. All rights reserved. 5
Write Requests
Write requests are received by Data ONTAP
through multiple interface protocols:
– CIFS
– NFS
– FCP
– iSCSI
– HTTP
– WebDAV Write requests are buffered into:
– System memory
– NVRAM
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 6/22
© 2008 NetApp. All rights reserved. 6
Write Request Data Flow: Write Buffer
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
NV
R
A
M
NVRAM Full
WAFL
NVLOGNVLOG
NVLOG
NVLOG
NVLOG
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 7/22© 2008 NetApp. All rights reserved. 7
Consistency Point
A completely self-consistent image of the file
system. Although dynamic, if the file system
were frozen momentarily to capture its
structure –that is a consistency point
A consistency point occurs when designateddata is written to a disk and a new root inode is
determined
A consistency point occurs for multiple
reasons, including the following:
– One bank of the NVRAM card is full
– 10 seconds have elapsed
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 8/22© 2008 NetApp. All rights reserved. 8
Consistency Point (Cont.)
During a consistency point, Data ONTAP
flushes writes to disk
– Always writes to new data blocks
– The volume is always consistent on disk
When Data ONTAP flushes memory to disk: – It updates the file system ―atomically,‖ meaning
that the entire write must be completed or the
entire write is rolled back
– This includes all metadata
– After checking, the NVRAM is cleared
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 9/22© 2008 NetApp. All rights reserved. 9
WAFL
Write Request Data Flow: WAFL to RAID
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
NV
R
A
M
NVLOGNVLOG
NVLOG
NVLOG
NVLOG
NVRAM Full
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 10/22© 2008 NetApp. All rights reserved. 10
Consistency Point: WAFL to RAID
The RAID layer calculates the parity of thedata:
– To protect it from one or more disk failures
– To protect stripes of data
If a data disk fails, the missing information canbe calculated from parity
The storage system can be configured aseither:
– RAID 4— Allows one disk failure in the RAIDgroup
– RAID-DP— Allows up to two disk failures in theRAID group
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 11/22© 2008 NetApp. All rights reserved. 11
Write Request Data Flow: RAID to Storage
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
NV
R
A
M
NVLOGNVLOG
NVLOG
NVLOG
NVLOG
NVRAM Full
WAFL
4k
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 12/22© 2008 NetApp. All rights reserved. 12
Consistency Point: RAID to Storage
Storage layer commits the data and parity to
the physical disks
Two atomic checksums are calculated to verify
that the data is written consistently on the disks
The root inode is updated to point to the newfile inodes on the disk
The NVRAM is flushed and made available
The consistency point now is complete
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 13/22© 2008 NetApp. All rights reserved. 13
Write Request Data Flow: Storage Writes
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
NV
R
A
M
NVLOGNVLOG
NVLOG
NVLOG
NVLOG
NVRAM Full
WAFL
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 14/22© 2008 NetApp. All rights reserved. 14
NVRAM
Data ONTAP writes from system memory
– NVRAM is never used for normal write
operations
– NVRAM is backed up with a battery
If a system failure occurs before thecompletion of a consistency point, the data is
written from NVRAM when the system is
brought back online (or by the partner machine
in an active-active environment)
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 15/22© 2008 NetApp. All rights reserved. 15
Read Requests
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 16/22© 2008 NetApp. All rights reserved. 16
Read Requests
Every time a read request is received, WAFL
does one of the following:
– Reads the data from the system memory, also
known as ―cache‖
– Reads the data from the disks The cache is populated by:
– Data recently written to disk
– Data recently read from disk
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 17/22© 2008 NetApp. All rights reserved. 17
Read Request Data Flow: Cache
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
N
V
R
A
M
NVLOG
NVLOG
NVLOG
NVLOG
NVLOG
NVRAM Full
WAFL
Cache
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 18/22© 2008 NetApp. All rights reserved. 18
Read Request Data Flow: Read from Disk
Network
SAN Host
UNIX
Client
WindowsClient
NetworkStack
RS-232
HBA
NIC
Protocols
SAN
Service
NFS
Service
CIFS
Service
Memory Buffer
RAID
Storage
N
V
R
A
M
NVLOG
NVLOG
NVLOG
NVLOG
NVLOG
NVRAM Full
WAFL
Cache
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 19/22© 2008 NetApp. All rights reserved. 19
Module Summary
In this module, you should have learned to:
WAFL plans and manages storage
RAID protects data
The storage layer manages data transfer to
and from disk
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 20/22
Exercise
Module 13: Write and Read Request
Processing
Estimated Time: 10 minutes
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 21/22
Answers
Module 13: Write and Read Request
Processing
7/29/2019 M13 Writes-Reads FINAL
http://slidepdf.com/reader/full/m13-writes-reads-final 22/22
Check Your Understanding
What is a consistency point?
– A completely self-consistent image of the entire
file system
What is the purpose of RAID?
– To protect data—RAID striping is the methodused to protect disk data by which a parity value
is calculated across the disks in 4-Kb blocks
What is the storage layer?
– Handles the I/Os to disk and checks for disk
failures