Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data...
Transcript of Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data...
![Page 1: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/1.jpg)
1
Christian BanduletPrincipal EngineerData Management AmbassadorSun Microsystems Inc. (Frankfurt, Germany)
GUUG-Frühjahrsfachgespräch 2008
The File Systems Survey
![Page 2: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/2.jpg)
2© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
![Page 3: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/3.jpg)
3© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
![Page 4: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/4.jpg)
4© Copyright: [email protected]
File Systems
Userspace
File System & Operating System
Kernelspace
mmap()
User Application and Libraries (ls, mv, rm, cp, ...)
Process Management
MemoryMgmt Scheduler IPC
Metadata Cache*Segmap Cache
Volume Manager
machine dependent codeHardware
System Calls (open(), close(), read(), write(), ioctl(), mmap(), ...)
DMA
VFS
Device DriversBuffers*can be
bypassed:Direct I/O
![Page 5: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/5.jpg)
5© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
![Page 6: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/6.jpg)
6© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• local/Disk File Systems> # ADFS – Acorn's Advanced Disc filing system, successor to DFS.> # BFS – the Be File System used on BeOS> # EFS – Encrypted filesystem, An extension of NTFS> # EFS (IRIX) – an older block filing system under IRIX.> # Ext – Extended filesystem, designed for Linux systems> # Ext2 – Second extended filesystem, designed for Linux systems.> # Ext3 – Name for the journalled form of ext2.> # FAT – Used on DOS and Microsoft Windows, 12, 16 and 32 bit table depths> # FFS (Amiga) – Fast File System, used on Amiga systems. This FS has evolved over
time. Now counts FFS1, FFS Intl, FFS DCache, FFS2.> # FFS – Fast File System, used on *BSD systems> # Fossil – Plan 9 from Bell Labs snapshot archival file system.> # Files-11 – OpenVMS filesystem> # GCR – Group Code Recording, a floppy disk data encoding format used by the Apple II
and Commodore Business Machines in the 5¼" disk drives for their 8-bit computers.> # HFS – Hierarchical File System, used on older Mac OS systems
![Page 7: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/7.jpg)
7© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• local/Disk File Systems (cont'd)> # HFS Plus – Updated version of HFS used on newer Mac OS systems> # HPFS – High Performance Filesystem, used on OS/2> # ISO 9660 – Used on CD-ROM and DVD-ROM discs (Rock Ridge and Joliet are
extensions to this)> # JFS – IBM Journaling Filesystem, provided in Linux, OS/2, and AIX> # LFS – 4.4BSD implementation of a log-structured file system> # MFS – Macintosh File System, used on early Mac OS systems> # Minix file system – Used on Minix systems> # NTFS – Used on Windows NT, Windows 2000, Windows XP and Windows Server
2003 systems> # NSS – Novell Storage Services. This is a new 64-bit journaling filesystem using a
balanced tree algorithm. Used in NetWare versions 5.0-up and recently ported to Linux.> # OFS – Old File System, on Amiga. Nice for floppies, but fairly useless on hard drives.> # PFS – and PFS2, PFS3, etc. Technically interesting filesystem available for the Amiga,
performs very well under a lot of circumstances. Very simple and elegant.> # ReiserFS – Filesystem that uses journaling> # Reiser4 – Filesystem that uses journaling, newest version of ReiserFS> # SFS – Smart File System, journaled file system available for the Amiga platforms.> # UDF – Packet based filesystem for WORM/RW media such as CD-RW and DVD.
![Page 8: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/8.jpg)
8© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• Local/Disk File Systems (cont'd)> # UDF – Packet based filesystem for WORM/RW media such as CD-RW and DVD.> # UFS – Unix Filesystem, used on older BSD systems> # UFS2 – Unix Filesystem, used on newer BSD systems> # UMSDOS – FAT filesystem extended to store permissions and metadata, used for
Linux.> # VxFS – Veritas file system, first commercial journaling file system; HP-UX, Solaris,
Linux, AIX> # VSAM> # WAFL – Used on Network Appliance systems> # XFS – Used on SGI IRIX and Linux systems> # ZFS – Used on Solaris 10
![Page 9: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/9.jpg)
9© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• Distributed/Network File Systems> * 9P The Plan 9 and Inferno distributed file system> * AFS (Andrew File System)> * AppleShare> * Arla (file system)> * Coda> * CXFS (Clustered XFS) a distributed networked file system designed by
Silicon Graphics (SGI) specifically to be used in a SAN> * Distributed File System (DCE)> * Distributed File System (Microsoft)> * Freenet> * Global File System (GFS)> * Google File System (GFS)> * IBRIX Fusion™> * InterMezzo> * Isilon OneFS™> * Lustre> * NFS> * OpenAFS> * Server message block (SMB) (aka Common Internet File System (CIFS)
or Samba file system)> * Xsan (a storage area network (SAN) filesystem from Apple Computer,
Inc.)>
![Page 10: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/10.jpg)
10© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• Special Purpose File Systems> # acme (Plan 9) (text windows)> # archfs (archive)> # cdfs (reading and writing of CDs)> # cfs (caching)> # Davfs2 (WebDAV)> # devfs> # ftpfs (ftp access)> # fuse (filesystem in userspace, like lufs but better maintained)> # GPFS an IBM cluster file system> # JFFS/JFFS2 (filesystems designed specifically for flash devices)> # lnfs (long names)> # LUFS ( replace ftpfs, ftp ssh ... access)> # nntpfs (netnews)> # OCFS (Oracle Cluster File System)
![Page 11: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/11.jpg)
11© Copyright: [email protected]
http://en.wikipedia.org/wiki/List_of_file_systems#Network_file_systems
• Special Purpose File Systems (cont'd)> # ParFiSys (Experimental parallel file system for massively parallel processing)> # plumber (Plan 9) (interprocess communication – pipes)> # procfs> # romfs> # specfs (Special Filesytem for device files )> # SquashFS (compressed read-only)> # sysfs (Linux)> # tmpfs> # wikifs (Plan 9) (wiki wiki)> # pvfs (Parallel Virtual File System)> # pvfs2 (Parallel Virtual File System, 2nd generation)
![Page 12: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/12.jpg)
12© Copyright: [email protected]
IBM AFSIBM AFS
Oracle OPS/RAC
VERITAS CFSVERITAS CFS
PolyS erve Matrix S erver
HP TruCluster/CFSHP TruCluster/CFSADIC StorNext FSADIC StorNext FS
NFSNFS
CIFSCIFS
SambaSamba
IBM SANergyIBM SANergy
Sybase MPP
SGI CXFS
Informix XPS
Redhat GFSRedhat GFS
EMC HighRoadEMC HighRoad
RFSRFS
DFSDFS
CodaCoda
S un QFSS un QFSPPFSPPFS
DB2DB2
SMBSMB
ISO9660ISO9660
WebNFSTacit Networks ITacit Networks Isharedshared
Cisco FileEngineCisco FileEngineDiskSites FilePort
Nuview StorageXNuview StorageX
Some Technologies and Products…
SUN SAM-QFS
Sanbolic M elio FS
WebFSWebFSIBM Storage TankIBM Storage Tank
OpenAFSOpenAFS
Isilon IQ OneFSIsilon IQ OneFS
IBRIX Fus ionFSONStor STOR-FSONStor STOR-FSWAFSWAFS
PVFS
OSD
WebNFS
pNFSpNFS
Apple Xsan
Lustre
FineGround
Source: www.snia.org
![Page 13: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/13.jpg)
13© Copyright: [email protected]
FS & Storage Architectures
StorageArchitecture
DAS NAS SAN ClusteredStorageObject
File systems can run on arbitrary storage architectures:
![Page 15: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/15.jpg)
15© Copyright: [email protected]
File System TaxonomyFile
System
Distributed FS Local FS
WAFS Network FSGlobal
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 16: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/16.jpg)
16© Copyright: [email protected]
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
File System TaxonomyFile
System
Distributed FS Local FS
WAFS Network FSGlobal
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 17: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/17.jpg)
17© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 18: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/18.jpg)
18© Copyright: [email protected]
Local FS
• Co-located with application server
Local FS
ApplicationFile System
![Page 19: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/19.jpg)
19© Copyright: [email protected]
Local FS
• Islands of storage (limited data sharing)
Local FS
ApplicationFile System
Local FS
ApplicationFile System
Local FS
ApplicationFile System
Local FS
ApplicationFile System
![Page 20: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/20.jpg)
20© Copyright: [email protected]
Host
Traditional File System - Inode• The inode contains a few block numbers to ensure efficient access
to small files. Access to larger files is provided via indirect blocks that contain block numbers
0 1 2 3 45 6 7 8 9
10 11 12 13 14
15 16 17 18 19
Host
Data Blocks
Inodedirect 0 data blockdirect 1 data blockdirect 2 data blockdirect 3 data blockdirect 4 data blockdirect 5 data blockdirect 6 data blockdirect 7 data blockdirect 8 data blockdirect 9 data blocksingle
indirectdoubleindirecttriple
indirect
data blockdata blockdata block
![Page 21: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/21.jpg)
21© Copyright: [email protected]
Logical to Physical Translation
Hieroglyphs: 3100 B.C - 400 A.D
Rosetta Stone: was created in 196 BC, discovered by the French in 1799 at Rosetta, a harbor on the Mediterranean coast in Egypt, and translated in 1822 by Frenchman Jean-François Champollion
![Page 22: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/22.jpg)
22© Copyright: [email protected]
Host
Data Blocks
Traditional File System - Inode
Inodedirect 0 data blockdirect 1 data blockdirect 2 data blockdirect 3 data blockdirect 4 data blockdirect 5 data blockdirect 6 data blockdirect 7 data blockdirect 8 data blockdirect 9 data blocksingle
indirectdoubleindirecttriple
indirect
data blockdata blockdata block
• The inode also contains file attributes...
File OwnerFile Type
PermissionsLast Access
Size# of links
...File Attributes:
0 1 2 3 45 6 7 8 9
10 11 12 13 14
15 16 17 18 19
![Page 23: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/23.jpg)
23© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 24: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/24.jpg)
24© Copyright: [email protected]
Network Files System – aka Proxy FS
Local FS Network FS
ApplicationFile System
ApplicationFile System
Client
File SystemServer
• A network file system is any computer file system that supports sharing of files over a computer network protocol
ApplicationFile System
Client
ApplicationFile System
Client
ApplicationFile System
Client
Network Protocol*
* e.g. NFS, CIFS, AFP, WebDAV, FTP, HTTP, ...
Device Sharing ≠ Data Sharing
![Page 25: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/25.jpg)
25© Copyright: [email protected]
Local FS and Proxy FS
Local FSServer
Application
Proxy FSClient
Application
Server
Name ServiceSpace Mgmt
Name ServiceSpace Mgmt
![Page 26: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/26.jpg)
26© Copyright: [email protected]
NFSv4 Single-Server Namespace ExtensionServer Pseudo FS – aka Shared Name Space
NFS Client NFS Client NFS Client NFS Client
NFSv4 server view:
/a /b /c
Transparent Files SystemTransitions
NFS Server / /a /b /c NFSv4 client view:
SAN
The NFSv4 spec (RFC 3530) defines how a server maintains a pseudo-filesystem namespace linking the filesystems it shares, so that clients can navigate to them from the server root. Many clients rely on this "single server namespace" to be able to access all filesystems on the server transparently.
![Page 27: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/27.jpg)
27© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Network FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 28: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/28.jpg)
28© Copyright: [email protected]
Distributed File System (DFS)Distributed FS
ApplicationFile System
Client
File SystemServer
/a
File SystemServer
/b
File SystemServer
/c
Network Protocol
Single FS
• A distributed file system is a network file system whose clients, servers, and storage devices are dispersed among the machines of a distributed system or intranet ( ≠ Parallel FS)
/ /a /b /c client view:
![Page 29: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/29.jpg)
29© Copyright: [email protected]
Distributed File System (DFS)Andrew FS (AFS), www.OpenAFS.org, Coda
Server II“read /home/a/b/c/foo.exe”
“/”
Server III
“/home/a”
Server I
“/home/a/b/c”
Server V
“/home/a/b”
Server VI
“/home”
Server IV
“/hom/a/b/c/foo.exe”
1
2
4
3
5
• Using Ethernet as a networking protocol between nodes, a DFS allows a single file system to span across all nodes in the DFS cluster, effectively creating a unified logical namespace for all files.
Single FS
![Page 30: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/30.jpg)
30© Copyright: [email protected]
Distributed File System (DFS)MS Distributed File System (DFS)
“read /home/a/b/c/foo.exe”
DFS Root Server
FileServer II
FileServer III
FileServer I
1?
?
?
• Uniting files on different computers into a single namespace• With DFS, you can make files distributed across multiple servers appear
to users as if they reside in one place on the network• Users no longer need to know and specify the actual physical location of
files in order to access them.• Logical file location is de-coupled from physical location
TransparentMigration
2
Single FS
![Page 31: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/31.jpg)
31© Copyright: [email protected]
NFSv4.1 – Multi-Server Name Space
/a
NFS Server A
NFS Client
NFS Server B
/b
NFS Server C
/c
/ /a /b /c NFSv4 client view:
SAN SAN SAN
NFSv4.1 supports attributes that allow a namespace to extend beyondthe boundaries of a single server through location attributes. A server can
inform a client that data it seeks lives at another location; this is called “referral”, and referrals can be used to construct an enterprise namespace
fs_location attribute enables:referral, replicas,clones, migration
Referral
Single FS
![Page 32: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/32.jpg)
32© Copyright: [email protected]
NFS RDMA Problem StatementBlock Diagram:
• http://ietf.org/html.charters/nfsv4-charter.html• http://ietf.org/internet-drafts/draft-ietf-nfsv4-nfs-rdma-problem-statement-05.txt• http://ietf.org/internet-drafts/draft-ietf-nfsv4-rpcrdma-04.txt• http://ietf.org/internet-drafts/draft-ietf-nfsv4-nfsdirect-04.txt
NFS NFS + RDMA
Operations/ProceduresRPC/XDR
TCP/IP RDMA Transport
Ethernet iWARP IB
![Page 33: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/33.jpg)
33© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 34: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/34.jpg)
34© Copyright: [email protected]
WAFS – aka Network Compression Problem Statement
Datacenter
SANSAN
NAS Server
Data
NFS/CIFS Client
IPIP
NFS/CIFS Client
NFS/CIFS Client NFS/CIFS Client
Remote Office
NFS/CIFS Client
IPIP
NFS/CIFS Client
NFS/CIFS Client NFS/CIFS Client
Remote Office
NAS Protocol
NAS Protocol
WANWAN
![Page 35: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/35.jpg)
35© Copyright: [email protected]
WAFS (NAS Aggregation/Virtualization)
SANSAN
NAS Server
Data
NFS/CIFS Client
IPIP
NFS/CIFS Client
NFS/CIFS Client NFS/CIFS Client
Remote Office (NAS Protocol)
NFS/CIFS Client
IPIP
NFS/CIFS Client
NFS/CIFS Client NFS/CIFS Client
Private Protocol*
WAFS EdgeAppliance
WAFS EdgeAppliance
WAFS CoreAppliance
Remote Office (NAS Protocol)
Datacenter (NAS Protocol)Private Protocol*
WANWAN
* compression, byte level differentiation,deferred write, read-ahead, TPC/IP optimization, ...
LAN-like file access over WAN
![Page 36: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/36.jpg)
36© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 38: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/38.jpg)
38© Copyright: [email protected]
Scale-Out
HorizontalScaling
...
• Creating islands of data• Replication of data
![Page 39: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/39.jpg)
39© Copyright: [email protected]
Scale-Out with Shared FS
HorizontalScaling ...
SharedData
Storage NetworkStorage Network
![Page 40: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/40.jpg)
40© Copyright: [email protected]
MDS Client
Shared FS & Metadata
1
MDS Client
2
MDS Client
3
• File access as a two-step transaction...
![Page 41: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/41.jpg)
41© Copyright: [email protected]
Shared FS – SAN FSApplication Server Application Server Application Server Application Server Application Server
Applicatione.g. Web Server
Applicatione.g. Web Server
Applicatione.g. Web Server
SharedData
Storage NetworkStorage Network
MDS (active) MDS (passive)
• MDS is part of each cluster node master slave (asymmetric)• Heterogeneous with unlimited number of nodes• unlimited distance between nodes
SAN FS SAN FS SAN FS
![Page 42: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/42.jpg)
42© Copyright: [email protected]
Shared FS – Cluster FSApplication Server
Applicatione.g. Web Server
Application Server Application Server Application Server Application Server
Cluster File system (Heart Beat, Lock Mgmt, coherence, global namespace...)optional layer: Cluster Volume Manager
Applicatione.g. Web Server
Applicatione.g. Web Server
Applicatione.g. Web Server
Applicatione.g. Web Server
SharedData
Storage NetworkStorage Network
MDS (active) MDS (active) MDS (active) MDS (active) MDS (active)
• MDS is part of each cluster node peer-to-peer (symmetric)• Homogenous with limited number of nodes• Limited distance between nodes
![Page 43: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/43.jpg)
43© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 44: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/44.jpg)
44© Copyright: [email protected]
ApplicationServer
Disk Array
Global FS (~ Shared FS)Data Sharing
ApplicationServer
ApplicationServer
ApplicationServer
![Page 45: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/45.jpg)
45© Copyright: [email protected]
ApplicationServer
Global & Network File System
ApplicationServer
ApplicationServer
ApplicationServer
Storage Network(Networking Protocol)
Storage Server
![Page 46: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/46.jpg)
46© Copyright: [email protected]
Distributed File System (DFS)Distributed FS
ApplicationFile System
Client
File SystemServer
/a
File SystemServer
/b
File SystemServer
/c
Network Protocol
Single FS
• Files are distributed across file servers
/ /a /b /c client view:
![Page 47: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/47.jpg)
47© Copyright: [email protected]
Disk Array
Parallel Data Access – RAID 0,5
Data
Stripe Unit Stripe Unit Stripe Unit Stripe Unit Stripe Unit
Disk Array Disk Array Disk Array Disk Array
Data segments are striped across storage devices
![Page 48: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/48.jpg)
48© Copyright: [email protected]
ApplicationServer
Global,Distributed & Parallel File SystemFile Segments distributed across storage nodes
ApplicationServer
ApplicationServer
ApplicationServer
File
StorageServer
StorageServer
StorageServer
StorageServer
StorageServer
SAN(Networking Protocol)
Aggregation of Storage Servers:RAIN + RAID
(aka Network RAID)Single Data Image
![Page 49: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/49.jpg)
49© Copyright: [email protected]
Global Distributed Parallel FS
ServerApplication
MDSName Service
ServerApplication
ServerApplication
Storage ServerSpace Mgmt
Storage ServerSpace Mgmt
Storage ServerSpace Mgmt
SAN(Networking Protocol)
![Page 50: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/50.jpg)
50© Copyright: [email protected]
Lustre™ Cluster File System
• The worlds most scalable parallel filesystem
• 10,000’s of clients• Proven technology at major HPC
installations:> Tokyo Tech, TACC (Sun),
LANL, LLNL, Sandia, PNNL, NCSA, etc.
• 70% of Top10 run Lustre• 50% of Top30 run Lustre• 15% of Top500 run Lustre
World’s Largest Network-Neutral Data Storage and Retrieval System
![Page 51: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/51.jpg)
51© Copyright: [email protected]
Ethernet, Infiniband, Quadrics, Myrinet
Lustre clients (up to 10,000's)
- Lustre treats files as objects- files can be striped across OSDs- Lustre also provides OSD drivers for other Linux file system: ext3, JFS, ReiserFS, XFS
Distributed Objects Storage Target (i.e. Linux nodes)
MDS
MDS
MDS
OST OST OST OST
OBD OBD OBD OBD
Meta Data Server (up to 10's)
Object Storage Targets (up to 1000's)
Lustre Global, Distributed & Parallel FS
![Page 52: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/52.jpg)
52© Copyright: [email protected]
Lustre: File/Object striped across 3 OST's
SCSI Port to OSiSCSI
TCP/IPAdapter Driver
Object APIExt3, reiser
LinuxBlock Driver
OSTSCSI Port to OS
iSCSITCP/IP
Adapter Driver
Object APIExt3, reiser
LinuxBlock Driver
OSTSCSI Port to OS
iSCSITCP/IP
Adapter Driver
Object APIExt3, reiser
LinuxBlock Driver
OST
File/Object
![Page 53: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/53.jpg)
53© Copyright: [email protected]
Object Storage Target
Lustre & Thumper
Object-Based Cluster File system Target
+ =X4500 – aka Thumper
24TB on 4U
![Page 54: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/54.jpg)
54© Copyright: [email protected]
SCSI Port to OSObject APIMDS
iSCSITCP/IP
Adapter DriverLinux-onlyOpenSourceOSD stack
as Linux Patch
ClientiSCSITCP/IP
Adapter DriverLinux-onlyOpenSourceOSD stack
as Linux Patch
ClientiSCSITCP/IP
Adapter DriverLinux-onlyOpenSourceOSD stack
as Linux Patch
ClientiSCSITCP/IP
Adapter DriverLinux-onlyOpenSourceOSD stack
as Linux Patch
Client
TITech & TACC
SCSI Port to OSiSCSI
TCP/IPAdapter Driver
Object APIExt3, reiser
LinuxBlock Driver
X4500SCSI Port to OS
iSCSITCP/IP
Adapter Driver
Object APIExt3, reiser
LinuxBlock Driver
X4500SCSI Port to OS
iSCSITCP/IP
Adapter Driver
Object APIExt3, reiser
LinuxBlock Driver
X4500
Heterogeneous Block Storage Devices
......
SCSI Port to OSObject APIMDSiSCSI
TCP/IPAdapter Driver
Linux-onlyOpenSourceOSD stack
as Linux Patch
Client
Lustre used to run proprietary Sandia Labs Protocol
between clients and OSTs – now they are using LNET
Linux100's
Storage Nodes
active
standby
IB, Myrinet, IB, Myrinet, Quadrics, GbEQuadrics, GbE
1-10.000'sCompute Nodes
![Page 55: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/55.jpg)
55© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 56: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/56.jpg)
56© Copyright: [email protected]
FS Virtualization – NAS AggregationIn-Band
Application Server Application Server Application Server Application Server Application Server Application Server
SANSAN
NAS Appliance
Data
SANSAN
NAS Appliance
Data
SANSAN
NAS Appliance
Data
SANSAN
NAS Appliance
Data
SANSAN
NAS Appliance
Data
Provides Global
Namespace!
IPIP
NAS Router
Data
![Page 57: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/57.jpg)
57© Copyright: [email protected]
Application Server
IP
In-Band NAS:
IP
Out-of-Band NAS:Application Server Application ServerApplication Server Application ServerApplication Server Application ServerApplication Server Application ServerApplication Server Application ServerApplication Server
SAN SAN
Data
NAS Appliance
Data
NAS Appliancewith NFSv4.1
pNFS extensions
FS Virtualization – NFS4.1 pNFS
NFSv4.1 client with pNFS
NFSv4.1 client with pNFS
NFSv4.1 client with pNFSNFSv4 client NFSv4 client NFSv4 client
Storage Protocol:SCSI (FCP, iSCSI, SRP),
NFS, OSD
![Page 58: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/58.jpg)
58© Copyright: [email protected]
NAS Appliancewith NFSv4.1
pNFS extensions
Data
Global Namespace
NAS Appliancewith NFSv4.1
pNFS extensions
Data
NFSv4.1 + pNFS
NFSv4.1
File: NFSv4.1Block: iSCSI, FCP, SRP
OSD: AINSI T10 OSD
one-to-one, stripe, concatenation
MDS createsGlobal
Namespace
Storage Protocol:SCSI, NFS, OSD
Control Protocol
NFSv4.1 client with pNFS
NFSv4.1 client with pNFS
NFSv4.1 client w/o pNFS
FS Virtualization – NFSv4.1 pNFSOut-of-Band
![Page 59: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/59.jpg)
59© Copyright: [email protected]
FS Virtualization – File Area Network
SANGlobal Address Space
(WWN, 24-bit fabric addresses, nameserver),
zoning, routing, ...
Storage Device Storage Device Storage Device Storage Device Storage Device
Server Server Server Server Server
![Page 60: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/60.jpg)
60© Copyright: [email protected]
FS Virtualization – File Area Network
FANGlobal Namespace,
load-balancing, network compression(WAFS), data protection (security,
replication, ...), SLA/ILM (migration,retention), ...
NAS ClientNAS ClientNAS Client NAS Client NAS Client
Global Address Space (WWN, 24-bit fabric address,
nameserver),zoning, routing, ...SAN
Storage Device Storage Device Storage Device Storage Device Storage Device
NAS Server NAS Server NAS Server NAS Server NAS Server
![Page 61: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/61.jpg)
61© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 62: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/62.jpg)
62© Copyright: [email protected]
Scalable NAS (NFS & Shared FS)
IPIP
NFSClient
NFSClient
NFSClient
NFSClient
NFSClient
MDS*
Shared FS with Shared Device
Shared FS Shared FS Shared FS
*MDS optional
MDS*
Scalable NFS with Shared FS
Shared FS Shared FS Shared FS
*MDS optional
NFSServer
NFSServer
NFSServer
![Page 63: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/63.jpg)
63© Copyright: [email protected]
Agenda• File System Basics• File Systems Taxonomy• Local FS• Distributed FS• Wide Area FS• Shared FS (SAN FS, Cluster FS)• Global, Distributed and Parallel FS• File System Virtualization• Scalable NAS• NAS Cluster / NAS Grid
Scalable NAS / NAS Clustering/ NAS Grid NAS Aggregation
aka Filesystem Virtualization
FileSystem
Distributed FS Local FS
WAFS Network FS Global
Distributed Parallel FS
Shared FS
SAN FS Cluster FS
![Page 64: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/64.jpg)
64© Copyright: [email protected]
NAS Scale-Out Problem Statement
HorizontalScaling ...
NASAppliance
NASAppliance
NASAppliance
NASAppliance
• Creating islands of data• Replication of data
![Page 65: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/65.jpg)
65© Copyright: [email protected]
NAS Cluster / NAS GridApplication Server Application Server Application Server Application Server Application Server Application Server
Single Data ImageGlobal Namespace
VIP
NAS Appliance
Data
NAS Appliance
Data
NAS Appliance
Data
NAS Appliance
Data
![Page 66: Christian Bandulet File Systems Survey - Home | … · 1 Christian Bandulet Principal Engineer Data Management Ambassador Sun Microsystems Inc. (Frankfurt, Germany) GUUG-Frühjahrsfachgespräch](https://reader031.fdocuments.in/reader031/viewer/2022020304/5b9fa9e809d3f2857a8b775a/html5/thumbnails/66.jpg)
66
Christian BanduletPrincipal EngineerData Management AmbassadorSun Microsystems Inc. (Frankfurt, Germany)
GUUG-Frühjahrsfachgespräch 2008
The File Systems Survey