GlusterFS as a Distributed File System (DFS)

Department of Computer EngineeringK. N. Toosi Univ. of Technology

Lecturer: Mahmoud Shiri VaraminiMar 4 2017

2

Agenda

What’s file system and List of file systems

DFS fundamental

Distributed parallel fault-tolerant file systems

Type of storage

Advantages of using object storage

What is gluster

GlusterFS data access overview

Gluster Architecture

Q & A

3

List of file systems

● Disk file systems (Btrfs,FAT,ext3,ext4,ntfs,ZFS,XFS,HFS,ReiserFS , ...)

● File systems with built-in fault-tolerance (Btrfs,ZFS,Reliance,HAMMER, …)

● Distributed parallel fault-tolerant file systems(BeeGFS ,Ceph,Gluster,Google File System (GFS),Hadoop Distributed File System,XtreemFS , ...)

4

DFS fundamental

● What’s DFS

● Why We should use DFS

● DFS case study

● cons and pros of DFS

● DFS vs SDS

● The future of DFS

5

Distributed parallel fault-tolerant file systems

● Distributed file systems, which also are parallel and fault tolerant, stripe and replicate data over multiple servers for high performance and to maintain data integrity.

● Even if a server fails no data is lost. The file systems are used in both high-performance computing (HPC) and high-availability clusters.

6

Type of Storage

● File-level storage

● Block-level storage

● Object storage

7

Advantages of using object storage

● Data model (structured vs unstructured)

● Protocol (NFS,SMB,iSCSI,FC)

● Type of access (locally,remote)

● Access data (server,network,API)

● Caching and meta data mechanism

● Performance and Scability

● Use case (physical,virtual,cloud)

● Real world scenario

8

What is Gluster? (1)

● GlusterFS is a SDS solution for any industry.

● GlusterFS is a scalable network filesystem.

● Using common off-theshelf hardware, you can create large, distributed storage solutions for media streaming, data analysis, and other data- and bandwidth-intensive tasks.

● GlusterFS is free and open source software.

9

What is Gluster? (2)

● Scalable, general-purpose storage platform

● POSIX-y Distributed File System

● Object storage (swift)

● Distributed block storage (qemu)

● Flexible storage (libgfapi)

● No Metadata Server

● Heterogeneous Commodity Hardware

● Flexible and Agile Scaling

● Capacity – Petabytes and beyond

● Performance – Thousands of Clients

10

GlusterFS data access overview

● GlusterFS Native Client

● Filesystem in Userspace (FUSE)

● NFS

● Built-in Service, NFS-Ganesha with libgfapi

● SMB/CIFS

● Samba server required (libgfapi based module)

● Gluster For OpenStack (Swift-on-file)

● Object-based access via Swift

● libgfapi flexible abstracted storage

● Integrated with QEMU, Bareos and oth

11

Gluster Architecture

12

Q & A

Questions?

You can contact me via:shirivaramini@gmail.com

13

Thank You!