Object storage

16
Object Storage Seminar Guide: Mr: R.Anand Mrs: G.Madhu Prepared by: Akash K T USN: 1CR11IS008 Department : ISE

Transcript of Object storage

Object Storage

Seminar Guide:Mr: R.Anand

Mrs: G.Madhu

Prepared by:

Akash K TUSN:1CR11IS008

Department:

ISE

Agenda

i. Abstract

ii. Existing technologies

iii. Comparison

iv. Drivers for Object-based storage

v. What is object based storage 1.Object

2.OSD(Object storage device)

3.MDS(Metadata Server)

vi. Key components of OSD

vii. Process of storing object in OSD

viii. Process of retrieving object from OSD

ix. Key benefits of Object based storage

Abstract

• Object Storage is the new storage paradigm. There is a high level of interest from organizations, as this new approach resolves the challenges of efficiently storing massive volumes of unstructured data - Big Unstructured Data

Two Technologies:

• Files:– Flexible data sharing– Secure

• Blocks:– High performance– Scalable

Blocks

Files

Comparison

Block Based Disk Object Based Disk

Operations: Read block Write block

Addressing: Block range

Operations:Create object Delete object Read objectWrite object

Addressing: [object, byte range]

Objects can be regarded as the convergenceof two technologies: files and blocks

Drivers for Object-based Storage

More than 90% of the data being generated is unstructured

Traditional solutions are inefficient to handle the growth

Object-based storage provides a smarter approach to manage unstructured data based on content

what is object based storage?

a way to store file data in the form of objects on a flat address space based on its content and attributes rather than the name and location

components of object based storage

• Object• OSD(Object-based storage Device)• MDS(Metadata Server)

Object

• An object is a logical unit of storage—ID (Identification)—Application data— Metadata which includes block allocation and

length—Attributes that is accessible by users

• Objects have file-like methods— open, close, read, write

• The root object -- The OSD itself• User object -- Created by SCSI

commands from the application or client

• Collection object -- A group of user

objects, such as all .mp3• Partition object -- Containers that

share common security and space management characteristics

CPU

Applications

System Call Interface

File SystemUser Component

File SystemStorage Component

Block I/O Manager

Storage Device

CPU

Applications

System Call Interface

File SystemUser Component

Object Interface

Interface

Two changes :Object-based storage offloads the storage component to the storage deviceThe device interface changes from blocks to objects

(a)Traditional

model

(b)Object storage

model

Object Storage Devices

File SystemStorage Component

Block I/O Manager

Storage Device

MDS(Metadata Server)

Key components of OSD

IP internal network

Metadata service

Storage service

OSD node Storage

OSD nodesInternal networkStorage

Application server

OSD system

Process of storing object in OSD

Metadata service

1.Application server sends file to OSD

6.Acknowledgement sent to application server

5.OSD stores user data using user service

Application server

Storage service

OSD node

2.OSD node divides file into two parts metadata and user data

3. OSD node generates object ID from user data

4. OSD stores metadata and object ID using metadata service

storage

Process of retrieving object from OSD

Metadata service

Storage service

Storage

1.Application server request file from OSD

2.metadata service locates object ID for the requested file

3.Metadata service sends object ID to application server

4.Application server sends object ID to OSD storage service for object retrieval

6.Storage service sends the file to the application server

5.OSD storage service retrieves the object from storage device

Application server

Storage service

OSD node

Key Benefits of object-based storage

• Security and Reliability

• Platform independence

• Scalability

• Manageability

Thank you