Post on 24-Jan-2017
BlackPearl: Spectra S3 vs. Standard S3
What is Spectra S3?
• Spectra S3 - a variation of Standard S3 popularized by Amazon. Used to archive and restore files to BlackPearl.
• Standard S3 is good for online, random access disk• Tape needs to write many files in sequence• Tape has a delay/latency on retrieval• Standard S3 doesn’t work with tape• Spectra S3 was created for tape• BlackPearl uses Spectra S3 to support tape• BlackPearl transfer rate with Spectra S3 exceeds 1 Gigabyte/second• Spectra S3, beyond archive and restore, includes over 200 API commands
STANDARD S3 PUT
Standard S3 - PUT
Standard S3 Public Cloud
Standard S3 Client
Standard S3 - PUT
Standard S3 Public Cloud
Standard S3 Client
“I am sending you one file and here it is.”
PUT file1.txt{file content}
Standard S3 - PUT
Standard S3 Public Cloud
Standard S3 Client
“I have received the file.”
200 OK
STANDARD S3 GET
Standard S3 - GET
Standard S3 Public Cloud
Standard S3 Client
Standard S3 - GET
Standard S3 Public Cloud
Standard S3 Client
“I am requestingone file.”
GET file1.txt
Standard S3 - GET
Standard S3 Public Cloud
Standard S3 Client
“Here is the file.”
200 OK{file content}
SPECTRA S3 PUT
Spectra S3 - Bulk PUT - 1
Spectra S3 BlackPearl
Spectra S3 Client
Spectra S3 - Bulk PUT - 1
Spectra S3 BlackPearl
Spectra S3 Client
“I will be sending youmultiple files. Here is a list of them and their sizes.”
START_BULK_PUT file1.txt 3GBfile2.txt 4GBfile3.txt 7GB
Spectra S3 - Bulk PUT - 1
Spectra S3 BlackPearl
Spectra S3 Client
“Okay. Here is your Job ID.”
200 OKJobId = 123ABC
Spectra S3 - Bulk PUT - 2
Spectra S3 BlackPearl
Spectra S3 Client
“Which files can I sendyou now?”
JOB_CHUNK JobId = 123ABC
Spectra S3 - Bulk PUT - 2
Spectra S3 BlackPearl
Spectra S3 Client
“You can send me these files”
200 OKfile1.txtfile2.txt
Spectra S3 - Bulk PUT - 3
Spectra S3 BlackPearl
Spectra S3 Client
“I am sending you one file for this job and here it is.”
PUT file1.txtJobId = 123ABC{file content}
Spectra S3 - Bulk PUT - 3
Spectra S3 BlackPearl
Spectra S3 Client
“I have received the file.”
200 OK
Spectra S3 - Bulk PUT - 4
Spectra S3 BlackPearl
Spectra S3 Client
“I am sending you one file for this job and here it is.”
PUT file2.txtJobId = 123ABC{file content}
Spectra S3 - Bulk PUT - 4
Spectra S3 BlackPearl
Spectra S3 Client
“I have received the file.”
200 OK
Spectra S3 - Bulk PUT - 5
Spectra S3 BlackPearl
Spectra S3 Client
“Which files can I sendyou now?”
JOB_CHUNK JobId = 123ABC
Spectra S3 - Bulk PUT - 5
Spectra S3 BlackPearl
Spectra S3 Client
“You can send me these files”
200 OKfile3.txt
Spectra S3 - Bulk PUT - 6
Spectra S3 BlackPearl
Spectra S3 Client
“I am sending you one file for this job and here it is.”
PUT file3.txtJobId = 123ABC{file content}
Spectra S3 - Bulk PUT - 6
Spectra S3 BlackPearl
Spectra S3 Client
“I have received the file.”
200 OK
SPECTRA S3 GET
Spectra S3 - Bulk GET - 1
Spectra S3 BlackPearl
Spectra S3 Client
Spectra S3 - Bulk GET - 1
Spectra S3 BlackPearl
Spectra S3 Client
“I want to retrieve multiple files. Here is a list of them.”
START_BULK_GET file1.txtfile2.txtfile3.txt
Spectra S3 - Bulk GET - 1
Spectra S3 BlackPearl
Spectra S3 Client
“Okay. Here is your Job ID.”
200 OKJobId = 123ABC
Spectra S3 - Bulk GET - 2
Spectra S3 BlackPearl
Spectra S3 Client
“Which files can I retrievefrom you now?”
JOB_CHUNK JobId = 123ABC
Spectra S3 - Bulk GET - 2
Spectra S3 BlackPearl
Spectra S3 Client
“You can retrieve these files”
200 OKfile1.txtfile2.txt
Spectra S3 - Bulk GET - 3
Spectra S3 BlackPearl
Spectra S3 Client
“I am requestingone file.”
GET file1.txtJobId = 123ABC
Spectra S3 - Bulk GET - 3
Spectra S3 BlackPearl
Spectra S3 Client
“Here is the file.”
200 OK{file content}
Spectra S3 - Bulk GET - 4
Spectra S3 BlackPearl
Spectra S3 Client
“I am requestingone file.”
GET file2.txtJobId = 123ABC
Spectra S3 - Bulk GET - 4
Spectra S3 BlackPearl
Spectra S3 Client
“Here is the file.”
200 OK{file content}
Spectra S3 - Bulk GET - 5
Spectra S3 BlackPearl
Spectra S3 Client
“Which files can I retrievefrom you now?”
JOB_CHUNK JobId = 123ABC
Spectra S3 - Bulk GET - 5
Spectra S3 BlackPearl
Spectra S3 Client
“You can retrieve these files”
200 OKfile3.txt
Spectra S3 - Bulk GET - 6
Spectra S3 BlackPearl
Spectra S3 Client
“I am requestingone file.”
GET file3.txtJobId = 123ABC
Spectra S3 - Bulk GET - 6
Spectra S3 BlackPearl
Spectra S3 Client
“Here is the file.”
200 OK{file content}