How to build system storage bigfile
-
Upload
tien-nguyen-van -
Category
Technology
-
view
147 -
download
3
description
Transcript of How to build system storage bigfile
![Page 2: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/2.jpg)
Architecture
![Page 3: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/3.jpg)
Upload
![Page 4: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/4.jpg)
Download
![Page 5: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/5.jpg)
Applications
![Page 6: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/6.jpg)
Architecture
![Page 7: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/7.jpg)
SBFSession
SBFProfiles
SBFMeta
SBFUserItems
IDZen
Frontend
SBFUpload
FilePoolSBFWork
er
SBFChunks
SBFZenTok
SBFDownload
Java, C++LibEvent, Poco,KyotoCabinet
![Page 8: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/8.jpg)
Upload
![Page 9: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/9.jpg)
SBFSession
SBFProfiles
SBFMeta
SBFUserItems
IDZen
Frontend
SBFUpload
FilePoolSBFWork
er
SBFChunks
1: reqPageUp
SBFZenTok
2b:genTok 3:tok2a:checkUser
SBFDownload
4:pageUp4:up(tok)
5a:check(tok)
6a:genId()
6b:writeFile(id)
7: putMeta
9:notify
8: putUsersFile
10: readFile
12: putChunks
11: genIds
6c: fileId
![Page 10: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/10.jpg)
Download
![Page 11: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/11.jpg)
SBFSession
SBFProfiles
SBFMeta
SBFUserItems
IDZen
Frontend
SBFUpload
FilePoolSBFWork
er
SBFChunks
1: reqPageDown
SBFZenTok
SBFDownload
4:pageDown
2a:checkUser2b:genTok 3:tok
4:down(tok)
5:getMeta
6:getChunks
loop
sendChunks
![Page 12: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/12.jpg)
One more thing
![Page 13: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/13.jpg)
SBFSession
SBFProfiles
SBFMeta
SBFUserItems
IDZen
Frontend
SBFUpload
FilePoolSBFWork
er
SBFChunks
SBFZenTok
SBFDownload
SBFChunks
SBFDownload
Node 1
SBFUpload
FilePoolSBFWork
er
SBFDownload
SBFChunks
Node 2
SBFNodeInfo
SBFBroker
![Page 14: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/14.jpg)
Applications
![Page 15: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/15.jpg)
Issues
Disk Bottleneck
Chunk Size, Sector Size, Block Size
Speed process file slow when concurrent upload high
![Page 16: How to build system storage bigfile](https://reader035.fdocuments.in/reader035/viewer/2022062514/55865666d8b42a221b8b475d/html5/thumbnails/16.jpg)
Bottleneck disk