Erasure Code in Ceph
22
Erasure Code in Ceph Loic Dachary @ Red Hat
-
Upload
redhatstorage -
Category
Technology
-
view
182 -
download
0
Transcript of Erasure Code in Ceph
![Page 1: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/1.jpg)
Erasure Code in CephLoic Dachary @ Red Hat
![Page 2: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/2.jpg)
Save Space
![Page 3: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/3.jpg)
5 minutes role playing game
![Page 4: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/4.jpg)
XOR
![Page 5: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/5.jpg)
3 peta => 1.3 peta
![Page 6: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/6.jpg)
Harder object mutations / recovery
![Page 7: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/7.jpg)
Simple operations and tiering
Replicated Erasure Coded
![Page 8: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/8.jpg)
Promoted to replica on read
Replicated Erasure Coded
![Page 9: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/9.jpg)
Sam & David : internals
![Page 10: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/10.jpg)
Janne & Andreas & Loic & Takeshierasure code
![Page 11: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/11.jpg)
Released May 2014 : Firefly
![Page 12: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/12.jpg)
Why save space before shortage ?
![Page 13: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/13.jpg)
Reliability Model
● After an OSD is lost● Recovery● Backfilling a new OSD
![Page 14: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/14.jpg)
April 2015 : Hammer
![Page 15: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/15.jpg)
Repair K=10, M=4
![Page 16: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/16.jpg)
Locally Recoverable CodesLRC @ Red Hat
![Page 17: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/17.jpg)
SHEC Takeshi @ Fujitsu
![Page 18: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/18.jpg)
ISA plugin Yuan @ Intel
SIMD aka SSE2, SSE3, SSE4
Only for Intel processors
~50% Faster
![Page 19: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/19.jpg)
jerasure ARM Janne @ ARM
![Page 20: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/20.jpg)
Infernalis
![Page 21: Erasure Code in Ceph](https://reader034.fdocuments.in/reader034/viewer/2022052311/55ce7c16bb61eb1f498b474c/html5/thumbnails/21.jpg)
Hitchhiker Rashmi @ U.C. Berkeley