ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM:...
Transcript of ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM:...
![Page 1: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/1.jpg)
Motivation Design Evaluation Discussion
ATOM: Automated Tracking, Orchestration andMonitoring of Resource Usage in Infrastructure as
a Service Systems
Min Du, Feifei Li
School of Computing, University of Utah
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 2: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/2.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Monitor the Cloud
I To provide system-wide visibility
I CloudWatch (AWS/Eucalyptus)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 3: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/3.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Monitor the Cloud
I To provide system-wide visibility
I CloudWatch (AWS/Eucalyptus)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 4: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/4.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Monitor the Cloud
I To provide system-wide visibility
I CloudWatch (AWS/Eucalyptus)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 5: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/5.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Monitor the Cloud
I To provide system-wide visibility
I CloudWatch (AWS/Eucalyptus)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 6: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/6.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Monitor the Cloud
I To provide system-wide visibility
I CloudWatch (AWS/Eucalyptus)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 7: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/7.jpg)
Motivation Design Evaluation Discussion
A Simplified Cloud
Questions
1. Monitor more efficiently?
2. Utilize the statistics for security
purpose?
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 8: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/8.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 9: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/9.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 10: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/10.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 11: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/11.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 12: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/12.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 13: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/13.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 14: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/14.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 15: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/15.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 16: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/16.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 17: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/17.jpg)
Motivation Design Evaluation Discussion
ATOM Architecture
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 18: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/18.jpg)
Motivation Design Evaluation Discussion
Tracking Component
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 19: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/19.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 20: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/20.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 21: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/21.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 22: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/22.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 23: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/23.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 24: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/24.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 25: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/25.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 26: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/26.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 27: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/27.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 28: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/28.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 29: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/29.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 30: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/30.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 31: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/31.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 32: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/32.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 33: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/33.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
* Values sent: {0, 6, 0, 6, 0, 6, ...}
* Optimal offline algorithm couldonly send one value: 3
* Competitive ratio: Unbounded
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 34: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/34.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
* Values sent: {0, 6, 0, 6, 0, 6, ...}* Optimal offline algorithm could
only send one value: 3
* Competitive ratio: Unbounded
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 35: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/35.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I A naive way:
* Values sent: {0, 6, 0, 6, 0, 6, ...}* Optimal offline algorithm could
only send one value: 3
* Competitive ratio: Unbounded
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 36: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/36.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 37: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/37.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 38: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/38.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 39: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/39.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 40: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/40.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 41: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/41.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 42: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/42.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 43: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/43.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
* Values sent: {0, 3}* Competitive ratio: log ∆
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 44: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/44.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
* Values sent: {0, 3}
* Competitive ratio: log ∆
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 45: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/45.jpg)
Motivation Design Evaluation Discussion
Tracking Component
What if a small error ∆ is allowed?
I Sequence: {0, 6, 0, 6, 0, 6, ...}; ∆ = 4
I The optimal one dimension online tracking algorithm:
* Values sent: {0, 3}* Competitive ratio: log ∆
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 46: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/46.jpg)
Motivation Design Evaluation Discussion
Tracking Component
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 47: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/47.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 48: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/48.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 49: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/49.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 50: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/50.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 51: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/51.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 52: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/52.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 53: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/53.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
Data matrix reported from each node:V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d︸ ︷︷ ︸d metrics
n time instances
I Anomaly detection using this matrx;
I Use Principal Component Analysis (PCA);
I Sliding window;
I Metrics identification after anomalies are detected.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 54: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/54.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 55: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/55.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 56: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/56.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 57: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/57.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 58: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/58.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 59: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/59.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
+ Threshold Qα is computedaccording to a given false alarmrate α.
+ Tracking component introduceserror ∆ to data matrix.
+ Given µ, dynamically adjust ∆according to PCA results, to ensurefalse alarm rate ∈ (α− µ, α + µ)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 60: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/60.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
+ Threshold Qα is computedaccording to a given false alarmrate α.
+ Tracking component introduceserror ∆ to data matrix.
+ Given µ, dynamically adjust ∆according to PCA results, to ensurefalse alarm rate ∈ (α− µ, α + µ)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 61: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/61.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
+ Threshold Qα is computedaccording to a given false alarmrate α.
+ Tracking component introduceserror ∆ to data matrix.
+ Given µ, dynamically adjust ∆according to PCA results, to ensurefalse alarm rate ∈ (α− µ, α + µ)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 62: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/62.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Anomaly Detection
PCA:
+ Threshold Qα is computedaccording to a given false alarmrate α.
+ Tracking component introduceserror ∆ to data matrix.
+ Given µ, dynamically adjust ∆according to PCA results, to ensurefalse alarm rate ∈ (α− µ, α + µ)
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 63: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/63.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 64: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/64.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 65: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/65.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 66: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/66.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 67: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/67.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
Main idea: Compare each dimension of the abnormal data points andnormal ones.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 68: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/68.jpg)
Motivation Design Evaluation Discussion
Monitoring Component - Metrics Identification
Goal: Pinpoint the abnormal dimensions of suspicious data points to assistOrchestration component.
V00 V01 V02 · · · V0d
.... . .
V(n−2)0 V(n−2)1 V(n−2)2 · · · V(n−2)d
V(n−1)0 V(n−1)1 V(n−1)2 · · · V(n−1)d
V(now)0 V(now)1 V(now)2 · · · V(now)d
Main idea: Compare each dimension of the abnormal data points andnormal ones.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 69: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/69.jpg)
Motivation Design Evaluation Discussion
Monitoring Component
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 70: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/70.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 71: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/71.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 72: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/72.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 73: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/73.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 74: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/74.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
I Raise alarm;
I Optionally, kill process.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 75: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/75.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
I Raise alarm;
I Optionally, kill process.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 76: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/76.jpg)
Motivation Design Evaluation Discussion
Orchestration Component
Virtual Machine Introspection (VMI)
I Introspect VM memory using existing VMI tools;
I Raise alarm;
I Optionally, kill process.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 77: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/77.jpg)
Motivation Design Evaluation Discussion
Evaluation
+ Implemented on the Eucalyptus Cloud platform;
+ Modified Node Controller and Cloud Controller source code.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 78: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/78.jpg)
Motivation Design Evaluation Discussion
Evaluation
+ Implemented on the Eucalyptus Cloud platform;
+ Modified Node Controller and Cloud Controller source code.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 79: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/79.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?I Tracking Component
2. Utilize the statistics for security purpose?I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 80: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/80.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?
I Tracking Component
2. Utilize the statistics for security purpose?I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 81: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/81.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?
I Tracking Component
2. Utilize the statistics for security purpose?
I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 82: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/82.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?I Tracking Component
2. Utilize the statistics for security purpose?
I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 83: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/83.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?I Tracking Component
2. Utilize the statistics for security purpose?I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 84: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/84.jpg)
Motivation Design Evaluation Discussion
Evaluation
Recall the two questions:
1. Monitor more efficiently?I Tracking Component
2. Utilize the statistics for security purpose?I Monitoring and Orchestration Component
Metrics monitored for each VM:
- The default 7 metrics monitored by Eucalyptus CloudWatch.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 85: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/85.jpg)
Motivation Design Evaluation Discussion
Evaluation - Tracking
A comparison on number of valuessent by NC for each metric.
I VM workload: TPC-Cbenchmark on MySQLdatabase;
I ∆: The average for eachmetric when VM is idle.
0
200
400
600
800
1000
0 1 2 3 4
Mes
sage
Count
Metric Id
Without TrackingWith Tracking
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 86: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/86.jpg)
Motivation Design Evaluation Discussion
Evaluation - Tracking
A comparison on number of valuessent by NC for each metric.
I VM workload: TPC-Cbenchmark on MySQLdatabase;
I ∆: The average for eachmetric when VM is idle.
0
200
400
600
800
1000
0 1 2 3 4
Mes
sage
Count
Metric Id
Without TrackingWith Tracking
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 87: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/87.jpg)
Motivation Design Evaluation Discussion
Evaluation - Monitoring
Experiment setting:
I 3 VMs being monitored: VM 1idle, VM 2 and 3 run Apache webserver;
I VM 2 and 3 are compromised asDDoS bots later.
0
10
20
30
40
50
60
70
80
0 500 1000 1500 2000 2500 3000 3500 4000
SP
E i
n r
esid
ual
su
bsp
ace
Time / seconds
SPEThreshold (α=0.2%)Threshold (α=0.5%)
Dim (j) vm1-d1 vm1-d2 vm1-d3 vm1-d4 vm1-d5 vm1-d6 vm1-d7 vm2-d1 vm2-d2 vm2-d3 vm2-d4rdj 23.70 -0.98 -0.98 -0.55 -0.57 4.27 3.76 9.14 64.18 65.05 3.50stddevj 0.78 0.42 0.58 0.00 0.67 0.00 0.71 3.17 8.01 8.30 0.00meandiffj 0.16 -0.26 -0.28Dim (j) vm2-d5 vm2-d6 vm2-d7 vm3-d1 vm3-d2 vm3-d3 vm3-d4 vm3-d5 vm3-d6 vm3-d7rdj -0.51 -0.82 4.23 9.04 60.56 61.16 1.45 -0.56 1.89 -0.51stddevj 0.31 0.00 0.35 7.23 6.06 6.98 0.17 3.39 0.12 3.65meandiffj 0.39 -0.23 -0.31
Metrics Identification Result
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 88: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/88.jpg)
Motivation Design Evaluation Discussion
Evaluation - Monitoring
Experiment setting:
I 3 VMs being monitored: VM 1idle, VM 2 and 3 run Apache webserver;
I VM 2 and 3 are compromised asDDoS bots later.
0
10
20
30
40
50
60
70
80
0 500 1000 1500 2000 2500 3000 3500 4000
SP
E i
n r
esid
ual
su
bsp
ace
Time / seconds
SPEThreshold (α=0.2%)Threshold (α=0.5%)
Dim (j) vm1-d1 vm1-d2 vm1-d3 vm1-d4 vm1-d5 vm1-d6 vm1-d7 vm2-d1 vm2-d2 vm2-d3 vm2-d4rdj 23.70 -0.98 -0.98 -0.55 -0.57 4.27 3.76 9.14 64.18 65.05 3.50stddevj 0.78 0.42 0.58 0.00 0.67 0.00 0.71 3.17 8.01 8.30 0.00meandiffj 0.16 -0.26 -0.28Dim (j) vm2-d5 vm2-d6 vm2-d7 vm3-d1 vm3-d2 vm3-d3 vm3-d4 vm3-d5 vm3-d6 vm3-d7rdj -0.51 -0.82 4.23 9.04 60.56 61.16 1.45 -0.56 1.89 -0.51stddevj 0.31 0.00 0.35 7.23 6.06 6.98 0.17 3.39 0.12 3.65meandiffj 0.39 -0.23 -0.31
Metrics Identification Result
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 89: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/89.jpg)
Motivation Design Evaluation Discussion
Evaluation - Monitoring
Experiment setting:
I 3 VMs being monitored: VM 1idle, VM 2 and 3 run Apache webserver;
I VM 2 and 3 are compromised asDDoS bots later.
0
10
20
30
40
50
60
70
80
0 500 1000 1500 2000 2500 3000 3500 4000
SP
E i
n r
esid
ual
su
bsp
ace
Time / seconds
SPEThreshold (α=0.2%)Threshold (α=0.5%)
Dim (j) vm1-d1 vm1-d2 vm1-d3 vm1-d4 vm1-d5 vm1-d6 vm1-d7 vm2-d1 vm2-d2 vm2-d3 vm2-d4rdj 23.70 -0.98 -0.98 -0.55 -0.57 4.27 3.76 9.14 64.18 65.05 3.50stddevj 0.78 0.42 0.58 0.00 0.67 0.00 0.71 3.17 8.01 8.30 0.00meandiffj 0.16 -0.26 -0.28Dim (j) vm2-d5 vm2-d6 vm2-d7 vm3-d1 vm3-d2 vm3-d3 vm3-d4 vm3-d5 vm3-d6 vm3-d7rdj -0.51 -0.82 4.23 9.04 60.56 61.16 1.45 -0.56 1.89 -0.51stddevj 0.31 0.00 0.35 7.23 6.06 6.98 0.17 3.39 0.12 3.65meandiffj 0.39 -0.23 -0.31
Metrics Identification Result
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 90: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/90.jpg)
Motivation Design Evaluation Discussion
Evaluation - Orchestration
I Received a VMI request with information:I A possible network problem;I Similar patterns for VM 2 and 3.
I Node Controller call existing VMI tools to introspect:I VM 2: Volatility found suspicious DDoS process;I VM 3: Same with VM 2?I Raise alarm to user;I Kill the processes automatically using StackDB if confirmed.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 91: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/91.jpg)
Motivation Design Evaluation Discussion
Evaluation - Orchestration
I Received a VMI request with information:I A possible network problem;I Similar patterns for VM 2 and 3.
I Node Controller call existing VMI tools to introspect:I VM 2: Volatility found suspicious DDoS process;I VM 3: Same with VM 2?I Raise alarm to user;I Kill the processes automatically using StackDB if confirmed.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 92: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/92.jpg)
Motivation Design Evaluation Discussion
Discussion - Overhead
Overhead introduced:
I On NC: O(1) to apply tracking algorithm and call VMI tools;
I On CLC: Depending on the PCA algorithm used, polynomial tosliding window size and number of dimensions monitored.
Overhead saved:
I Significant amount of network traffic sending from NC to CC toCLC;
I Significant amount of memory space to be introspected by VMI.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 93: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/93.jpg)
Motivation Design Evaluation Discussion
Discussion - Overhead
Overhead introduced:
I On NC: O(1) to apply tracking algorithm and call VMI tools;
I On CLC: Depending on the PCA algorithm used, polynomial tosliding window size and number of dimensions monitored.
Overhead saved:
I Significant amount of network traffic sending from NC to CC toCLC;
I Significant amount of memory space to be introspected by VMI.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 94: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/94.jpg)
Motivation Design Evaluation Discussion
Discussion - Overhead
Overhead introduced:
I On NC: O(1) to apply tracking algorithm and call VMI tools;
I On CLC: Depending on the PCA algorithm used, polynomial tosliding window size and number of dimensions monitored.
Overhead saved:
I Significant amount of network traffic sending from NC to CC toCLC;
I Significant amount of memory space to be introspected by VMI.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 95: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/95.jpg)
Motivation Design Evaluation Discussion
Discussion - Possible Extension
I Monitor more metrics;
I Extend VMI tools to find more complicated attacks.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 96: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/96.jpg)
Motivation Design Evaluation Discussion
Discussion - Possible Extension
I Monitor more metrics;
I Extend VMI tools to find more complicated attacks.
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 97: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/97.jpg)
Motivation Design Evaluation Discussion
Thank you.
Questions?
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems
![Page 98: ATOM: Automated Tracking, Orchestration and Monitoring of ...lifeifei/papers/atom-slides.pdfATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure](https://reader030.fdocuments.in/reader030/viewer/2022040317/5e31a98db814274440354b47/html5/thumbnails/98.jpg)
Motivation Design Evaluation Discussion
Thank you.
Questions?
ATOM: Automated Tracking, Orchestration and Monitoring of Resource Usage in Infrastructure as a Service Systems