Guaranteed Performance While Querying Ever-Growing Data
description
Transcript of Guaranteed Performance While Querying Ever-Growing Data
![Page 1: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/1.jpg)
Guaranteed Performance While Querying Ever-Growing Data
Michael ArmbrustBEARS Conference – February 2012
P QL
![Page 2: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/2.jpg)
Web Applications Grow Rapidly
![Page 3: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/3.jpg)
Success Disaster?
![Page 4: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/4.jpg)
• Force developers to use simple operations (get/put)
• Makes complexity obvious
![Page 5: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/5.jpg)
• Force developers to use simple operations (get/put)
• No optimization or data independence
![Page 6: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/6.jpg)
PIQL Solution
P QL
Performance Insightful Query Language
• SQL-like• Builds on existing
scalable storage• Guaranteed
performance independent of scale
![Page 7: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/7.jpg)
Problem with Cost Based OptimizationPlan Choices
Sequential Scan
Random Lookups
![Page 8: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/8.jpg)
BIG DATA: The State of the Art
Algorithms
Machines
People
search
Watson/IBM
8
![Page 9: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/9.jpg)
AMP: A Holistic Approach
search
Watson/IBM
Machines
People
Algorithms
9
![Page 10: Guaranteed Performance While Querying Ever-Growing Data](https://reader035.fdocuments.in/reader035/viewer/2022062501/56815b2c550346895dc8f2aa/html5/thumbnails/10.jpg)
BDAS: Berkeley Data Analysis System A Top-to-Bottom Rethinking of the big data analytics stack integratingAlgorithms, Machines, and People
Infra. Builder
Algo/Tools
Data Collector
Data Analyst
Higher Query Languages / Processing Frameworks
Resource Management
StorageData
CollectorCrowd
Interface
Analytics Libraries, Data Integration
Data Source Selector
Result Control Center
Visualization
Qua
lity
Co
ntr
ol
Mo
nito
ring
/Deb
ug
gin
g Poster Session@amplab465 SODA Hall