Databases, the Cloud and its Discontents
-
Upload
orchestrate -
Category
Software
-
view
106 -
download
1
Transcript of Databases, the Cloud and its Discontents
![Page 1: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/1.jpg)
Databases, the Cloud and its Discontents
“...it is impossible to overlook the extent to which civilization is built up upon a renunciation of instinct....”
― Sigmund Freud, Civilization and Its Discontents
![Page 2: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/2.jpg)
Who am I?
![Page 3: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/3.jpg)
IAN PLOSKER
![Page 5: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/5.jpg)
Our goal is to make storing and querying data so easy, you don’t
need databases
![Page 6: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/6.jpg)
Charles Darwin
Charles Darwin demonstrated that all life on Earth is formed and
transformed by the environmental pressures
applied to it.
![Page 7: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/7.jpg)
Sigmund Freud
In Civilization and its Discontents Freud argues
that our minds were forged before civilization, and that our maladaptive behaviors are remnants of a different
time.
![Page 8: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/8.jpg)
Ian Plosker
In Databases, the Cloud and its Discontents Plosker
argues that database were forged before the cloud, and
that their maladaptive behaviors are remnants of a
different time.
![Page 9: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/9.jpg)
Path Dependence
The idea that current available options may be limited by choices and forces in the past which are
no longer relevant.
![Page 10: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/10.jpg)
How Many Storage Engines Make These Assumptions:
• The disks are local
• The disk is spinning media
• Memory pages are contiguous
• The kernel is omnipotent
• Records have a repeating form and a consistent size
![Page 11: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/11.jpg)
How Many Distributed Database Make These Assumptions:
• The network is reliable
• Nodes in a cluster share a switch
• Nodes in a cluster are in the same datacenter
• Switch ingress/egress buffers never fill up
• Networks are not congested
![Page 12: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/12.jpg)
To understand our present choices, we must understand the
past.
![Page 13: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/13.jpg)
A Brief History of Databases
![Page 14: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/14.jpg)
Let's start by reviewing the evolution of storage media
![Page 15: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/15.jpg)
Writing, Paper, and Libraries (600 BCE, 105 CE, 2600 BCE)
![Page 16: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/16.jpg)
Punch Card Databases (~1800)
![Page 17: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/17.jpg)
Drums(invented 1930, general use 1950s)
![Page 18: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/18.jpg)
Disks(invented 1954, general use 1960s)
![Page 19: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/19.jpg)
Solid State(invented 1950s, general use 2000s)
![Page 20: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/20.jpg)
Next let's review storage and query model
![Page 21: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/21.jpg)
File Systems(proposed 1958, general use 1970s)
![Page 22: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/22.jpg)
DBMS(1960s, general use 1970s)
Two main models …
![Page 23: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/23.jpg)
Navigational
![Page 24: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/24.jpg)
Hierarchical
![Page 25: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/25.jpg)
Enter the notorious RDBMS(proposed 1970s, general use 1980s)
![Page 26: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/26.jpg)
To Summarize and Synthesize …
![Page 27: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/27.jpg)
Databases in 2005
![Page 28: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/28.jpg)
COUCHBASE
MEMCACHE
BERKLEY DB
GENIEDB REDIS
SWIFT RIA
K
VOLDEMORT
TOKYO CABIN
ET
HBASE NEO4J
TEMPODB
ELASTIC SEARCH
COUCHDB
HIBARI
ORIENTDB
NOSQL DB
DYNAMO
BIG C
OUCH
MARKLOGIC SERVER
COHERENCE
AEROSPIKE
DEX
DRAWN TO SCALE
INFIN
IGRAPH
SIMPLEDB
FLOCKDB
MNESIA COHERENCE
MONGODB
CASSANDRA
25+ databases in production today that didn’t exist 8 years ago
Databases in 2014
![Page 29: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/29.jpg)
Key-Value Search GeoGraph/
Relation Event
Scale-up
BerkleyDBCouchDBMongoDB
MySQL
SOLRSphinx
PostGISMongoDB
SOLRneo4j MySQL
Scale-out
RiakCassandra elasticsearch elasticsearch titan HBase
ONLINE QUERY TYPES
![Page 30: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/30.jpg)
The database paradox of choice:
Choice has brought complexity
![Page 31: Databases, the Cloud and its Discontents](https://reader036.fdocuments.in/reader036/viewer/2022062515/55c29734bb61eb3d128b46df/html5/thumbnails/31.jpg)
Enter: The Cloud