Alternative Database Technology in the Cloud
-
Upload
bret-piatt -
Category
Technology
-
view
4.525 -
download
1
description
Transcript of Alternative Database Technology in the Cloud
![Page 1: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/1.jpg)
Community StackerBret Piatt
LinuxCon 2010Alternative Database Technologies for the Cloud
&
![Page 2: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/2.jpg)
OPEN SOURCE ISDRIVING THE CLOUD
![Page 3: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/3.jpg)
LINUX
![Page 4: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/4.jpg)
XEN
![Page 5: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/5.jpg)
KVM
![Page 6: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/6.jpg)
APACHE
![Page 7: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/7.jpg)
MEMCACHED
![Page 8: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/8.jpg)
VARNISH
![Page 9: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/9.jpg)
WORDPRESS
![Page 10: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/10.jpg)
DRUPAL
![Page 11: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/11.jpg)
MAGENTO
![Page 12: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/12.jpg)
THE HARDEST PARTIS STILL THE DATABASE
![Page 13: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/13.jpg)
![Page 14: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/14.jpg)
![Page 15: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/15.jpg)
![Page 16: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/16.jpg)
![Page 17: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/17.jpg)
TIMES HAVE CHANGED
![Page 18: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/18.jpg)
![Page 19: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/19.jpg)
![Page 20: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/20.jpg)
![Page 21: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/21.jpg)
![Page 22: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/22.jpg)
OTHER THINGSHAVE ALSO CHANGED
![Page 23: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/23.jpg)
![Page 24: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/24.jpg)
![Page 25: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/25.jpg)
![Page 26: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/26.jpg)
![Page 27: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/27.jpg)
THE WEB
WEB APPS ARE BUILT DIFFERENTLY
SERVER-SIDE PROCESSING
BURSTY LOADS, UNPREDICTABILITY
DISTRIBUTED USERS
SIMPLIFIED PROBLEM SET
SIMPLIFIED OPERATING ENVIRONMENT
![Page 28: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/28.jpg)
WEB SCALE REQUIREMENTS
TERABYTES OF DATA, INCLUDING STRUCTURED DATA
MILLIONS TO BILLIONS OF WRITES EACH DAY
GLOBAL REPLICATION AND REDUNDANCY–EVENTUAL CONSISTANCY
COMMODITY HARDWARE–SCALE OUT NOT UP
CACHE EVERYTHING YOU READ
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 29: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/29.jpg)
RIAK
JSON AND REST–WEB GENERATION INTERFACE
MAP/REDUCE TERM MATCHING QUERIES
SCALE HORIZONTALLY WITH MULTIPLE MASTERS
EVENTUAL CONSISTENCY WITH VECTOR CLOCKS
WRITTEN IN ERLANG–CONCURRENT FUNCTIONAL PROGRAMMING
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 30: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/30.jpg)
HBASE
REST-FUL WEB SERVICE GATEWAY
DISTRIBUTED COLUMN STORE MODELED AFTER BIGTABLE
SCALE HORIZONTALLY WITH MULTIPLE MASTERS
ROLLING RESTART FOR CONFIG CHANGES AND MINOR UPGRADES
HIGH PERFORMANCE THRIFT GATEWAY
CASCADING, HIVE, AND PIG SOURCE AND SINK MODULES
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 31: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/31.jpg)
REDIS
API LIBRARIES AVAILABLE IN MANY LANGUAGES
MORE THAN JUST A PLAIN KEY-VALUE STORE
THE DATABASE IS IN MEMORY–RAM IS CHEAP
ASYNCHRONOUS FLUSH TO DISK
REPLICATION IS MASTER->SLAVE
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 32: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/32.jpg)
MONGODB
BSON INTERFACE DOCUMENT DATABASE
FULL INDEX SUPPORT
REPLICATION & HIGH AVAILABLITY ACROSS WANS
AUTO-SHARDING FOR HORIZONTAL SCALE
GRIDFS TO STORE LARGE FILES
MAP/REDUCE BATCH MANIPULATION
MORE CORES, MORE MEMORY, MORE MACHINES
Sources: http://www.businessinsider.com/how-we-use-mongodb-2009-11 -- andhttp://blog.boxedice.com/2010/02/28/notes-from-a-production-mongodb-deployment/
![Page 33: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/33.jpg)
CASSANDRA
FULLY DISTRIBUTED
TRUE HORIZONTAL SCALEABILITY
REPLICATION–INCLUDING WIDE-AREA REPLICATION
PREDICTABLE, BLAZING WRITE PERFORMANCE
CONTROLLABLE READ/WRITE CONSISTENCY
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 34: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/34.jpg)
DRIZZLE
RELEASE EARLY, RELEASE OFTEN–NO 2-YEAR CYCLES
UTF8-THE WEB IS “WORLDWIDE” AFTER ALL
STRONG SQL INTERFACES MEAN STABILITY & INNOVATION
MODULAR ARCHITECTURE ALLOWS EXTENSION…
…OR PERFORMANCE BY REMOVING WHAT YOU DON’T NEED
MORE CORES, MORE MEMORY, MORE MACHINES
![Page 35: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/35.jpg)
WHY OPEN MATTERS
LOCK-IN IS A REAL CONCERN IN THE CLOUD
OPEN SOURCE MAKES IT ACCESSIBLE TO YOU
TECHNOLOGY IS NOT A SUSTAINABLE, LONG-TERM ADVANTAGE
GAIN THE KNOWLEDGE OF A COMMUNITY
SHARE YOUR KNOWLEDGE WITH EVERYONE
TURNS COMPETITION INTO COOPERATION
![Page 36: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/36.jpg)
THERE IS NOSILVER BULLET
![Page 37: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/37.jpg)
MASSIVE SCALESPECIFIC PROBLEMS
![Page 38: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/38.jpg)
REQUIRE OPTIMIZEDSPECIFIC SOLUTIONS
![Page 39: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/39.jpg)
HOW SHOULDI CHOOSE?
Source: http://blog.mozilla.com/data/2010/05/18/riak-and-cassandra-and-hbase-oh-my/
![Page 40: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/40.jpg)
SCALABILITY
![Page 41: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/41.jpg)
ELASTICITY
![Page 42: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/42.jpg)
RELIABILITY
![Page 43: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/43.jpg)
STORAGE
![Page 44: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/44.jpg)
DATA ANALYSIS
![Page 45: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/45.jpg)
COST
![Page 46: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/46.jpg)
SECURITY
![Page 47: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/47.jpg)
EXTENSIBILITY
![Page 48: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/48.jpg)
DR / MIGRATION
![Page 49: Alternative Database Technology in the Cloud](https://reader031.fdocuments.in/reader031/viewer/2022013101/555a6aacd8b42a972b8b4b22/html5/thumbnails/49.jpg)
ANALYZE THEN DECIDE