Post on 09-Jan-2017
LAMBDA-B-GONE: IN-MEMORY CASE STUDY FOR FASTER, SMARTER AND SIMPLER ANSWERS
DENNIS DUCKWORTHVOLTDB See all the presentations from the In-Memory
Computing Summit at http://imcsummit.org
VOLTDB An operational database purpose-built to run 100% in-
memory at web scale In-Memory Relational, SQL, fully ACID compliantScale-out on commodity hardwareReliability, HA, fault tolerant Integration with OLAP, Hadoop, DW Best use cases: operational and transactional workloads
ORIGINAL LAMBDA ARCHITECTURE
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
CASE STUDY
5
Content Delivery Network Service Provider
Business challenges:- Real-time analytics for customers- Data accuracy: over/under billing- Scalability
SQL interface unlike Trident or Spark-Streaming Merges the good things of the old-world like SQL and transactions
with the good things of the new world like ‘no-locks’, ‘k-factor’ HA, etc….
Very simple and intuitive API and usage k-factor + logs + snapshots eliminates the need to backup the
system Fast query performance Horizontal scalability
MAXCDN FINDINGS: VOLTDB ADVANTAGES
MAXCDN FINDINGS: VOLTDB ADVANTAGES
MAXCDN RESULTS
8
Simplified system architecture
1/10th the compute resources
100% budget accuracy, eliminated $$$ under/over spending
Faster time to value“We chose to go with VoltDB over other streaming aggregate solutions (like Trident) for its SQL interface, real-time Ad-Hoc queries over our raw data, and simpler overall design”Behzad Pirvali, Architect, MaxCDN
REAL-TIME IN-MEMORY OLTP AND ANALYTICS WITH APACHE IGNITE ON AWS BY BABU ELUMALAI
HTTP://BLOGS.AWS.AMAZON.COM/BIGDATA/POST/TX3RS3V80XNRJH3/REAL-TIME-IN-MEMORY-OLTP-AND-ANALYTICS-WITH-APACHE-IGNITE-ON-AWS
AMAZON DYNAMODB
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING +
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING IGNITE + KCL
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
ONE LAST THOUGHT: WORD OF THE DAY
IDEMPOTENCETHE PROPERTY OF CERTAIN OPERATIONS IN MATHEMATICS AND
COMPUTER SCIENCE, THAT CAN BE APPLIED MULTIPLE TIMES WITHOUT CHANGING THE RESULT BEYOND THE INITIAL
APPLICATION.
DONE - THANK YOU
If you want to talk about how real transactions (and idempotence) can help you, come see us.
http://voltdb.com
@dennisduckworthdduckworth@voltdb.com
all images from wikimedia w/ cc license unless otherwise noted