Oracle NOSQL Database A Practical Introduction – [CON8062] Robert Greene & Anuj Sahni Product...

37

Transcript of Oracle NOSQL Database A Practical Introduction – [CON8062] Robert Greene & Anuj Sahni Product...

Oracle NOSQL DatabaseA Practical Introduction – [CON8062]

Robert Greene & Anuj SahniProduct ManagementOracle NOSQL DatabaseOctober 01, 2014

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

What is Oracle NOSQL, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading,

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

What is Oracle NOSQL Database

Oracle Confidential – Internal/Restricted/Highly Restricted 5

101100101001001001101010101011100101010100100101

ReliableFlexibleFastSimple

advanced Key-Value database designed as cost effective, high performance solution for simple operations on collections of data with built in high availability and elastic scale-out.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

2009

• Servicing major Financials, LinkedIn, Amazon

2010

• Scaling out BerkeleyDB NoSQL Database

2011

• Nov 2011, version 1.0 released

2012

• Dec 2012, version 2.0 released

• Oracle Eco Integrated

2013

• Quarterly releases, version 2.1 released

2014

• Version 3.0• Hosted

NoSQL• Big Data

SQL

CustomersIn Production Oracle Solutions Engineered

SystemsNoSQL DatabaseIn developmentBerkeleyDB Oracle Cloud

Oracle NOSQL DatabaseFrom startups to enterprise ready

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• NOSQL Features– Elastic– BASE Operations– Tables / JSON / Binary– Online management

• Differentiators– ACID transactions– Online rolling upgrades– Oracle technology integrated (tools & solutions)– Commodity & Engineered systems– Streaming large object support

Oracle NOSQL Database - Enterprise Ready

– Data Center Support– Secondary Indexes– Secure Access– Flexible schema

Best NOSQL choice for any company using Oracle products

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Finance

• Large credit card network provider

• Fraud rule and history management

• 6,500 ops/sec, 85% update on read

Manufacturing

• Large airline manufacturer

• Developing next generation planes

• 750K key inserts/sec, 6TB per hour

8

Telecoms

• Large mobile telecom operator

• Mobile personalized advertizing

• 24,000 ops/sec, 100% update on read

Gaming

• Real-time, live event platform provider

• Sports wagering for William Hill, BetVictor

• 600 concurrent feeds, 400 events/feed

Oracle NOSQL Database customer success…

……many more

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle NOSQL Database Subscription Model

• Business-friendly support service– Oracle NoSQL Database Community Edition

• Open Source AGPL Edition

– Support is now available for Community Edition• Price is $2,000/year per server • No upfront license fee• Provides for full Oracle support policy response• Purchase online via the Oracle Store

– Offers affordable support option for startups– Provides Oracle expertise for production

deployment

9

Oracle Store https://shop.oracle.com/

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle NOSQL DB Licensing

• Community -or- Enterprise Edition– Enterprise Edition

• Closed Source. Standard Oracle License

– Community Edition has all of the basic functionality and APIs. Gets you started

– Enterprise Edition for large, production, multi-data center, Oracle integration-centric customers and/or non-GPL compliant customers.

10

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Enterprise ready- for Administrators and Developers

• Integrated - into Oracle software stack of tools and solutions

• Engineered appliance – fast deployment and comprehensive support

Oracle NOSQL Database product missionTransitioning NOSQL from Startup to Enterprise

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

What is it, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading,

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Cluster TopologySmart Topology

Agents

A

A

A

Machine1

Machine2

Machine3

Replica Group1 Replica Group2 Replica Group4Replica Group3

R1

R2

R2

R1 R4

R4

R3

R3

M4

M1

M2

M3DD

D

D

Application

NoSQL Driver

D

D

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Simple setup via Resource Declaration (no replica group definition)

• Automatic HA process placement (DBA assist)

• Oracle Enterprise Manager (unified SQL and NoSQL resource view)

Enterprise ReadyCluster creation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Automated write availability - master re-election on failure

• Cloud ready tooling and standards based alerting (html5, jmx, snmp)

• Automated process rebalancing on recovery - DBA-less recovery

Enterprise ReadyHigh availability and active monitoring

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

What is it, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Email Example – RDBMS SchemaER Diagram

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Parent/child Parent/child

Value Value Value Value

Email Example – NOSQL SchemaHierarchical key space, table meta layer

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Simple, scripted DDL (familiar SQL concepts)

• Rich modeling: Collections, Records, Primitives, Embedding, Linked (powerful modeling)

• Strongly typed data, loosely coupled applications (governance with agility)

Enterprise ReadyTable creation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Easy CLI based data loading from CVS, JSON formats

• High speed bulk loading – ODI / Oracle Connectors (Map Reduce)

• Data load from cluster wide snapshots

Enterprise ReadyData Loading

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

What is it, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Email ExampleQueries

Parent/child Parent/child

Value Value Value Value

Query by primary key

Query by secondary index

Queries with ordered results

kv-> get table -name user -field userId -value 1

kv-> get table -name user -index emailIndex -field email -value [email protected]

kv-> get table -name user -index ageIndex -field age -start 12 -end 20

kv-> get table -name user -index emailIndex

Range Queries

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Email ExampleQueries

Parent/child Parent/child

Value Value Value Value

Intersection Queries (JOIN)

kv-> get table -name User.Folder.Message -field userId -value 1 -field folderId -value 2

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Easy CLI adhoc query (Dev prototype, DBA examine)

• Range and aggregate operators (advanced filtering, indexes, store wide ordered)

• Scriptable and exportable results (predictable, repeatable, sharable)

Enterprise ReadyCLI queries

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Simple Oracle integration

• All SQL tools available thru Oracle Database

• Foundation for unified query of Big Data SQL

Enterprise ReadySQL based queries

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Simple Eclipse based, multi-language development

• Flexible Table, AVRO, Key-Value API with adhoc query

• Powerful operators, primary/secondary indexing

Enterprise Ready and Developer friendlyTable API based queries

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Program Agenda

What is it, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3)

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

0

1

2

3

4

5

6

7

8

95/5 Read/Update Throughput

Throughput (ops/sec) Read Latency (ms)Update Latency (ms)

Replicas (RG x RF)

Thro

ughp

ut (o

ps/s

ec)

Ave

rage

Lat

ency

(ms)

• 144 -> 216 nodes• 4% initial reduction• 9% final gain• Linear scalability

Engineered for Linear ScalingBig Data Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• 216 nodes• 15 minutes to software upgrade• Scriptable automation• Linear scalability

72 (24x3) 144 (48x3) 216 (72x3)0

2.5

5

7.5

10

12.5

15

17.5

Online Rolling Upgrade

Total Nodes

Tim

e to

Upg

rade

(min

)

Engineered for Rolling UpgradesBig Data Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle NoSQL Database

Terracotta

Read Latency

Enterprise ReadyPredictable performance beats in-memory grids

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Authentication (truststore)

• Wire line encryption (SSL)

• At rest encryption (eCryptfs)

• Oracle Wallet (key management)

• Upcoming security integrations• Kerberos, Database Vault, Auditing, Masking, Label Security

Enterprise ReadyDefense in Depth Security

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Data WarehouseData Reservoir +

Oracle Big Data Connectors

Oracle DataIntegrator

Oracle Advanced Analytics

OracleDatabase

Oracle Spatial & Graph

Cloudera Hadoop

Oracle R Distribution

Oracle NoSQL Database

Oracle Industry Models

OracleGoldenGate

Oracle DataIntegrator

Oracle Event Processing

Oracle Event Processing

Apache Flume

OracleCoherence

Oracle Advanced Analytics

Oracle Database

Oracle Spatial & Graph

Oracle Industry Models

Integrated with Oracle Software

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

2014

• Version 3.0,• Hosted NoSQL• Big Data SQL

2015

• Release 4.0, seamless management

• IoT platform infrastructure

• Analytic enablement

2016

• NoSQL Everywhere - DMS

• Cloud burst automation

• Data Contexts

++ +++ ++++

Ubiquitous DataBig Data AgilityOracle Cloud

Oracle NOSQL DatabaseFrom enterprise product to market leading NOSQL

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Enterprise ready- for Administrators and Developers

• Integrated - into Oracle software stack of tools and solutions

• Engineered appliance – fast deployment and comprehensive support

Oracle NOSQL DatabaseFrom enterprise product to market leading NOSQL

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor StatementThe preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |