Design your application using Persistent Graphs and OrientDB

(c) Luca Garulli Licensed under a Creative Commons Attribution-NoDerivs 3.0 Unported License www.orientechnologies.com

Luca Garulli – Founder and CEONuvolaBase Ltd

May 2012 29 - 30 in Cologne, Germany

Design your application using Persistent Graphs and OrientDB

(c) Luca Garulli Licensed under a Creative Commons Attribution-NoDerivs 3.0 Unported License

Usually NoSQL products are selectedbecause are fast and super scalable,

but at what price?


Can you really renounce toTransactions, an expressive Query

language and all the featuresavailable for years by RDBMS?


Can we have a fast and scalable NoSQLproduct with flexible schema,

transactions, SQL, security and thesupport for complex types ?


The answer is OrientDB,the document-graph NoSQL dbms


The answer is OrientDB,the document-graph NoSQL dbms

I never will change my RDBMS with

anything!


Mission?Reduce to the minimum the compromises

on fitting the application domain to apersistent database supporting

multiple models


OrientDB = {flexibility of Document databases+ complexity of the Graph model

+ Object Oriented concepts+ fast Index

+ powerful SQL dialect}


+13 yearsof research


+3 yearsof design and development


Relationshipsare direct links

no Relational JOINS to connect multiple tables

Load trees and graphs in few ms!


Ø configdownload, unzip, run!

cut & paste the db


150,000records per second

(flat records, no index, on commodity hw)


Schema-lessschema is not mandatory, relaxed model,collect heterogeneous documents all together


Schema-fullschema with constraints on fields and validation rules

Customer.age > 17Customer.address not null

Customer.surname is mandatoryCustomer.email matches '\b[A-Z0-9._%+-]+@[A-Z0-9.-]+\.[A-Z]{2,4}\b'


Schema-mixedschema with mandatory and optional fields + constraints

the best of schema-less and schema-full modes


ACID Transactionsdb.begin();try{ // your code ... db.commit();

} catch( Exception e ) { db.rollback();}


Complex typesnative support for collections, maps (key/value)

and embedded documentsno more additional tables to handle them


SQLselect * from employee where name like '%Jay%' and status=0


Why reinventyet another language when

the 100% of developers alreadyknow SQL?

OrientDB begins from SQLbut improves it with new

operators for graph manipulation


For the most of the querieseveryday a programmer needs

SQL is simpler,more readable and

compact thenScripting (Map/Reduce)


SELECT SUM(price) as prices, SUM(cost) as costs, prices-costs, margin/price FROM Balance

VSfunction (key, values) { var price = 0.0, cost = 0.0, margin = 0.0, marginPercent = 0.0; for (var i = 0; i < values.length; i++) { price += values[i].price; cost += values[i].cost; } margin = price - cost; marginPercent = margin / price; return { price: price, cost: cost, margin: margin, marginPercent: marginPercent };}


Asynchronous Queryinvoke callback when a record matches the condition

doesn't collect the result set

perfect for immediate resultsuseful to compute aggregates


Enhanced SQLSQL is not enough for collections, maps, trees and graphs

need to enhance SQL syntax

Easy syntax derived from JDO/JPA standards


SQL & relationshipsselect from Account where address.city.country.name = 'Italy'

select from Account where addresses contains (city.country.name = 'Italy')


SQL & trees/graphsselect out[label='friend'].in from V where name = 'Luca' and surname = 'Garulli'

select out[@class='knows'].in from V where name = 'Jay' and surname = 'Miner'

traverse friends from Profile where $depth < 7


SQL sub queriesselect from ( traverse friends from Profile where $depth < 7 ) where home.city.name = ‘Cologne’


SQL & stringsselect from Profile where name.toUpperCase() = 'LUCA'

select from City where country.name.substring(1,3).toUpperCase() = 'TAL'

select from Agenda where phones contains ( number.indexOf( '+39' ) > -1 )

select from Agenda where email matches '\bA-Z0-9._%[email protected]?+\.A-Z?{2,4}\b'


SQL & schema-lessselect from Profile where any() like '%Jay%'

select from Stock where all() is not null


SQL & collectionsselect from Tree where children contains ( married = true )

select from Tree where children containsAll ( married = true )

select from User where roles containsKey 'shutdown'

select from Graph where edges.size() > 0


Java®runs everywhere is available JRE1.5+

robust engine


Language bindingsJava as native

JRuby, PHP, C, Scala, .NET,Ruby, Clojure, Node.js,Python and Javascript


Is your languagenot supported (yet)?

Write an adapter using theC, Java or HTTP binding


Binary protocolFast compressed JSON over tcp/ip

available for Javaand soon C, C++ and Ruby


HTTP RESTful

firewall friendly

use it from the web browseruse it from the ESB (SOA)


Native JSONODocument = new ODocument().fromJSON( " { '@rid' = '26:10', '@class' = 'Developer', 'name' : 'Luca', 'surname' : 'Garulli', 'out' : [ #10:33, #10:232 ] }“ );


Import/Exportuses JSON format

online operations (don't stop the database)

> export database demo


MVRB-Tree index

the best of B+Tree and RB-Treefast on browsing, low insertion cost

it's a new algorithm


Hookssimilar to triggers

catch events against records, database and transactions

implement custom cascade deletion algorithm

enforce constraints


Securityusers and roles, encrypted passwords

fine grain privileges(similar to what RDBMS offer)


CacheYou can avoid using 3°party caches

like Memcached

2 Level caches:Level1: Database level, 1 per thread

Level2: Storage level, 1 per JVM


OGraphVertex (V)

PersonAddress : Address

Inheritance

CustomertotSold : float

ProvidertotBuyed : float

OGraphEdge (E)

Works

since : Date

Residessince : Date

till : Date

Knows

Level : LEVELS

Vehiclebrand : BRANDS


OgraphVertex (V)

PersonAddress : Address

Polymorphic SQL Query

CustomertotSold : float

ProvidertotBuyed : float

Vehiclebrand : BRANDS select from Person

where city.name = 'Rome‘

Queries are polymorphicsand subclasses of Person can be

part of result set


Fetch plansChoose what to fetch on query and vertexes/edges loading

Vertexes/Edges not fetched will be lazy-loaded on request

Optimizes network latency


Load only the root vertex= *:1

Fetch plansVertex Luca | | lives city +---------> Vertex ------------> Vertex | 10th street Italy | knows +--------->* [Vertex Vertex Vertex ] [ Marko John Nicholas]



Load root + address= *:1 lives:2



Load root + all known= *:1 knows:1



Load up 3rd level of depth= *:3


Graph Database model

Built as wrapper on top ofThe Document Database

Few simple concepts: Vertex, Edge,Property and Index


Why OrientDB is so special onhandling Graphs?

Can I model a graphon top of a RDBMS?


A GraphDB has an“index-free adjacency”

mechanism to crossthe graph without any

index lookup


OrientDB doesn’t use JOINbut the “link” to traverse

millions of elements per second

In Blueprints benchmark, with a hot cache,traverses 29,6M of records in less than 5 seconds

= 5,92M of nodes traversed per sec!


OGraphDatabaseNative, damn fast, not the most beautiful API

2 different API

OrientGraphTinkerPop Blueprints, slowest but:

common to other impls, Gremlin, SPARQL (via Sail)

All APIsare compatibleamong them!

So use the right onefor the right case


What to choose?

OGraphDatabase if you needperformance at any cost.

Use it for massive insertion orlow resources

OGraphDatabaseNative, damn fast, not the most beautiful API


What to choose?

OrientGraph if you want to stayPortable

at the cost of less speed and more memory used

or to use Gremlin language,or as RDF store + SPARQL

OrientGraphTinkerPop Blueprints, slowest but:

common to other impls, Gremlin, SPARQL (Sail)


TinkerPop technologiessort of “standard” for GraphDB

a lot of free open-source projects

http://tinkerpop.com


TinkerPop Blueprintsbasic API to interact with GraphDB

implements transactional andindexable property graph model

bidirectional edges


GraphDB & Blueprints API

OrientGraph graph = new OrientGraph("local:/tmp/db/graph”);

Vertex actor = graph.addVertex(null);actor.setProperty("name", "Leonardo");actor.setProperty("surname", "Di Caprio");

Vertex movie = graph.addVertex(null);movie.setProperty("name", "Inception");

Edge edge = graph.addEdge(null, actor, movie, "StarredIn");

graph.shutdown();


TinkerPop

scripting language

easy to learn and understandUsed for operations against graphs

(c) Luca Garulli Licensed under a Creative Commons Attribution-NoDerivs 3.0 Unported License www.orientechnologies.com

gra

ph-e

xam

ple

-1

.xm

l


Load graph

Run the console, open the database and load a graph in xml format

marko:~/software/gremlin$ ./gremlin.sh

\,,,/ (o o)-----oOOo-(_)-oOOo-----

gremlin> $_g := orientdb:open('/tmp/graph/test')==>orientgraph[/tmp/graph/test]

gremlin> g:load('data/graph-example-1.xml')==>true

gremlin> $_g==>orientgraph[/tmp/graph/test]


SearchDisplays outgoing edges of vertices with name equals to 'marko',then the name of inbound vertices

gremlin> g:key-v('name','marko')/outE==>e[6:0][5:2-knows->5:1]==>e[6:1][5:2-knows->5:4]==>e[6:4][5:2-created->5:0]

gremlin> g:key-v('name','marko')/outE/inV/@name==>vadas==>josh==>lop

gremlin> g:close()==>true


High-AvailabilityMulti-Master replication

Servers can be heterogeneous withdifferent replicated databases


Where is the previousOrientDB

Master/Slavearchitecture?


Master/slave only. Do not

recycle!


After first tests we decided tothrow away the old Master-Slave

architecture because it wasagainst the OrientDB philosophy:

(1) It didn't scaleand

(2) It was hard to configure


ConsoleORIENT database v.0.9.23 www.orientechnologies.comType 'help' to display all the commands supported.

> connect remote:localhost/demo admin adminConnecting to database [remote:localhost/demo] with user 'admin'...OK

> select from profile where nick.startsWith('L')---+--------+--------------------+--------------------+--------------------+ #| REC ID |NICK |SEX |AGE |---+--------+--------------------+--------------------+--------------------+ 0| 10:0|Lvca |male |34 1| 10:3|Leo |male |22 2| 10:7|Luisa |female |273 item(s) found. Query executed in 0.013 sec(s).

> closeDisconnecting from the database [demo]...OK

> quit


OrientDB Studio/View graph


Multi-Modeluse case


Always FreeOpen Source Apache 2 license

free for any purposes,even commercials


Prof€$$ional$€rvic€$

directly by NuvolaBase Ltd or partners

support, training, consulting, mentoring

Do you want to be a partner?

Contact [email protected]


OrientDBfor Java developers

8 hours

OrientDBMaster Development

14 hours

OrientDBfor SOA

6 hours

OrientDBand the power of graphs

6 hours

OrientDBfor DBA

6 hours

OrientPlanetfor Web Developers

6 hours


Certification Programto be part of the network

do coursesshare revenues for support

work as [email protected]


“OrientDB in Action”book

by Manning Publicationsis coming: January 2013


NuvolaBase.com

The firstGraph Database

on the Cloud

always availablefew seconds to setup it

use it from app & mobile


Luca Garulli

www.twitter.com/lgarulli

CEO atAuthor of

Document-Graph NoSQLOpen Source project

Ltd, London UK

Design your application using Persistent Graphs and OrientDB

Technology

Transcript of Design your application using Persistent Graphs and OrientDB