CloudFoundry and MongoDb, a marriage made in heaven

Cloud Foundry and MongoDB, a marriage made in heaven Patrick Chanezon@chanezonSenior Director, Developer RelationsVMware

Friday, December 9, 11

P@ in a nutshell

• French, based in San Francisco

• Senior Director, Developer Relations, VMware

• Software Plumber, API guy, mix of Enterprise and Consumer

• 18 years writing software, backend guy with a taste for javascript

• 2 y Accenture (Notes guru), 3 y Netscape/AOL (Servers, Portals), 5 y Sun (ecommerce, blogs, Portals, feeds, open source)

• 6 years at Google, API guy (first hired, helped start the team)

• Adwords, Checkout, Social, HTML5, Cloud

Spring

Spring’s aim:

bring simplicity to java development

web tier &

RIAservice tier batch

processing

integration &

messaging

data access

/ NoSQL / Big Data

mobile

tc ServerTomcatJetty

lightweightCloudFoundry

VMForce Google App Engine

Amazon Web Services

the cloud: WebSphereJBoss ASWebLogic

(on legacy versions, too!)

traditional

The Spring framework

Spring Data

Data Access Challenge #1: Scale Horizontally

Data Access Challenge #2: Heterogeneous data access needs

New demands on data access

•... until we needed inexpensive horizontal scaling for some large web based applications ...•... and we needed to deploy our apps in the cloud ...

* image courtesy of Bitcurrent

NoSQL offers several data store categories

ColumnKey-Value Document Graph

Redis, Riak

Cassandra,HBase

MongoDB Neo4J

NoSQL offers several data store categories

ColumnKey-Value Document Graph

MongoDB (who cares about the rest?)

Spring Frameworkbuilt-in data access support

•Transaction abstractions•Common data access exception hierarchy•JDBC - JdbcTemplate•ORM - Hibernate, JPA support•OXM - Object to XML mapping•Serializer/Deserializer strategies (Spring 3.0)•Cache support (Spring 3.1)

•Spring Data Key-value•Spring Data Document•Spring Data Graph•Spring Data Column•Spring Data Blob•Spring Data JPA Repository / JDBC Extensions•Spring Gemfire / Spring Hadoop ...•Grails iNcOnSeQuentiaL

http://www.springsource.org/spring-data

Spring Data Building Blocks

•Low level data access APIs✓MongoTemplate, RedisTemplate ...•Object Mapping (Java and GORM)•Cross Store Persistence Programming model•Generic Repository support •Productivity support in Roo and Grails

Spring MongoDB

Spring Data Document Mongo

•MongoTemplate•MongoConverter interface for mapping Mongo documents•SimpleMongoConverter for basic POJO mapping support•Leverage Spring 3.0 TypeConverters and SpEL•Exception translation•Advanced Mapping•Annotation based (@Document, @Id, @DbRef)•MongoRepository•Built on Hades support for JPA Repositories

Simple Domain Class

Mongo Template

Direct Usage of the Mongo Template:

Mongo Template

Insert into “Person” Collection

Mongo Template

findOne using query: { "name" : "Joe"} in db.collection: database.Person

Mongo Template

Dropped collection [database.person]

Generic Repository

Interface for generic CRUD operations on a repository for a specific type

Paging and Sorting Repository

Extends “CrudRepository” Paging and Sorting Repository:

Paging and Sorting Repository

Extends “CrudRepository”

Usage:

Paging and Sorting Repository:

Custom Repository

Custom Repository:

Custom Repository

Custom Repository:

Keyword Sample Logical result

GreaterThan findByAgeGreaterThan(int age) {"age" : {"$gt" : age}}

LessThan findByAgeLessThan(int age) {"age" : {"$lt" : age}}

Between findByAgeBetween(int from, int to) {"age" : {"$gt" : from, "$lt" : to}}

NotNull findByFirstnameNotNull() {”firstname" : {"$ne" : null}}

Null findByFirstnameNull() {”firstname" : null}

Like findByFirstnameLike(String name) "firstname" : firstname} (regex)

Keywords :

Cross Store

JPA and MongoDB

JPA “Customer” with a “SurveyInfo” Document

Using a Cross-Store

Saving a Customer with a SurveryInfo

Using a Cross-Store

Saving a Customer with a SurveryInfoCreate Customer

Using a Cross-Store

Create SurveyInfo

Using a Cross-Store

Assign Survey to Customer

Using a Cross-Store

Mongo Document:

Cloud Foundry

Cloud Foundry: The Open PaaS

Application Service Private Clouds

PublicCloud

MicroCloud

Data Services

Other Services

Msg Services

vFabric Postgres

vFabric RabbitMQTM

• Open Source: Apache 2 Licensed

• multi language/frameworks

• multi services

• multi cloud

Open Source

Open Source Advantage

§ http://code.google.com/p/googleappengine/issues/detail?id=13

• https://github.com/cloudfoundry/vcap/pull/25

Multi Cloud

CloudFoundry.COM

Runtimes & Frameworks

Services

vCenter / vSphere

Cloud Foundry

Infrastructure

Cloud Foundry.ORG

The Source Code to Compile & Build Cloud Foundry

vCenter / vSphere

Cloud Foundry

Download

Setup Environment

Deploy Behind Firewall

Setup Scripts

Micro Cloud Foundry

What is a Micro Cloud?

Entire Cloud Running inside of a single VM

Micro Cloud Foundry… (BETA)

A pre-built Micro (Single VM) version of Cloud Foundry…

Signup @ http://cloudfoundry.com/micro

You need a Cloud Foundry.com Account to use Micro Cloud Foundry

Micro Cloud Foundry… (BETA)

A pre-built Micro (Single VM) version of Cloud Foundry…

Signup @ http://cloudfoundry.com/micro

You need a Cloud Foundry.com Account to use Micro Cloud Foundry

Pre-requisites

Resources

Virtualization

Clients

Minimum 1 GB

Minimum 8 GB

Internet Connectivity

(w/DHCP is ideal)

VMC STSCommand line GUI

What is in Micro Cloud Foundry?

Open source Platform as a Service project

App Instances Services

Dynamic Updating DNS

Other Cloud Foundry powered PaaS

Private PaaS

Added Python and Perl

Public PaaS

Added PHP

Services

Current Services Available on Cloud Foundry

Service Creation and Binding

App Instance

App Instance Redis Service

MongoDB

Service

Development LifeCycle

Traditional App Deploy and Request/Response

Request/AllocateBuild/SetupInstall/ConfigureDeploy/Test

Scale?Upgrade?Update?

How Apps are Deployed on Cloud Foundry

“vmc push MyApp”

WebApp

“vmc instances MyApp 5”“vmc map MyApp MyApp2”“vmc update MyApp”

How Apps are Deployed on Cloud Foundry

WebApp

“vmc instances MyApp 5”“vmc map MyApp MyApp2”“vmc update MyApp”

How Apps are Accessed on Cloud Foundry

App Instance

Service

Request Web InterfaceLoad

Balancingand

Routing

Response

How Apps are Scaled on Cloud Foundry

App Instances

Service

Request

Response

Balancer(s)Load

Balancer(s)

Load Balancing

and Routing

“vmc instances MyApp 3”

How Apps are Updated on Cloud Foundry

Service

PreviousVersion

InstanceStopped

UpdatedCode

NewVersion

“vmc update MyApp”

At Scale – Multi-Node Distributed App

rabbitMQ

redis mysql

system load balancer

elastic pool

front_end front_end

elastic pool

back_end

mongodb

Setting up Cloud Foundry Demo

Caldecott: tunnelling to Cloud Foundry services

Accessing Services Bound to Cloud Foundry (producer)

private String mongoDatabaseServiceName = "survey-mongo";

@Beanpublic CloudEnvironment cloudEnvironment() { return new CloudEnvironment();}

@Beanpublic MongoServiceInfo mongoServiceInfo() { return cloudEnvironment().getServiceInfo( mongoDatabaseServiceName, MongoServiceInfo.class);}

@Beanpublic MongoDbFactory mongoDbFactory() { MongoServiceCreator msc = new MongoServiceCreator(); MongoDbFactory db = msc.createService(mongoServiceInfo());}

Accessing Services Bound to Cloud Foundry (consumption)

@Inject private Mongo mongo ;

@Inject private MongoTemplate mongoTemplate;

Cloud Foundry MongoDB Demo

Where to Find More

§ Spring Data Project: http://bit.ly/spring-data

§ CloudFoundry Samples: http://bit.ly/cloudfoundry-samples

§ MicroCloud Foundry for Spring Developershttp://bit.ly/mcf4spring

§ Spring Data Mongo on Cloud Foundry (webinar, 12/01/2011)

§ http://bit.ly/spring-mongo-cloudfoundry

CloudFoundry and MongoDb, a marriage made in heaven

Technology

Transcript of CloudFoundry and MongoDb, a marriage made in heaven

MongoDB Europe 2016 - Debugging MongoDB Performance

MongoDB Days Silicon Valley: Introducing MongoDB 3.2

MongoDB Days Germany: Data Processing with MongoDB

MongoDB Europe 2016 - Graph Operations with MongoDB

Memcached as a Service for CloudFoundry

CloudFoundry Bootcamp springone2gx

MongoDB Europe 2016 - Distributed Ledgers, Blockchain + MongoDB

MongoDB World 2016: MongoDB & IBM

DevOps and Continuous Delivery with CloudFoundry

OpenSlava 2014 - CloudFoundry inside-out

MongoDB Days UK: MongoDB and Spark

Cloud Development Made Easy with CloudFoundry - IndicThreads cloud computing conference 2011

MongoDB Europe 2016 - Advanced MongoDB Aggregation Pipelines

Automated Lifecycle Management - CloudFoundry on OpenStack

Openstack CPI cloudfoundry

MongoDB and using MongoDB with .NET

Cassandra Summit 2014: Apache Cassandra on Pivotal CloudFoundry

Automate MongoDB with MongoDB Management Service

Free Yourself with CloudFoundry: A Private Cloud Experience

The Compatible One Application and Platform Service (COAPS ...€¦ · CloudFoundry-api: the CloudFoundry-COAPS implementation. ii. OpenShift-api: the OpenShift-COAPS implementation.