© 2012 VMware, Inc. All rights reserved

Ramnivas Laddad

@ramnivas

Framework Integration in Cloud Foundry

2

CONFIDENTIAL

@ramnivas

Spring framework committer

Cloud Foundry committer

Main interests

• Cloud computing

• Aspect-oriented programming

• Scala and functional programming

Author of books and articles

• AspectJ in Action (1st and 2nd edition)

Speaker at many professional conferences

• JavaOne, JavaPolis, SpringOne, Software Development, No Fluff Just Stuff, EclipseCon, O’Reilly OSCON etc.

Active involvement in AspectJ, Spring, and Cloud Foundry since their early form

3

CONFIDENTIAL

Technologies “Я” Us

RabbitMQ

Postgres

REST

MySQLJPA

HibernateJDBC

Django

node.jsRedis

JTA

JMS

Web Services

Spring

Security

Caching

Mongo AMQP

Neo4j

JSF

Sinatra

TestingScripting

HTML5

RailsLift

Batch Job

LDAP

Grails

Ruby

Java

Python

AkkaScala

Closure

Hadoop

4

CONFIDENTIAL

Technologies “Я” Us

Monitoring

Hardware failures

Backups

Rolling Updates

Patches

Security DoS

OS

DNSStorage

Routing

DBA

Network

Load balancing

User managementAuditing

Access logs

5

CONFIDENTIAL

More functionality

Time to market pressure

Complex integration

Higher stake in quality

Facets of complexity: Product

6

CONFIDENTIAL

Sound architecture: future proofing without overdoing

Unit and integration tests

Responding to changing business needs

Confusing technology landscape

Facets of complexity: Development

7

CONFIDENTIAL

Choosing the right hardware, operating system, web server

Monitoring applications

Responding to scalability needs

Dealing with hardware- and system-level failures

Upgrading without substantial down time

Facets of complexity: Deployment and operation

8

CONFIDENTIAL

Inherent vs. Apparent Complexity

ImplementationFunctional logic

Implementation overhead

Inherent

complexity

Apparent

complexity

What can we do about this?

9

CONFIDENTIAL

What can we do?

?

10

CONFIDENTIAL

SaaSSoftware as a Service

PaaSPlatform as a Service

IaaSInfrastructure as a

Service

Three layers of Cloud Computing

11

CONFIDENTIAL

Clou

d Pr

ovid

er In

terfa

ce

Application Service Interface

Private Clouds

PublicClouds

Micro Clouds

Cloud Foundry open PaaS - Choice of clouds

Data Services

Other Services

Msg Services

12

CONFIDENTIAL

Clou

d Pr

ovid

er In

terfa

ce

Application Service Interface

Private Clouds

PublicClouds

Data Services

Other Services

Msg Services

Partners

Apache2 license

Cloud Foundry open PaaS - Choice of clouds

Micro Clouds

13

CONFIDENTIAL

Frameworks in Cloud Foundry

14

CONFIDENTIAL

Community and Partner contributions

The Cloud Foundry Universe

Core Frameworks

15

CONFIDENTIAL

Java

• Spring

• Grails

• Lift

Ruby

• Rails

• Sinatra

• Rack

Node.js (Community lead: Joyent)

Core Runtimes and Frameworks

16

CONFIDENTIAL

Python

• Django

• WSGI

Erlang OTP/Rebar

PHP

Perl

.Net

• On Iron Foundry

Community and partners contributions

17

CONFIDENTIAL

The Platinum Rule

Treat each framework

the way it will like to be treated!

18

CONFIDENTIAL

Common Framework Support

19

CONFIDENTIAL

Create apps and services

Update bindings, memory etc.

Scale instances

Command-line access

$ vmc push conference

$ vmc create-service mysql conf-db

$ vmc bind-service conf-db conference

$ vmc instances conference +2

20

CONFIDENTIAL

Access to services and app info through environment variables

• Service host, port, credentials

• App ip and port

Access to services and app info

VCAP_SERVICES: {

"postgresql-9.0": [{

"name": "env-postgresql",

"label": "postgresql-9.0",

"plan": "free",

"credentials": {

"name": "de24667f9344b4eeaad6b5a2326d52faa",

"host": "172.30.48.122",

"port": 5432,

"user": "u50ce600bba434bacbc99e034bb415644",

"password": "pf4dca5bd449d4732841f0c4ae3f299d0"

}

}]

}

21

CONFIDENTIAL

A runtime library to access service and app info

Auto-reconfiguration for typical apps

• Node.js coming soon

Simplified app configration

22

CONFIDENTIAL

Access to service through Caldecott

$ vmc tunnel conf-dbBinding Service [conf-db]: OKStopping Application 'caldecott': OKStaging Application 'caldecott': OK Starting Application 'caldecott': OK Getting tunnel connection info: OK Service connection info: username : uG5jVXaBPmjl6 password : pE3HOwIwGgkbv name : d76e62447a4c04f2b8e7b79f41c450aa0 Starting tunnel to conf-db on port 10000.1: none2: mysql3: mysqldumpWhich client would you like to start?: 2

23

CONFIDENTIAL

Access to service through Caldecott

Launching 'mysql --protocol=TCP --host=localhost --port=10000 --user=uG5jVXaBPmjl6 --password=pE3HOwIwGgkbv d76e62447a4c04f2b8e7b79f41c450aa0' ...  mysql> select * from users; 

24

CONFIDENTIAL

Manifest Support---

applications:

.:

name: conference

url: ${name}.${target-base}

framework:

name: rails3

info:

mem: 256M

description: Rails Application

exec:

mem: 256M

instances: 1

services:

conf-db:

type: mysql

25

CONFIDENTIAL

Spring

26

CONFIDENTIAL

IDE integration

• SpringSource Tools Suite and Eclipse

• Open source

Auto-reconfiguration by hooking into Spring application context

<cloud:> namespace

Spring 3.1 profile support

Maven plugin

The Platinum Rule: Spring and Grails

27

CONFIDENTIAL

IDE Integration

28

CONFIDENTIAL

Auto-Reconfiguration: Relational DB Detects beans of type javax.sql.DataSource

Connects to MySQL or PostgreSQL services

• Specifies driver, url, username, password, validation query

Creates Commons DBCP or Tomcat DataSource

<bean class="org.apache.commons.dbcp.BasicDataSource"

destroy-method="close" id="dataSource">

<property name="driverClassName" value="org.h2.Driver" />

<property name="url" value="jdbc:h2:mem:" />

<property name="username" value="sa" />

<property name="password" value="" />

</bean>

29

CONFIDENTIAL

<cloud:service-scan>

Scans all services bound to the application and creates a bean of an appropriate type for each

• Same bean types as auto-reconfiguration

Useful during early development phases

<beans …>

<cloud:service-scan/>

</beans>

30

CONFIDENTIAL

<cloud:service-scan> Autowire Dependencies

Created beans can be autowired as dependencies

Use @Qualifier with service name if multiple services of same type bound to app

@Autowired(required=false) private ConnectionFactory rabbitConnectionFactory;

@Autowired private RedisConnectionFactory redisConnectionFactory;

@Autowired @Qualifier("test_mysql_database")

private DataSource mysqlDataSource;

@Autowired(required=false) @Qualifier("test_postgres_database")

private DataSource postgresDataSource;

31

CONFIDENTIAL

<cloud:data-source>

Configures a DataSource bean

• Commons DBCP or Tomcat DataSource

Basic attributes:

• id: defaults to service name

• service-name: only needed if you have multiple relational database services bound to the app

<cloud:data-source id="dataSource"/>

32

CONFIDENTIAL

Isolating Cloud Foundry Configuration

<bean class="org.sf.orm.jpa.LocalContainerEntityManagerFactoryBean"

id="entityManagerFactory">

<property name="dataSource" ref="dataSource"/>

</bean>

<beans profile="cloud">

<cloud:data-source id="dataSource" />

</beans>

<beans profile="default">

<bean class=”o.a.commons.dbcp.BasicDataSource" id="dataSource">

<property name="url" value="jdbc:mysql://localhost/inventory" />

</bean>

</beans>

33

CONFIDENTIAL

Scala/Lift Auto-reconfiguration for Scala Lift apps

PostgreSQL support coming soon

34

CONFIDENTIAL

Ruby

35

CONFIDENTIAL

Bundle support

• Just include a Gemfile.lock

Rails console

• Debugging

Auto-reconfiguration through meta-programming

cf-runtime gem

The Platinum Rule: Rails, Sinatra, Rack

36

CONFIDENTIAL

$ vmc rails-console conf

Connecting to 'conf' console: OK

irb():001:0> u = User.find_by_email('ramnivas@ramnivas.com')

=> #<User id: 1, email: "ramnivas@ramnivas.com", reason: "It is cool!", created_at: "2012-03-29 23:10:34", updated_at: "2012-03-29 23:10:34">

irb():002:0> u.email = "rladdad@vmware.com"

=> "rladdad@vmware.com"

irb():003:0> u.save

=> true

irb():004:0> u = User.find_by_email('rladdad@vmware.com')

=> #<User id: 1, email: "rladdad@vmware.com", reason: "It is cool!", created_at: "2012-03-29 23:10:34", updated_at: "2012-03-29 23:14:17">

Rails Console

37

CONFIDENTIAL

require 'mongo' module Demo  class App < Sinatra::Base    configure do      mongo =  Mongo::Connection.new(:host => '127.0.0.1', :port => 27017) db = mongo['db']    end    ...  endend

Ruby auto-reconfiguration

38

CONFIDENTIAL

cf-runtime: Ruby Runtime Gem

require 'cfruntime/mongodb'

connection =

CFRuntime::MongoClient.create_from_svc('docs')

db = connection.db

...

39

CONFIDENTIAL

Running locally and in Cloud Foundry

require 'cfruntime/mongodb'

...

db = CFRuntime::MongoClient.create.db

rescue Mongo::Connection.new("localhost",

27017)

.db("db”)

...

40

CONFIDENTIAL

Taking full control

if CFRuntime::CloudApp.running_in_cloud?  @service_props = CFRuntime::CloudApp.service_props('docs’)else  @service_props = {}  @service_props[:host] = 'localhost'  @service_props[:port] = 27017  @service_props[:db] = 'testdb'enddb = Mongo::Connection.new(@service_props[:host], @service_props[:port]) .db(@service_props[:db])if CFRuntime::CloudApp.running_in_cloud?  db.authenticate(@service_props[:username], @service_props[:password])end

41

CONFIDENTIAL

Node.js

42

CONFIDENTIAL

NPM support

• Coming soon!

Debugging using node-inspector

Auto-reconfiguration and runtime package

• Coming soon!

The Platinum Rule: Node.js

43

CONFIDENTIAL

Debugging node.js apps

44

CONFIDENTIAL

Auto-reconfiguration in node.jsvar host = 'localhost', port = 3000, url = require('url'); var client = require("redis").createClient(); require('http').createServer(function (req, res) { ...

45

CONFIDENTIAL

var cfruntime = require('cfruntime'), host = cfruntime.CloudApp.host || 'localhost', port = cfruntime.CloudApp.port || 3000, url = require('url'); if (cfruntime.CloudApp.runningInCloud) { var client = cfruntime.RedisClient.create();} else { var client = require("redis").createClient();} require('http').createServer(function (req, res) { ...

Accessing apps and services info

46

CONFIDENTIAL

Peeking into future

47

CONFIDENTIAL

Bring your own container

• Jetty

• Netty

• …

Non-web apps

• Resque workers

• Spring Batch

• Spring Integration

Still to come

• Short-running apps

• Scheduled tasks

Standalone apps

48

CONFIDENTIAL

Lift updated support

Play!

Akka

Enhanced Scala Support

49

CONFIDENTIAL

Revamped vmc

• Embeddable core

• Scripting friendly

• Even more intuitive user interaction

Eclipse plugin

• Enhanced wizard with service requirement detection

• Manifest support

• Caldecott integration

Improved Tools

© 2012 VMware, Inc. All rights reserved

Ramnivas Laddad

@ramnivas

Questions?