Optimizing production apps on heroku 7.31.13

Join the conversation via #herokuJoin the conversation via #heroku

Optimizing Production Apps Optimizing Production Apps on Herokuon HerokuOptimizing Production Apps Optimizing Production Apps on Herokuon Heroku

Ryan Huber, Customer AdvocateRyan Huber, Customer Advocate@ryan_huber@ryan_huber

Greg Nokes, Technical Account ManagerGreg Nokes, Technical Account Manager@tsykoduk@tsykoduk


IntroductionsIntroductions

Ryan HuberCustomer Advocate

@ryan_huber

Greg NokesTechnical Account

Manager@tsykoduk


AgendaAgendaAgendaAgenda Using CDN to increase app performance

Managing Asset Pipeline (RoR specific)

PG Extras - Postgres

Postgres Database Migrations

Postgres Database Followers

Database Caching

Recommended Monitoring Tools


AssumptionsAssumptionsAssumptionsAssumptions Existing Heroku User

General understanding of Heroku / CLI

Have installed Toolbelt & created / pushed apps

General understanding of Postgres / SQL

Have provisioned Postgres databases on Heroku

*** This webinar is being recorded and distributed online ***


Asset PipelineAsset PipelineAsset PipelineAsset Pipeline



Processes assets for use by Caching



Two hard problems in Computer Science:

1. Cache Invalidation

2. Naming Things

3. Off by One errors



Helps with Cache Invalidation and Naming Things



What about uploading to S3?



NO



Then you have 2 sets of files to manage



Leave them on the Dyno

Use a Edgecache CDN such as:

CDN Sumo

Cloudfront

CDNetworks

Akamai


Why Use a CDN? Why Use a CDN? Why Use a CDN? Why Use a CDN?


CDN vs S3CDN vs S3CDN vs S3CDN vs S3Application Assets User Generated Assets


S3 Best PracticesS3 Best PracticesS3 Best PracticesS3 Best Practices

Direct Upload

Pass-through Upload

* If processing is required *

https://devcenter.heroku.com/articles/s3


CDN Best PracticesCDN Best PracticesCDN Best PracticesCDN Best PracticesCache/Pull CDN

Sync/Push CDN

* Automatic Update*

* Manual Update*

Cache/Pull CDN Recommended

CDN Sumo (Heroku Addon)https://addons.heroku.com/

cdn_sumo


PG ExtrasPG ExtrasPG ExtrasPG Extras

http://www.craigkerstiens.com/2012/10/01/understanding-postgres-performance/

http://www.craigkerstiens.com/2013/01/10/more-on-postgres-performance/



A Heroku plugin for awesome pg:* commands that are also great and fun

and super.



There is a lot in there



We will talk about two

1. heroku pg:cache_hit

2. heroku pg:index_usage


heroku pg:cache_hitheroku pg:cache_hitheroku pg:cache_hitheroku pg:cache_hit

Shows the cache hit ratio.

A good measure of database sizing

We like to see it at 99%


heroku pg:index_usageheroku pg:index_usageheroku pg:index_usageheroku pg:index_usage

Shows the index hit ratio on each table

Big, heavily used tables need to have 99 – 100%


Postgres Database MigrationPostgres Database MigrationPostgres Database MigrationPostgres Database Migration


Dev / Basic vs Production DBsDev / Basic vs Production DBsDev / Basic vs Production DBsDev / Basic vs Production DBs

Dev / Basic* Not suitable for production applications* Expected uptime of 99.5%* Many level features not supported: Fork, follow* Row number limitation: 10K for Dev, 10M for Basic.* The database instance is shared among many other customers

Production* Designed for higher uptime, 99.95%* No row level limitation* You get your own database instance* Fork, follow supported* Suitable for production applications


Migrating Dev / Basic DBsMigrating Dev / Basic DBsMigrating Dev / Basic DBsMigrating Dev / Basic DBs

https://devcenter.heroku.com/articles/upgrade-heroku-postgres-with-pgbackups


Migrating Production DBsMigrating Production DBsMigrating Production DBsMigrating Production DBs

https://devcenter.heroku.com/articles/heroku-postgres-follower-databases


Follower DatabasesFollower DatabasesFollower DatabasesFollower Databases

Starter:

Development

No Fork/Follow

99.5% uptime



Production:

Can Fork/Follow

99.95% uptime



Why?


Follower DatabaseFollower DatabaseFollower DatabaseFollower Database

HA


Follower DatabaseFollower DatabaseFollower DatabaseFollower Database

Analytics / Reporting



Octopus gem (https://github.com/tchandy/octopus)


Overcoming Postgres Connection LimitsOvercoming Postgres Connection LimitsOvercoming Postgres Connection LimitsOvercoming Postgres Connection Limits



Limit the number of connections

https://devcenter.heroku.com/articles/forked-pg-connections



Sometimes that’s not enough



https://github.com/gregburek/heroku-buildpack-pgbouncer


Caching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & Performance


Caching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & Performance

https://devcenter.heroku.com/articles/memcachier

http://guides.rubyonrails.org/caching_with_rails.html


Performance MonitoringPerformance MonitoringPerformance MonitoringPerformance Monitoring

New Relic

Dyno Queuing

Runtime Metrics (https://devcenter.heroku.com/articles/log-

runtime-metrics)

Log2viz (http://log2viz.herokuapp.com/)

Logging


New RelicNew RelicNew RelicNew Relic

https://devcenter.heroku.com/articles/newrelic

Ruby

Java

Python

Node


New Relic: BenefitsNew Relic: BenefitsNew Relic: BenefitsNew Relic: Benefits



New Relic: Pro vs StandardNew Relic: Pro vs StandardNew Relic: Pro vs StandardNew Relic: Pro vs Standard



New Relic: Caveats New Relic: Caveats New Relic: Caveats New Relic: Caveats



Dyno QueuingDyno QueuingDyno QueuingDyno Queuing

Processing in the router

Traveling over the network to a dyno

Queuing in the TCP socket backlog

Processing by the web server

Processing by Rack middleware

https://devcenter.heroku.com/articles/newrelic#interpreting-new-relic-request-queueing


Runtime MetricsRuntime MetricsRuntime MetricsRuntime Metrics

Resident Memory (memory_rss)

Disk Cache Memory (memory_cache)

Swap Memory (memory_swap)

Total Memory (memory_total)

Pages Written to Disk (memory_pgpgout)

Pages Read from Disk (memory_pgpgin)

CPU Load Avg (1 min, 5 min, 15 min avgs)

https://devcenter.heroku.com/articles/log-runtime-metrics


Log2vizLog2vizLog2vizLog2viz

http://log2viz.herokuapp.com/


LoggingLoggingLoggingLogging

https://devcenter.heroku.com/articles/logging


RecapRecapRecapRecap

Cache Assets

PG-Extras to Understand DB Performance

Select the Right DB Plan / Configuration

Leverage App Monitoring Tools


Q&AQ&A

Ryan HuberCustomer Advocate

@ryan_huber

Greg NokesTechnical Account

Manager@tsykoduk

Optimizing production apps on heroku 7.31.13

Technology

Transcript of Optimizing production apps on heroku 7.31.13