Onavo aws summit 2012
description
Transcript of Onavo aws summit 2012
![Page 1: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/1.jpg)
SCALING UP WITH AWSGROWING PAINS OF A STARTUP COMPANY
Galed FriedmannHead of Operations
![Page 2: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/2.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
ONAVO
![Page 3: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/3.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
ONAVO IS 100% CLOUD BASED
» Over 150 instances world wide› US East, EU West, South America,
Singapore
» Plenty of AWS services in use› EC2 S3 RDS IAM EMR› SES SNS SQS› CloudWatch Route53
CloudFront
![Page 4: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/4.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
BASIC ARCHITECTURE
![Page 5: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/5.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
THE GROWING PAINS
» Continuously growing› Adding more resources all the time
» Handling sudden increases› “We’re on TechCrunch, bring up more
servers!”
» Maintaining a 99.99% uptime
![Page 6: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/6.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
UTILIZING RESOURCES
![Page 7: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/7.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
AUTO SCALING
» Maintains the desired amount of instances› Replaces unhealthy instances
» Allows scaling up and down based on CloudWatch metrics
» Completely automated› Assumes your application is automated
![Page 8: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/8.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
BECOMING FULLY AUTOMATED
» Instance Store backed› Pre-bundled AMIs with everything
» Configuration» Sharing
› No persistent storage, but data needs to be shared
» Exporting› No persistent storage, but data needs to be
saved
![Page 9: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/9.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
AUTOMATING CONFIGURATION
» Puppet› Keeping
configuration up to date
› Share resources› Deploy changes
instantly
Configuration Sharing Exporting
![Page 10: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/10.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
LOAD BALANCER NEEDS TO KNOW
» Life is easy with Auto Scaling & ELB› We’re not using ELB
» Puppet keeps the LB up to date
Oct 18 00:34:58 puppet-agent[6841]: (/Stage[main]/Loadbalancer::Loadbalancer/Export::Expiringhost[proxy21]/Host[stable_host21]/ip) ip changed '0.0.0.1' to '10.207.110.184'Oct 18 00:34:58 puppet-agent[6841]: Finished catalog run in 2.87 seconds
Configuration Sharing Exporting
![Page 11: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/11.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
SHARED CONFIGURATION
» Basic information needs to be shared› Authentication details› Compression on/off› Desired compression level
» Are there any off the shelf solutions?
Configuration Sharing Exporting
![Page 12: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/12.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
REDIS TO THE RESCUE!
» Advanced key-value store» In memory data sets, atomic operations» Easy to implement master-slave replication
Configuration Sharing Exporting
![Page 13: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/13.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
LOG COLLECTION
» Logs need to be collected and processed in order to display users’ savings
» Flume – distributed, reliable and available service for moving large amounts of log data.
Configuration Sharing Exporting
![Page 14: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/14.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
DECIDING ON SCALING POLICIES
» Scale up quickly› You want to prepare for the worst
» Scale down slowly› Prevent fluctuations
» Get the most out of the resource› Maintain 80-90% utilization
![Page 15: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/15.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
PUTTING IT ALL TOGETHER
![Page 16: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/16.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
SUMMARY
» AWS have great building blocks» Auto Scaling
› Reduces operational costs› Assists in utilizing your resources effectively
» Prepare your automation and handle all use cases
» It’s worth it.
![Page 17: Onavo aws summit 2012](https://reader030.fdocuments.in/reader030/viewer/2022012918/54530fdfb1af9f76248b5685/html5/thumbnails/17.jpg)
COPYRIGHT © 2012 ONAVO LTD. PROPRIETARY AND CONFIDENTIAL.
THANK YOU
» [email protected]» @galedfriedmann