Basic Ops Skills and Tools for Beginners
-
Upload
mongodb -
Category
Technology
-
view
903 -
download
3
description
Transcript of Basic Ops Skills and Tools for Beginners
![Page 1: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/1.jpg)
rainforest @rainforestqa
Ops Skills and Tools for Beginners
![Page 2: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/2.jpg)
Russell Smith!
English guy Mongo DB Master Ex Ops consultant
Ruby / PHP developer YC S12 Alum
Using mongo in Prod since 1.6/1.8
![Page 3: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/3.jpg)
@rainforestqarainforest
Rainforest QA
!
Insanely simple testing
checkout: www.rainforestqa.com
![Page 4: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/4.jpg)
What is Ops?
![Page 5: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/5.jpg)
@rainforestqarainforest
Setting up servers / services
![Page 6: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/6.jpg)
@rainforestqarainforest
Supporting Engineers
![Page 7: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/7.jpg)
@rainforestqarainforest
Keeping stuff running
![Page 8: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/8.jpg)
@rainforestqarainforest
Avoiding disasters
![Page 9: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/9.jpg)
@rainforestqarainforest
Fixing breakage
![Page 10: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/10.jpg)
Lets Learn the basics
![Page 11: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/11.jpg)
Installation
![Page 12: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/12.jpg)
@rainforestqarainforest
Replicated
![Page 13: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/13.jpg)
@rainforestqarainforest
Sharded
![Page 14: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/14.jpg)
@rainforestqarainforest
Best practices
Ubuntu is simplest
Install from Mongo’s repo
Chose the right replica set size: 3 nodes
Never use 32 bits
![Page 15: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/15.jpg)
@rainforestqarainforest
Alternatives
MongoHQ
MonogLab
ObjectRocket
MMS + AWS (via automation)
![Page 16: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/16.jpg)
Monitoring Mongo
![Page 17: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/17.jpg)
@rainforestqarainforest
Server components
![Page 18: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/18.jpg)
@rainforestqarainforest
Storage
magnetic, ssd
metric: disk io
![Page 19: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/19.jpg)
@rainforestqarainforest
Memory / RAM
fastest general store
metrics; free, swap usage
![Page 20: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/20.jpg)
@rainforestqarainforest
Network
allows communication
use 1gbit or higher (avoid 100mbit)
metrics; latency, throughput
![Page 21: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/21.jpg)
@rainforestqarainforest
CPU
more is better
mostly used
metrics; % usage
![Page 22: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/22.jpg)
@rainforestqarainforest
Monitoring & Diagnostics
![Page 23: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/23.jpg)
@rainforestqarainforest
Top things to monitorFailover events
Repl Lag
Connections
Lock %
Disk usage
![Page 24: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/24.jpg)
@rainforestqarainforest
Hosted is Simplest
![Page 25: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/25.jpg)
MMSHosted, free for monitoring
!
Also can do Backups
Automation
![Page 26: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/26.jpg)
ScoutMonitors mongo, servers and many
others (Plugins!) !
non-free
![Page 27: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/27.jpg)
Server DensityMonitors mongo, servers and many
others (Plugins!) !
non-free
![Page 28: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/28.jpg)
@rainforestqarainforest
Opensource options
Ganglia
Munin
Nagios
Zabbix
![Page 29: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/29.jpg)
Linux tools to learnmongostat / mongotop
top iostat vmstat netstat
![Page 30: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/30.jpg)
@rainforestqarainforest
Mongo shellrs.conf()
rs.status()
db.serverStatus()
db.stats()
db.currentOp()
![Page 31: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/31.jpg)
@rainforestqarainforest
Backups
![Page 32: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/32.jpg)
@rainforestqarainforest
Backup options
mongodump
from the file system
LVM / EBS
MMS
![Page 33: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/33.jpg)
@rainforestqarainforest
TEST YOUR BACKUPS
![Page 34: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/34.jpg)
Common pitfals
![Page 35: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/35.jpg)
Missing indexes!
Running out of disk space
Untested backups
Sharding too late / wrong key
un-replicated / even set size
![Page 36: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/36.jpg)
@rainforestqarainforest
Conclusion
do backups
monitor
read the docs
![Page 37: Basic Ops Skills and Tools for Beginners](https://reader034.fdocuments.in/reader034/viewer/2022051608/540d5a768d7f728d7e8b48ae/html5/thumbnails/37.jpg)
rainforest @rainforestqa
Questions?@rainforestqa
@rhs