Google Analytics Konferenz 2012: Michael Ebner, e-dialog: Analytics und xls Plugins
Michael Still Google Inc. October, 2006
description
Transcript of Michael Still Google Inc. October, 2006
![Page 1: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/1.jpg)
Michael StillGoogle Inc.October, 2006
![Page 2: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/2.jpg)
2
Managing Unix servers the slack wayTools and techniques for managing
large numbers of Unix machines
Michael StillGoogle, Inc.October, 2006
![Page 3: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/3.jpg)
3
Who is this guy and what does he do at Google?
![Page 4: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/4.jpg)
4
Agenda
I thought we should talk about these things:
• My background
• Rules of thumb
• Tools:
– cssh
– slack
![Page 5: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/5.jpg)
5
Background
None of these tools or techniques are particularly unique, I more want to start a discussion about how to do this sort of thing, and how other
people do it, while sharing some information about the approach that Google takes.
![Page 6: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/6.jpg)
6
Rules of thumb
The following are obvious, right?
• Have a repeatable OS build
• Document, document, document
• Monitor your machines
• Keep failure metrics you know what to work on next
• Expect failures
• Have a repeatable application install
![Page 7: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/7.jpg)
7
Logging into many machines at once
First problem: executing the same command on many machines
• Clusters result in lots of machines which are identical
• Logging into them one after the other to perform maintenance sucks
• You could script this work, but that isn't time efficient
• I use clusterssh (also known as cssh)
• Let's log into a bunch of hypothetical database replicas and check their status
cssh myapp-rdb1 myapp-rdb2 myapp-rdb3 myapp-rdb4
![Page 8: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/8.jpg)
8
Logging into many machines at once
![Page 9: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/9.jpg)
9
Logging into many machines at once
cssh
• A relatively simple perl script
• Runs with your choice of terminal
• You can run commands on all machines, one machine, or a subset of the machines
• This tool was not developed at Google
• http://clusterssh.sourceforge.net/
![Page 10: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/10.jpg)
10
Repeatable software installs
slack
• Google's home grown software deployment system
• Written by Alan Sundell and Roman Marxer
• Centralized configuration repository
• Configuration is then deployed onto selected machines
• You can have more than one “slack role” on a given machine
![Page 11: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/11.jpg)
11
Repeatable software installs
![Page 12: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/12.jpg)
12
Repeatable software installs
slack
• Configuration changes flow from the Administrators via a code review mechanism
• Once checked into the source control repository, they are synced to the slack master
• Individual servers then sync their configurations from the slack master
– Manually: slack role.sub-role
– Automatically via cron
![Page 13: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/13.jpg)
13
Repeatable software installs
slack
• What does a role look like?
$ find mail-loghost -type f
mail-loghost/files/etc/cron.d/logcleanup
mail-loghost/files/etc/syslog-ng.conf.mailloghost
mail-loghost/files/usr/local/scripts/logcleanup
mail-loghost/scripts/postinstall
mail-loghost/scripts/preinstall
$
![Page 14: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/14.jpg)
14
Repeatable software installs
slack
• What does a sub-role look like?
$ find mail-loghost -type f
mail-loghost/files/etc/cron.d/logcleanup
mail-loghost/files/etc/syslog-ng.conf.mailloghost
mail-loghost/files/usr/local/scripts/logcleanup
mail-loghost/scripts/postinstall
mail-loghost/scripts/preinstall
mail-loghost/files.trakken-mail/etc/syslog-ng.conf.mailloghost
$
![Page 15: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/15.jpg)
15
Repeatable software installs
slack
• There are lot of similarities between this and binary packages like .deb or RPM:
– Pre and post install scripts
– Deploys files
• Things which are cool about slack:
– There is no intermediate packaged form
– Sub-roles
– Pre and post install scripts in any language
![Page 16: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/16.jpg)
16
Repeatable software installs
slack
• Versioning
– How do I undeploy a slack role?
– How do I find out what slack roles a machine needs?
– Dependencies between slack roles?
![Page 17: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/17.jpg)
17
Repeatable software installs
slack
• Where can you get slack?
– Google and Alan Sundell have released slack!
– http://www.sundell.net/~alan/projects/slack/
![Page 18: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/18.jpg)
18
Questions?
Any questions?
![Page 19: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/19.jpg)
19
One final note
Google is hiring, both domestically within Australia, and Internationally. Talk to me if you want to know more.
![Page 20: Michael Still Google Inc. October, 2006](https://reader036.fdocuments.in/reader036/viewer/2022062315/56814ef3550346895dbc8342/html5/thumbnails/20.jpg)
Michael StillGoogle, [email protected]