Continous Monitoring

151
Sreekanth @sreeix 1

description

Most lean manufacturing system have some version of singnelling or notifications system that is used by the workers to signal issues and errors. Andon is a very important part of Lean Manufacturing process, but it's an often overlooked practice in the Agile Development process.There are vast amounts of data produced out of an agile software development process, but most of it live in their own silos, where the access is available to only few people. The metrics on the process that are presented to the team are hard to understand, makes little sense and represents very limited scope. We champion the use of visually appealing and all round view of the development process. We also present a set of metrics that we build the andon process around, it breaks down the traditional data silos (includes source code information, deployment/bugs/story/application performance/build status) and makes information accessible to all people on the team. And when all the information is shared across the team in visually appealing way people feel empowered to detect and resolve the process problems.Information radiators are widely used in development process.We will also present our version of the information radiator that's based on these ideas.

Transcript of Continous Monitoring

Page 1: Continous Monitoring

Sreekanth@sreeix

1

Page 2: Continous Monitoring

Nilakanta@nilakanta

2

Page 3: Continous Monitoring

Developers

3

Page 4: Continous Monitoring

ThoughtWorkswww.thoughtworks.com

4

Page 5: Continous Monitoring

Continuous Monitoring

(For Continuous Improvement)

5

Page 6: Continous Monitoring

Presentation = 45 Min.

6

Page 7: Continous Monitoring

Design Radiators = Remainder

7

Page 8: Continous Monitoring

Jargon Warning

8

Page 9: Continous Monitoring

We all know Continuous

Integration...

9

Page 10: Continous Monitoring

Cruisecontrol

10

Page 11: Continous Monitoring

Cruisecontrol.net

11

Page 12: Continous Monitoring

Hudson

12

Page 13: Continous Monitoring

Cruise

13

Page 14: Continous Monitoring

And We’ve Had Build Radiators

14

Page 15: Continous Monitoring

Angry Snowman

15

Page 16: Continous Monitoring

Traffic Lights

16

Page 17: Continous Monitoring

Nabaztag

17

Page 18: Continous Monitoring

Build Radiator

18

Page 19: Continous Monitoring

More Build Radiators

19

Page 20: Continous Monitoring

Why?

20

Page 21: Continous Monitoring

am·bi·ent: adjectiveexisting or present on all sides

21

Page 22: Continous Monitoring

vi·su·al: adjectiveproducing mental images

22

Page 23: Continous Monitoring

au·to·mat·ic: adjectivehaving a self-acting or self-regulating mechanism

23

Page 24: Continous Monitoring

ac·ces·si·ble: adjectivecapable of being used or seen

24

Page 25: Continous Monitoring

Story of a Large Agile Project

25

Page 26: Continous Monitoring

Developers Write Code

26

Page 27: Continous Monitoring

QA’s Write Functional Tests

27

Page 28: Continous Monitoring

People call for Deleting Functional Tests

28

Page 29: Continous Monitoring

PM Steps in...

29

Page 30: Continous Monitoring

Adds Tests the Build Radiator

30

Page 31: Continous Monitoring

~15 passing tests out of 70

31

Page 32: Continous Monitoring

No New functional tests

(aka. Stop the Line)

32

Page 33: Continous Monitoring

Fix Existing Tests

33

Page 34: Continous Monitoring

Add New Tests

34

Page 35: Continous Monitoring

Ends with most passing tests and

growing

35

Page 36: Continous Monitoring

Left Test metrics on radiator

36

Page 37: Continous Monitoring

Team own up for tests

(Collective Responsibility)

37

Page 38: Continous Monitoring

Right Away(Fast Feedback)

38

Page 39: Continous Monitoring

Deja Vu?

39

Page 40: Continous Monitoring

Digression...

40

Page 41: Continous Monitoring

Andon

41

Page 42: Continous Monitoring

Lean Manufacturing

42

Page 43: Continous Monitoring

Jidoko Quality Control System

43

Page 44: Continous Monitoring

Andon (アンドン, あんどん, 行灯) is a manufacturing

term referring to a system to notify management, maintenance, and other workers of a quality or process problem. The centrepiece is a signboard incorporating

signal lights to indicate which workstation has the problem

44

Page 45: Continous Monitoring

Andon Board(Image Credit: wikipedia)

45

Page 46: Continous Monitoring

Detect a problem

46

Page 47: Continous Monitoring

Stop

47

Page 48: Continous Monitoring

Fix the Immediate

problem

48

Page 49: Continous Monitoring

Install a Countermeasure

49

Page 50: Continous Monitoring

Automate Supervisory

Functions

50

Page 51: Continous Monitoring

Not Production Function

51

Page 52: Continous Monitoring

Employees decide when to stop

52

Page 53: Continous Monitoring

Employees Decide Counter

Measures

53

Page 54: Continous Monitoring

Examples

54

Page 55: Continous Monitoring

Examples

55

Page 56: Continous Monitoring

Back to Software Development

56

Page 57: Continous Monitoring

Big Visible Charts

57

Page 58: Continous Monitoring

Display important project information not in some formal way,

not on the web, not in PowerPoint, but in charts on the wall that no one

can miss.

58

Page 59: Continous Monitoring

Tests

59

Page 60: Continous Monitoring

Burn Down

60

Page 61: Continous Monitoring

Scope Burndown

61

Page 62: Continous Monitoring

Niko Niko Cal

62

Page 63: Continous Monitoring

XP Values Quiz

Communication Feedback Simplicity

Courage Respect

63

Page 64: Continous Monitoring

XP Values Quiz

Communication Feedback Simplicity

Courage Respect

64

Page 65: Continous Monitoring

Good Projects Gone Bad

65

Page 66: Continous Monitoring

Good at Detecting Problems

66

Page 67: Continous Monitoring

Good at Fixing Problems

67

Page 68: Continous Monitoring

Not Good At Stopping

68

Page 69: Continous Monitoring

Worse At Installing

Countermeasures

69

Page 70: Continous Monitoring

Enter.

70

Page 71: Continous Monitoring

Continuous Monitoring

71

Page 72: Continous Monitoring

Coined by

Owen Rogers(@exortech)

72

Page 73: Continous Monitoring

“the practice of leveraging ambient displays to provide the whole team with information to continuously monitor overall project health”

73

Page 74: Continous Monitoring

Not Just ...

74

Page 75: Continous Monitoring

Build Status

75

Page 76: Continous Monitoring

Burndowns

76

Page 77: Continous Monitoring

It is...

77

Page 78: Continous Monitoring

Project Information

78

Page 79: Continous Monitoring

Source Control History

79

Page 80: Continous Monitoring

80

Page 81: Continous Monitoring

Deployment Status

81

Page 82: Continous Monitoring

Performance metrics

82

Page 83: Continous Monitoring

Code Quality

83

Page 84: Continous Monitoring

84

Page 85: Continous Monitoring

Team Calendar

85

Page 86: Continous Monitoring

Wasted time in meetings

86

Page 87: Continous Monitoring

87

Page 88: Continous Monitoring

Use your imagination...

88

Page 89: Continous Monitoring

Information lives in silos

89

Page 90: Continous Monitoring

Project Management

Software

90

Page 91: Continous Monitoring

(D)SCM Repositories

91

Page 92: Continous Monitoring

Operational Databases

92

Page 93: Continous Monitoring

Bugtrackers

93

Page 94: Continous Monitoring

Emails

94

Page 95: Continous Monitoring

Excel Sheets

95

Page 96: Continous Monitoring

Lead QA worries about Bug Queue

96

Page 97: Continous Monitoring

Tech Leads worry about Code

Quality

97

Page 98: Continous Monitoring

PM Worries about Stories

Signed off

98

Page 99: Continous Monitoring

Democratize Information

99

Page 100: Continous Monitoring

Make it collective Responsibility

100

Page 101: Continous Monitoring

Another Story...

101

Page 102: Continous Monitoring

102

Page 103: Continous Monitoring

Simple Radiator with Build

103

Page 104: Continous Monitoring

CCDashboard

Branch R1 - 2306

Stage 1 - 2608

Smoke - 2601

DB - 2306

Regression - 2308

104

Page 105: Continous Monitoring

Performance problems

105

Page 106: Continous Monitoring

Operational Database

106

Page 107: Continous Monitoring

Reported Metrics in standup every

week

107

Page 108: Continous Monitoring

Tech cards for the Issues

108

Page 109: Continous Monitoring

Operational Metrics

109

Page 110: Continous Monitoring

People fix issues soon as they see.

110

Page 111: Continous Monitoring

Everybody looked at

Performance

111

Page 112: Continous Monitoring

Right Away.

112

Page 113: Continous Monitoring

I focus on writing code

113

Page 114: Continous Monitoring

Bugs

114

Page 115: Continous Monitoring

Bug Map

115

Page 116: Continous Monitoring

116

Page 117: Continous Monitoring

Refactor Problem Areas

117

Page 118: Continous Monitoring

Prerequistes

118

Page 119: Continous Monitoring

Open workspace

119

Page 120: Continous Monitoring

Open Information

120

Page 121: Continous Monitoring

Self organizing Teams

121

Page 122: Continous Monitoring

Implementation

122

Page 123: Continous Monitoring

Step 1

123

Page 124: Continous Monitoring

Big Visible Charts

124

Page 125: Continous Monitoring

It is easy.

125

Page 126: Continous Monitoring

Step 2

126

Page 127: Continous Monitoring

Software Radiators

127

Page 128: Continous Monitoring

Start with...

128

Page 129: Continous Monitoring

Build Monitoring

129

Page 130: Continous Monitoring

Add as new problems are

fixed

130

Page 131: Continous Monitoring

Software > Paper Charts

131

Page 132: Continous Monitoring

Automated

132

Page 133: Continous Monitoring

Flexible Representation

133

Page 134: Continous Monitoring

Flexible Alerting

134

Page 135: Continous Monitoring

Tips for Radiators

135

Page 136: Continous Monitoring

Focus on Problems

136

Page 137: Continous Monitoring

Not Metrics

137

Page 138: Continous Monitoring

Trends

138

Page 139: Continous Monitoring

Not Absolute Numbers

139

Page 140: Continous Monitoring

Visibility and Simplicity

140

Page 141: Continous Monitoring

Not too much data

141

Page 142: Continous Monitoring

Visualization is important

142

Page 143: Continous Monitoring

One size may not fit all teams

143

Page 144: Continous Monitoring

Caveats(as you build

raidators)

144

Page 145: Continous Monitoring

Too much data

145

Page 146: Continous Monitoring

Use More Radiators

146

Page 147: Continous Monitoring

Use Alerts

147

Page 148: Continous Monitoring

Don’t Bother me till there is a

problem

148

Page 149: Continous Monitoring

Don’t display Coverage till it is

Abnormal

149

Page 150: Continous Monitoring

Like Nagois

150

Page 151: Continous Monitoring

Questions?

151