1© 2014 Pivotal Software, Inc. All rights reserved.

Whose Metric is it Anyway

Kira CombsCloud Foundry Logging and Metrics

Denver, CO

2© 2014 Pivotal Software, Inc. All rights reserved.

What you’re in for- Loggregator lesson

- Types of metrics

- Examples of important metrics

- ComponentMetrics app demo

@kicombs

3© 2014 Pivotal Software, Inc. All rights reserved.

Loggregator

- Sources- Metron- Doppler- Traffic Controller

@kicombs

4© 2014 Pivotal Software, Inc. All rights reserved.

Loggregator

@kicombs

5© 2014 Pivotal Software, Inc. All rights reserved.

Firehose (Demo)

@kicombs

6© 2014 Pivotal Software, Inc. All rights reserved.

Types of Metrics

@kicombs

7© 2014 Pivotal Software, Inc. All rights reserved.

HttpStart HttpStop HttpStartStop

Client GoRouter

HTTPStart

Request

Response

HTTPStop

HTTPStartStop

@kicombs

8© 2014 Pivotal Software, Inc. All rights reserved.

Log Events- STDOUT or STDERR

- AppID

- Message

@kicombs

9© 2014 Pivotal Software, Inc. All rights reserved.

Error Event

- Source

- Error Code

- Description

@kicombs

10© 2014 Pivotal Software, Inc. All rights reserved.

Container Metric- App Information

- CPU Percentage- Disk Space- Memory

@kicombs

11© 2014 Pivotal Software, Inc. All rights reserved.

Counter Event Value Metric

- Numerical count- Incremented or

Decremented

- Numerical representation of a value

http://metrics20.org/spec/#units

@kicombs

12© 2014 Pivotal Software, Inc. All rights reserved.

Metric Structure

app_benchmarking.rest_of_time

datadog.nozzle.DopplerServer.TruncatingBuffer.DroppedMessages

datadog.nozzle.DopplerServer.messageRouter.numberOfDumpSinks

datadog.nozzle.routing_api.total_routes

diego.canary.app.instance

datadog.nozzle.router__0.routed_app_requests

@kicombs

13© 2014 Pivotal Software, Inc. All rights reserved.

datadog.nozzle.DopplerServer.TruncatingBuffer.DroppedMessages

Origin

Next traveled to Ended

up at

Final, emitted metric (CounterEvent)

@kicombs

14© 2014 Pivotal Software, Inc. All rights reserved.

Masters of Metrics(Not Really)

@kicombs

15© 2014 Pivotal Software, Inc. All rights reserved.

Metric Logging Tools

APM (please enjoy aworking demo)

@kicombs

16© 2014 Pivotal Software, Inc. All rights reserved.

Metric Logging Tools

Datadog

@kicombs

17© 2014 Pivotal Software, Inc. All rights reserved.

Some Interesting Metrics

@kicombs

18© 2014 Pivotal Software, Inc. All rights reserved.

Reservable Stagers

(cf.collector.reservable_stagers)

@kicombs

19© 2014 Pivotal Software, Inc. All rights reserved.

Log Message Marshalled

(datadog.nozzle.MetronAgent.dropsondeMarshaller.logMessageMarshalled)

@kicombs

20© 2014 Pivotal Software, Inc. All rights reserved.

CPU Percentage(bosh.healthmonitor.system.cpu.user)

@kicombs

21© 2014 Pivotal Software, Inc. All rights reserved.

Router Bad Requests

(cf.collector.router.bad_requests)

@kicombs

22© 2014 Pivotal Software, Inc. All rights reserved.

Demo (ComponentMetrics)

@kicombs

23© 2014 Pivotal Software, Inc. All rights reserved.

Questions?

@kicombs

24© 2014 Pivotal Software, Inc. All rights reserved.

Thank You

Kira Combs

PCF Denver, CO

@kicombs

@kicombs

We are hiring!! (London and Berlin)pivotal.io/careers

25© 2014 Pivotal Software, Inc. All rights reserved.

Additional Resources

- Hiring: http://pivotal.io/careers- Metric Types: https://github.com/cloudfoundry/dropsonde-

protocol/tree/master/events- Value Metric Units: http://metrics20.org/spec/#units- Cloud Foundry Release: https://github.com/cloudfoundry/cf-release- Loggregator: https://github.com/cloudfoundry/loggregator- Firehose Metrics Catalog: https://github.

com/cloudfoundry/loggregator/wiki/Firehose-Metric-Catalog- (other wiki pages contain more component-specific metrics)- Not a complete resource