Velocity Conference - What do cats and APIs have in common? They are both awesome!

35
Q: What do APIs and cats have in common? A: They are both AWESOME!

description

Talk at 2014 Velocity Santa Clara Conference on utilizing the Keynote Systems API to help manage automate the reporting of performance metrics

Transcript of Velocity Conference - What do cats and APIs have in common? They are both awesome!

Page 1: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Q: What do APIs and cats have in common?

A: They are both AWESOME!

Page 2: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Before we get to the cats....

Page 3: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Stephen FishmanDirector, Consumer Platforms

Autotrader.com

Robert TanzolaManager, Technical Architecture

Autotrader.com

Abelardo GonzalezDirector, Product Management

Keynote Systems

Page 4: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Full Dislosure : We are all dog people

Page 5: Velocity Conference - What do cats and APIs have in common? They are both awesome!

And now, back to your regularly scheduled programming of cats.

Page 6: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Not much has changed since ancient Egypt...

Page 7: Velocity Conference - What do cats and APIs have in common? They are both awesome!

We are still writing on walls and worshipping cats

Page 8: Velocity Conference - What do cats and APIs have in common? They are both awesome!

One question remains: Are more cats are better than less cats?

Page 9: Velocity Conference - What do cats and APIs have in common? They are both awesome!

This is one of the mysteries of the universe...

Page 10: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Maybe we can solve this mystery by looking from a different perspective

Page 11: Velocity Conference - What do cats and APIs have in common? They are both awesome!

The most ardent lovers of cats are just like people who sell ads on media sites

Page 12: Velocity Conference - What do cats and APIs have in common? They are both awesome!

They both believe “more is better”... No matter what the cost

Page 13: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Which kinda sucks if it’s your job to herd the cats

Page 14: Velocity Conference - What do cats and APIs have in common? They are both awesome!

One of IT’s prime jobs in a well monetized media site, is to make it possible for our cat lovers (i.e., sales) to have more and more and more cats (i.e., ads) on our site while simultaneously improving the page performance of our site.

Page 15: Velocity Conference - What do cats and APIs have in common? They are both awesome!

This is a story of our journey as cat herders

Page 16: Velocity Conference - What do cats and APIs have in common? They are both awesome!

At Autotrader, We Have A 25-Page Daily Performance Dashboard

Page 17: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Managing Performance Is Good!

Page 18: Velocity Conference - What do cats and APIs have in common? They are both awesome!

We Have A Team Of Four Who Manually Produces This Every Day

Page 19: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Manually Managing Performance Is Bad!

Page 20: Velocity Conference - What do cats and APIs have in common? They are both awesome!

But It Does Not Have to Be That Way!

Page 21: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Automation + Performance Management = Transparency + Real Time Visibility

Page 22: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Transparency + Real Time Visibility = Executive Attention

Page 23: Velocity Conference - What do cats and APIs have in common? They are both awesome!

For those who don’t know... Executive Attention Creates Movement

Page 24: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Keynote REST API

• http://api.keynote.com/ - JSON or XML output

•Available Services

•Get Test “Slot” meta data (getslotmetadata)

•Get Test measurement results (getgraphdata)

•And more…

Page 25: Velocity Conference - What do cats and APIs have in common? They are both awesome!

The API is Listening

To  get  Keynote  graph  data:

https://api.keynote.com/keynote/api/getgraphdata?api_key=[api key]slotidlist=845480&format=json&transpagelist=845480:5&pagecomponent=x,@,u,f,y,m

JSON  Results:

"measurement" : [ { "id" : "1105572", "alias" : “AutoTrader Home Page(TxP)[IE] - Total Time (seconds)", "bucket_data" : [ { "name" : "2012-MAY-06 11:18 AM", "id" : 1, "perf_data" : { "value" : "3.393", "unit" : "seconds" }, "avail_data" : { "value" : "100", "unit" : "percent" }, "data_count" : { "value" : "40", "unit" : "#" }.  .  .  (more)

Page 26: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Data Processing Tech Stack•Python 2.7

• HTTP handling

• JSON parsing

• Storage & Transformation

• ELK (ElasticSearch, Logstash, Kibana)

• Graphite

• MySQL

• d3

• Automated email

• Threshold validation

• Minimum and Maximum range

Page 27: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Email Based Alerting

Page 28: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Overcoming Challenges•Data Storage

• Splunk vs ELK

•Valid Metrics

• Median vs Mode

• Browser Variations

• Application Error vs Measurement Error

•Notification Challenges

• Accountable vs Responsible

Page 29: Velocity Conference - What do cats and APIs have in common? They are both awesome!

And now, a word from our sponsor.

Page 30: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Keynote APIIntegrating Keynote data into other

dashboards and applications

Page 31: Velocity Conference - What do cats and APIs have in common? They are both awesome!

About the Keynote API§ RESTful Web service§ Direct data access

- Raw & aggregate data download- Direct dashboard download- Object level performance (July 2014)

§ Alarm polling access (Beta)

- Access the status of any Keynote alarm- Evaluate/generate alarm on-demand- Execute instant measurement- Manage and edit all alarms

Keynote lobby, San Mateo, Calif.

Page 32: Velocity Conference - What do cats and APIs have in common? They are both awesome!

IT Management Integration§ Keynote API allows integration with multiple platforms

Page 33: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Integration Scenarios§ Integrating Keynote data into a Dashboard and using a correlation engine

to better manage alarms§ Directly importing alarm information into a ticketing system allowing for

better management of incidents§ The flexibility of the Keynote API allows integration to many 3rd party

platforms§ Keynote has sample custom integrations available at https://github.com/

KeynoteSystems/Keynote-Apps

Page 34: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Enhanced Reporting§ Integration with Google Docs

- Allow data to be directly imported to a spreadsheet for easier custom reports

§ Integration with Microsoft Excel- Direct calls within Excel can download data using Get External Data from Web

Page 35: Velocity Conference - What do cats and APIs have in common? They are both awesome!

Questions?