Telemetry OnboardingRoberto Vitillo - Firefox Data Engineering Team

Ask a question

Get the data

Analyse the data

Report

TELEMETRY 101

(Base Telemetry)

(Extended Telemetry)

https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/index.html

about:telemetry

Real-time

https://pipeline-cep.prod.mozaws.net/

Need help?

trink@mozilla.com

S3

Ask a question

Get the data

Analyse the data

Report

Step 1: Ask a question

Step 2: Get the data

Data exists Data exists

Step 2: Get the data

Data exists Data exists

dashboard

KPIs

https://metrics.services.mozilla.com/

https://telemetry.mozilla.org/new-pipeline/dist.html

Performance Need help?

fbertsch@mozilla.com

Step 2: Get the data

Data exists Data exists

dashboard s.t.m.o

https://sql.telemetry.mozilla.org/

Need help?

bimsland@mozilla.com

Datasets

https://github.com/mozilla/telemetry-batch-view/blob/master/docs/choosing_a_dataset.md

Client ID A B

“X” FALSE 42

“Y” TRUE null

“X” FALSE 40

12/12/2016

21/12/2016

01/12/2016

main_summary

https://github.com/mozilla/telemetry-batch-view/blob/master/docs/MainSummary.md

Need help?

mreid@mozilla.com

longitudinalClient ID A B

“X” [FALSE, FALSE, TRUE] [42, 40, 41]

“Y” [TRUE] [null]

https://github.com/mozilla/telemetry-batch-view/blob/master/docs/Longitudinal.md

Need help?

rvitillo@mozilla.com

cross_sectional

Client ID A B

“X” FALSE 41

“Y” TRUE null

mode mean

Need help?

rharter@mozilla.com

client_countClients A

{“3”} FALSE

{“1”, “2} TRUE

Need help?

rvitillo@mozilla.com

crash_aggregates#crashes A B

42 GPU X OSX

12 GPU Y WIN

Need help?

mdoglio@mozilla.com

https://github.com/mozilla/telemetry-batch-view/blob/master/docs/CrashAggregateView.md

Step 2: Get the data

Data exists Data exists

dashboard s.t.m.o a.t.m.o

S3

https://atmo-prod.herokuapp.com/

Need help?

jannis@mozilla.com

https://wiki.mozilla.org/Telemetry/Custom_analysis_with_spark

Need help?

mdoglio@mozilla.com

Step 2: Get the data

Data exists Data exists

dashboard s.t.m.o a.t.m.o add a probe

https://docs.google.com/document/d/11wM2RJkHAqYF-4xgL5tHwA621IUQEaf4vecuC-hqnzk/edit#heading=h.tkrw9ahjfrcp

New ping?

gfritzsche@mozilla.com

Need help?

https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/collection/scalars.html

https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Adding_a_new_Telemetry_probe

Need help?

aplacitelli@mozilla.com

Need help?

chutten@mozilla.com

http://alerts.telemetry.mozilla.org

https://wiki.mozilla.org/Firefox/Data_Collection

https://www.mozilla.org/en-US/privacy/

Owner: Benjamin Smedberg Peers: Chenxia Liu, François Marier, Ally Naagktgeboren, Rebecca Weiss

Ask a question

Get the data

Analyse the data

Report

Ask a question

Get the data

Analyse the data

Report

#datapipeline#telemetry

https://wiki.mozilla.org/Telemetryhttps://wiki.mozilla.org/CloudServices/DataPipeline