Airflow Summit

17
Airflow Summit Advanced Apache Superset for Data Engineers

Transcript of Airflow Summit

Page 1: Airflow Summit

Airflow SummitAdvanced Apache Superset for Data Engineers

Page 2: Airflow Summit

2

● A passion for building data tools!

● Started Apache Airflow at Airbnb in 2014

● Started Apache Superset at Airbnb in 2015

● Started Preset - The Apache Superset company in 2019

Page 3: Airflow Summit

3

Agenda!

● Superset Overview / Demo

● SQL Lab for data engineers

● Scheduling Queries

● Building a visualization plugin

● Building charts and dashboards dynamically

Page 4: Airflow Summit

4

Superset Overview / Demo!

Page 5: Airflow Summit

5

Enhancing Jinja Context

Page 6: Airflow Summit

6

Scheduling Queriesexperimental feature!

Page 7: Airflow Summit

7

Page 8: Airflow Summit

8

superset_config.pyhttp://superset.apache.org/installation.html#sql-lab

Page 9: Airflow Summit
Page 10: Airflow Summit

10

/savedqueryviewapi/api/read

Page 11: Airflow Summit

11

Visualization Plugins

Page 12: Airflow Summit

12

https://preset.io/blog/

Page 13: Airflow Summit

13

Superset Plugins as a data product development platform

● Build data products without writing much backend code

● Tap into Superset’s Data Access Layer (auth, perm, cache, audit)

● Rich controls at your fingertips

● Focus on the visualization / frontend

● Bring into a dashboard (surround with context / add interactions)

Page 14: Airflow Summit

14

Dynamic Chart/Dashboard Creation

Page 15: Airflow Summit

15

Swagger API @ /swaggerview/v1

Rest API!

Page 16: Airflow Summit

16

/superset/examples/birth_names.py

Using SQLAlchemy (improper)

Page 17: Airflow Summit

17

We’re hiring!