Saving Energy with Apache Spark and Toon with Stephen Galsworthy
-
Upload
spark-summit -
Category
Data & Analytics
-
view
178 -
download
3
Transcript of Saving Energy with Apache Spark and Toon with Stephen Galsworthy
![Page 1: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/1.jpg)
Stephen Galsworthy, Toon
Saving energy with Apache Spark and Toon
#EUds10 #ToonTalks
![Page 2: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/2.jpg)
31 October 2017
![Page 3: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/3.jpg)
![Page 4: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/4.jpg)
![Page 5: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/5.jpg)
Data management
Solar solution
Network
Mobility
Control by demand
Heat pump
Services
Storage
The beating heart of your smart life
�Smart Platforms & Energy Services
![Page 6: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/6.jpg)
#EUds10 #ToonTalks
Boiler adapter
Z-Wave
Meter adaptor
Gas sensor
Electricity sensor
Philips Hue
Z-Wave
Toon data sources
Central heating system
Solar panels
![Page 7: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/7.jpg)
#EUds10 #ToonTalks
Scale of Toon data
100 MB data per user
collected per month
350,000 thermostats installed
300 types of sensor and
user interaction
data
![Page 8: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/8.jpg)
#EUds10 #ToonTalks
Data Privacy
Data from all Toons is collected and stored
anonymously. Data is tagged with an anonymous ID,
generated locally on Toon.
The end user maintains control over this key and we
only use data in a non-anonymous way when a
customer explicitly opts-in.
![Page 9: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/9.jpg)
#EUds10 #ToonTalks
Toon Innovators
Innovators agree to share their data for research
and product development.
In return they they are first in line to try out our
new services!
![Page 10: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/10.jpg)
#EUds10 #ToonTalks
Data Collection setup
data collector
datastorage
Processed data
Data science platform
![Page 11: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/11.jpg)
#EUds10 #ToonTalks
Apache Airflow
Data Science platform
For managing Spark clusters and notebooks
For scheduling complex workflows
For production grade algorithms and R&D
For machine learning on distributed data
![Page 12: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/12.jpg)
#EUds10 #ToonTalks
Concept testing(3 employees)
Initial tests (10-50 users)
Development(600 users)
Commercial launch
(300,000+ users)
Manual
Our journey
![Page 13: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/13.jpg)
#EUds10 #ToonTalks
Data driven services
![Page 14: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/14.jpg)
#EUds10 #ToonTalks
Energy Waste Checker
We don’t always notice how much energy we’re
wasting.
Toon can now expose the energy guzzlers in
your home.
![Page 15: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/15.jpg)
#EUds10 #ToonTalks
Toon detects inefficient appliances and behaviours
![Page 16: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/16.jpg)
#EUds10 #ToonTalks
Electricity data Appliance signals
An underlying concept: Load disaggregation
![Page 17: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/17.jpg)
#EUds10 #ToonTalks
Run on 10s electricity meter data
1
Disaggregation algorithms
Dryer DishwasherWashing machine x2
Power(Wh)
![Page 18: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/18.jpg)
#EUds10 #ToonTalks
Determine appliance ‘fingerprint’
![Page 19: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/19.jpg)
#EUds10 #ToonTalks
Efficiency classification
![Page 20: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/20.jpg)
#EUds10 #ToonTalks
Personalised advice for the end user“It looks like your
washing machine uses
more energy than an
efficient one”
![Page 21: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/21.jpg)
#EUds10 #ToonTalks
Another example: Heating and Insulation advice1. Analyse how much gas is used forheating the home
2. Analyse the cooling down rate of the home overnight from temperaturedata
3. Benchmark with comparablehomes
4. Personalised insulation advice for the customer
InsulationIt looks like your home loses energy more
quickly than efficient homes
![Page 22: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/22.jpg)
#EUds10 #ToonTalks
Scale of Toon data
35,000,000 washing machine cycles detected per year
100,000 washing machine cycles detected per day
![Page 23: Saving Energy with Apache Spark and Toon with Stephen Galsworthy](https://reader031.fdocuments.in/reader031/viewer/2022030318/5a64760b7f8b9afc4d8b45cf/html5/thumbnails/23.jpg)
#EUds10 #ToonTalks
What else is on its way?
Boiler MonitoringToon will keep an eye on your boiler 24 hours per day.
It’ll tell you if it’s still working correctly and when the next maintenance is due.
Monthly Energy InsightsA personalised overview of energy usage for all Toon users.