Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente
-
Upload
bbva-innovation-center -
Category
Technology
-
view
104 -
download
2
description
Transcript of Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente
![Page 1: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/1.jpg)
Esteban MoroAlejandro Llorente
Analytics & Models
![Page 2: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/2.jpg)
INNOVA CHALLENGE Taller 8 Octubre
① Introduction to cartographic data
② Getting Points of Interest
③ Extracting data from Innova Challenge API
④ Merging activity and cartography
⑤ Building a recommender system
⑥ From analytics to the app: RShiny
Index
Workshop30thOctober
![Page 3: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/3.jpg)
Introduction to cartographic data in R
![Page 4: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/4.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Loading and filtering Shapefiles
Workshop30thOctober
![Page 5: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/5.jpg)
INNOVA CHALLENGE Taller 8 Octubre
plot(map) plot(mapMadrid)
Loading and filtering Shapefiles
Workshop30thOctober
![Page 6: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/6.jpg)
Getting points of interest
![Page 7: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/7.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Parameters
Workshop30thOctober
![Page 8: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/8.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Obtaining places information
Workshop30thOctober
![Page 9: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/9.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Obtaining POI around Puerta del Sol and color them by type
Workshop30thOctober
![Page 10: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/10.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Using Google Maps as background
Workshop30thOctober
![Page 11: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/11.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Workshop30thOctober
![Page 12: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/12.jpg)
Extracting data fromInnova Challenge API
![Page 13: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/13.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Connecting to the API
Parameters
Workshop30thOctober
![Page 14: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/14.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Extracting data
Connecting to the API
Workshop30thOctober
![Page 15: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/15.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Building the adjacency list
Connecting to the API
Workshop30thOctober
![Page 16: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/16.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Building and plotting the graph
Connecting to the API
Workshop30thOctober
![Page 17: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/17.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Connecting to the API
Workshop30thOctober
![Page 18: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/18.jpg)
Merging activity andcartography
![Page 19: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/19.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Reading files
Workshop30thOctober
![Page 20: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/20.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Merging & plotting data and maps
Data + Cartography
Workshop30thOctober
![Page 21: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/21.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Workshop30thOctober
![Page 22: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/22.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Building our own polygons: a regular grid
Data + Cartography
Workshop30thOctober
![Page 23: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/23.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Workshop30thOctober
![Page 24: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/24.jpg)
Building a recommender system
![Page 25: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/25.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
?
????
???
Workshop30thOctober
![Page 26: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/26.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Getting data from the API
Recommending by profile
Workshop30thOctober
![Page 27: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/27.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Reading and preprocessing data
Recommending by profile
Workshop30thOctober
![Page 28: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/28.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Parameters
Result of preprocessing
Recommending by profile
Workshop30thOctober
![Page 29: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/29.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
Recommendation map
Workshop30thOctober
![Page 30: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/30.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
Workshop30thOctober
![Page 31: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/31.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Recommending by origin postal code
? ???
Workshop30thOctober
![Page 32: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/32.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Getting data from the API
Recommending by origin postal code
Workshop30thOctober
![Page 33: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/33.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Analogous data preprocessing and visualizing results
Recommending by origin postal code
Workshop30thOctober
![Page 34: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/34.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Combining classifiers
+
Geographic and demographic based recommender system
Workshop30thOctober
![Page 35: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/35.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Combining classifiers
Getting and merging recommendations
Workshop30thOctober
![Page 36: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/36.jpg)
INNOVA CHALLENGE Taller 8 OctubreWorkshop
30thOctober
Combining classifiers
![Page 37: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/37.jpg)
From analytics to the app:RShiny
![Page 38: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/38.jpg)
INNOVA CHALLENGE Taller 8 Octubre
What’s RShiny
1 Web development framework with R.
2 Declarative user interface definition.
3 Server processing as servlets.
4 Agile prototyping.
Workshop30thOctober
![Page 39: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/39.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Installing Shiny
Workshop30thOctober
![Page 40: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/40.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Shiny project structure
ui.R: definition of user interface.• Layout• Plots• Control panels and filters• Tabs
server.R: definition of functions that generate the output to visualize in ui.R
Workshop30thOctober
![Page 41: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/41.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
![Page 42: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/42.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
![Page 43: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/43.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
![Page 44: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/44.jpg)
INNOVA CHALLENGE Taller 8 Octubre
User interface definition
Requirements
1. Title of the application
2. Tabs to handle visualizations
3. Conditional panels
4. Filters: radio buttons, sliders and selectors
Workshop30thOctober
![Page 45: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/45.jpg)
INNOVA CHALLENGE Taller 8 Octubre
ui.R
Layout, title and beginning of the control panel
Workshop30thOctober
![Page 46: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/46.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Control panel definition
ui.R
Workshop30thOctober
![Page 47: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/47.jpg)
INNOVA CHALLENGE Taller 8 Octubre
Main panel definition
ui.R
Workshop30thOctober
Control panel definition
![Page 48: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/48.jpg)
INNOVA CHALLENGE Taller 8 Octubre
server.R
Importing modules and first line
Workshop30thOctober
![Page 49: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/49.jpg)
INNOVA CHALLENGE Taller 8 Octubre
server.R
Output definitions
Workshop30thOctober
![Page 50: Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro Llorente](https://reader035.fdocuments.in/reader035/viewer/2022070304/54c951014a795912628b45a0/html5/thumbnails/50.jpg)
INNOVA CHALLENGE Taller 8 Octubre
And it works!
Recommender system
@estebanmoro [email protected]@llorentealex [email protected]
Workshop30thOctober