MS&E 448: Big Financial Data for Algorithmic Trading High ...
Teaching Big Data Analtyics to Business School MS Students
Transcript of Teaching Big Data Analtyics to Business School MS Students
![Page 1: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/1.jpg)
Teaching Big Data Analtyics to Business School MS Students
Ramesh Shankar
Uconn School of Business
IT Teaching Workshop 2019, Wharton
1
![Page 2: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/2.jpg)
MSBAPM Curriculum
2
![Page 3: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/3.jpg)
Hadoop books Source: David Tilson, IT Teaching Workshop 2018
3
![Page 4: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/4.jpg)
Hadoop resources
4
![Page 5: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/5.jpg)
Cloudera VM Enabling virtualization
5
![Page 6: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/6.jpg)
AWS EMR (Elastic MapReduce) Cluster
Source: David Tilson, IT Teaching Workshop 2018
6
![Page 7: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/7.jpg)
7
![Page 8: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/8.jpg)
AWS EC2:
8
![Page 9: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/9.jpg)
Topics covered• Linux
• Hadoop Distributed File System
• Apache Sqoop• Extract data from RDBMS, into HDFS
• Apache Pig• Extract, Transform, Load (ETL) on data obtained via Sqoop• Schema on read, no permanent schema, flat files
• Apache Hive• Hadoop Data Warehousing Tool• Schema on read, permanent schema required, flat files
• MapReduce – conceptual overview
• Spark• In-memory Analytics
• Recommender Systems • Illustrates Spark
9
![Page 10: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/10.jpg)
HDFS
10
![Page 11: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/11.jpg)
Sqoop
11
![Page 12: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/12.jpg)
Pig
12
![Page 13: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/13.jpg)
Hive
13
![Page 14: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/14.jpg)
14
![Page 15: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/15.jpg)
15
![Page 16: Teaching Big Data Analtyics to Business School MS Students](https://reader031.fdocuments.in/reader031/viewer/2022012412/616b8ef2c98b7f14d109e102/html5/thumbnails/16.jpg)
Spark – recommender system (ALS)
16