Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf ·...
Transcript of Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf ·...
![Page 1: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/1.jpg)
Big Data in Transportation
What is it and why does it matter?
Nikola Ivanov, University of Maryland CATT Laboratory
![Page 2: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/2.jpg)
What is Big Data?
2
Extremely large data sets that may be analyzed computationally to reveal patterns, trends, and associations, especially relating to human behavior and interactions. - Google
Big Data is a loosely defined term used to describe data sets so large and complex that they become awkward to work with using standard statistical software. - International Journal of Internet Science
Big Data is defined by the three V’s: Volume Variety Velocity
- Principles of Big Data (Morgan Kaufmann)
Fourth V: Value
- Extracting Value from Chaos (J. Gantz and D. Reinsel)
![Page 3: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/3.jpg)
What is Big Data?
3
Big is a relative term: 1 GB? 1 TB? 1 PB? 1 EB? 1 ZB?
As of March 2013, about 640 TB of data is transferred across the Internet - techspot.com
Fast is a relative term: Once per minute? Once per second? 100 times per second?
per minute = ~900 PB per day
![Page 4: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/4.jpg)
Why did this term become so popular?
4
![Page 5: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/5.jpg)
What is the value of Big Data?
5
Creating insights out data and acting on those
Maybe your goals/actions don’t change because the insight was always there, just not readily available.
Maybe this changes everything because you are discovering new and different things you were not aware of.
OR
Do not offer a hypothesis and let data tell you what is there to be seen
Source: http://fortune.com/2012/09/10/what-data-says-about-us/
![Page 6: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/6.jpg)
How do you process Big Data?
6
Three main components/platforms: • Storage • Discovery and Processing • Visualization
Hadoop
Source: http://www.glennklockwood.com/di/hadoop-overview.php https://www.data-hive.com/academy/primer.php Reddit.com u/JorgeGT
![Page 7: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/7.jpg)
What does all this have to do with transportation?
7
Traffic events: 7,000 records per day (0.001 GB/day) Traffic detectors: 35,000,000 records per day (5 GB/day) Probe vehicle data: 4,200,000,000 records per day (550 GB/day)
Ford Fusion connected vehicle will generate 25 GB of data per hour.
Today, this would account for almost HALF of all Internet traffic.
![Page 8: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/8.jpg)
Big Data at the CATT Lab
8
![Page 9: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/9.jpg)
9
![Page 10: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/10.jpg)
Big Data at the CATT Lab
10
![Page 11: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/11.jpg)
Big Data at the CATT Lab
11
![Page 12: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/12.jpg)
Big Data at the CATT Lab
12
![Page 13: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/13.jpg)
Big Data at the CATT Lab
13
![Page 14: Big Data in Transportationitsmd.org/.../uploads/Nikola-Ivanov-Big-Data-in-Transportation.pdf · What is Big Data? 3 Big is a relative term: 1 GB? 1 TB? 1 PB? 1 ZB? 1 EB? As of March](https://reader031.fdocuments.in/reader031/viewer/2022030510/5aba28107f8b9a441d8b5350/html5/thumbnails/14.jpg)
14
Nikola Ivanov,
Deputy Director, CATT Laboratory
http://cattlab.umd.edu
(301) 405-3626