Introduction to Big...
Transcript of Introduction to Big...
![Page 1: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/1.jpg)
Introduction to Big Data
![Page 2: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/2.jpg)
Lecture #1
![Page 3: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/3.jpg)
Cloudera VM Tour
![Page 4: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/4.jpg)
Launch the Cloudera quick start VM
![Page 5: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/5.jpg)
Inside the VM
![Page 6: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/6.jpg)
Welcome page inside a browser
![Page 7: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/7.jpg)
Welcome page inside a browser
![Page 8: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/8.jpg)
Additional Services
![Page 9: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/9.jpg)
Click on – Hadoop Or open in a New Tab
![Page 10: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/10.jpg)
Overview of the Hadoop installation within the VM
![Page 11: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/11.jpg)
Click on Datanodes
![Page 12: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/12.jpg)
![Page 13: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/13.jpg)
Additional Services Click on HBase
![Page 14: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/14.jpg)
![Page 15: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/15.jpg)
Additional Services Click on Impala
![Page 16: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/16.jpg)
![Page 17: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/17.jpg)
Additional Services Click on Oozie
![Page 18: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/18.jpg)
![Page 19: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/19.jpg)
Getting Started
![Page 20: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/20.jpg)
![Page 21: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/21.jpg)
Lets Start the Tutorial!
![Page 22: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/22.jpg)
![Page 23: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/23.jpg)
![Page 24: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/24.jpg)
![Page 25: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/25.jpg)
More about Scoop
![Page 26: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/26.jpg)
Scroll down for more
![Page 27: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/27.jpg)
Open Terminal
![Page 28: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/28.jpg)
![Page 29: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/29.jpg)
Copy Sqoop Command to launch the Sqoop job
![Page 30: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/30.jpg)
Paste into the Terminal
Click Edit -> Paste Or Shift-Ctrl-V
![Page 31: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/31.jpg)
Confirm that data files exist in HDFS
![Page 32: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/32.jpg)
![Page 33: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/33.jpg)
Next step
![Page 34: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/34.jpg)
![Page 35: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/35.jpg)
![Page 36: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/36.jpg)
Click on Impala
![Page 37: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/37.jpg)
Copy and paste to create tables
![Page 38: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/38.jpg)
First delete the queries currently in the editor
Copy the show tables command into the window
![Page 39: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/39.jpg)
Revenue per product
![Page 40: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/40.jpg)
Let’s move on to the next section!!
![Page 41: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/41.jpg)
Let’s move on to the next scenario!!
![Page 42: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/42.jpg)
![Page 43: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/43.jpg)
Copy data into HDFS
![Page 44: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/44.jpg)
![Page 45: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/45.jpg)
![Page 46: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/46.jpg)
![Page 47: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/47.jpg)
![Page 48: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/48.jpg)
![Page 49: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/49.jpg)
![Page 50: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/50.jpg)
![Page 51: Introduction to Big Datasupport.pdnsoft.com/docs/docs-pics/Big-Data-Meeting/PDN-Tech-BigData...included with CDR (including Cloudera Impala, Cloudera Search. and Hue) udera Ask Bigger](https://reader030.fdocuments.in/reader030/viewer/2022040113/5e09e5709751db004560ab9b/html5/thumbnails/51.jpg)
Assignment