Big Data and Hadoop Ecosystem
-
Upload
canburak-tuemer -
Category
Data & Analytics
-
view
100 -
download
2
Transcript of Big Data and Hadoop Ecosystem
![Page 1: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/1.jpg)
Big Data & Hadoop
EcosystemCanburak Tümer
![Page 2: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/2.jpg)
• Ege University, BSc. Computer Engineering, ’07-’12• Libera Universitá di Bolzano, BSc. Computer Science,
’09-’10• İstanbul Technical University, MSc. Computer
Engineering, ’13-’16 (expected)• Turkcell Technology, ETL & DWH Developer, ’11-’12• Oracle, Consultant, ’12-’13• MAKEIT Software & Consulting, BI&DW Specialist ’14-...• www.canburaktumer.com/blog @canburakTblog
https://www.linkedin.com/in/canburaktumer
About MeCanburak Tümer
![Page 3: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/3.jpg)
Agenda• Big Data• NoSQL• Hadoop• HDFS• MapReduce• Management Tools• Data Access Tools• Data Processing and Mining Tools
![Page 4: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/4.jpg)
![Page 5: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/5.jpg)
![Page 6: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/6.jpg)
VOLUME VALUE
VARIETYVERIFICATION VELOCITY
![Page 7: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/7.jpg)
![Page 8: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/8.jpg)
![Page 9: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/9.jpg)
- Open source big data platform- Started by developers from Yahoo!- Two main distributors now : Cloudera, Hortonworks- Both storage and processing
- HDFS for storage- MapReduce for processing- Spark engine is replacing MapReduce day by day
![Page 10: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/10.jpg)
![Page 11: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/11.jpg)
HDFS
![Page 12: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/12.jpg)
Map Reduce
![Page 13: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/13.jpg)
Managing Tools for Hadoop
![Page 14: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/14.jpg)
Data Access Tools for Hadoop
![Page 15: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/15.jpg)
Data Processing and Mining Tools
![Page 16: Big Data and Hadoop Ecosystem](https://reader035.fdocuments.in/reader035/viewer/2022081520/58ee4b5a1a28ab6e198b45cb/html5/thumbnails/16.jpg)