Hadoop story

10
Hadoop Concepts

description

 

Transcript of Hadoop story

Page 1: Hadoop story

Hadoop Concepts

Page 2: Hadoop story
Page 3: Hadoop story

Problem #1

Page 4: Hadoop story

Solution #1 Parallel Processing

Page 5: Hadoop story

Problem #2

Page 6: Hadoop story

Solution #2 Distributed System

Page 7: Hadoop story

Extension to Solution #1 Commodity Hardware

(Baby Elephants)

Problem #3

Page 8: Hadoop story

Solution #3 Master Slave Architecture

Page 9: Hadoop story

Hadoop Ecosystem

Page 10: Hadoop story

HDFSHadoop Distributed File System

MapReduceParallel Processing Framework

Sqoop

Flume

HBase or any other NoSQL

HiveSQL Engine

PigScripting

Oozie

Zookeeper

Kerberos

Ganglia Ambari/ Cloudera ManagerDeployment and Management Tools

Tableau/ Datameerany BI/ Visualization tools