Hadoop story

Post on 15-Jan-2015

156 views 0 download

Tags:

description

 

Transcript of Hadoop story

Hadoop Concepts

Problem #1

Solution #1 Parallel Processing

Problem #2

Solution #2 Distributed System

Extension to Solution #1 Commodity Hardware

(Baby Elephants)

Problem #3

Solution #3 Master Slave Architecture

Hadoop Ecosystem

HDFSHadoop Distributed File System

MapReduceParallel Processing Framework

Sqoop

Flume

HBase or any other NoSQL

HiveSQL Engine

PigScripting

Oozie

Zookeeper

Kerberos

Ganglia Ambari/ Cloudera ManagerDeployment and Management Tools

Tableau/ Datameerany BI/ Visualization tools