2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...

Post on 18-Jan-2018

215 views 0 download

description

Analyzes the Hadoop architecture and MapReduce Working principle How to write Mapper and Reducer classes, and how to use the object 3

Transcript of 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...

2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang

The Application of MapReduce in the Cloud Computing

Speaker : Kun-Hsiang, Chang

1

• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task

2

Outline

Analyzes the Hadoop architecture and MapReduce Working principle

How to write Mapper and Reducer classes, and how to use the object

3

Abstract

NameNode

DataNode

Client

4

Hadoop-HDFS

5

Hadoop-MapReduce

6

MapReduce

MapReduce programs can be run in three modes:

Standalone Mode

Pseudo-distributed Mode

Fully-distributed Mode

7

MapReduce

Inputs division and dispatch

task configuration

task executive

Create customized Mapper and Reducer

8

MapReduce Programmed To Perform Task

Speaker : Kun-Hsiang, Chang

End…

9