Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache...

17
Hadoop Personal Project: Apache Ambari CHONNAM NATIONAL UNIVERSITY MUHAMMAD FIQRI MUTHOHAR

Transcript of Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache...

Page 1: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Hadoop Personal Project: Apache Ambari

C H O N N A M N A T I O N A L U N I V E R S I T Y M U H A M M A D F I Q R I M U T H O H A R

Page 2: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Apache AmbariA f r a m e w o r k f o r p r o v i s i o n i n g , m a n a g i n g a n d m o n i t o r i n g A p a c h e

H a d o o p c l u s t e r s

2

Page 3: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

What it does?Ambari enables system administrators to provision, manage

and monitor a Hadoop cluster, and also to integrate Hadoop with the existing enterprise infrastructure.

3

Page 4: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Apache Ambari

IntegrateMonitorManageProvision

4

Page 5: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

ProvisionApache Ambari

No matter the size of your Hadoop cluster, the deployment and maintenance of hosts is simplified using Ambari. Ambari includes an intuitive Web interface that allows you to easily provision, configure and test all the Hadoop services and core components. Ambari also provides the powerful Ambari Blueprints API for automating cluster installations without user intervention.

5

Page 6: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Apache Ambari

Manage

Ambari provides tools to simplify cluster management. The Web interface allows you to control the lifecycle of Hadoop services and components, modify configurations and manage the ongoing growth of your cluster.

6

Page 7: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Apache Ambari

Monitor

Gain instant insight into the health of your cluster. Ambari pre-configures alerts for watching Hadoop services and visualizes cluster operational data in a simple Web interface.

7

Page 8: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Apache Ambari

Integrate

Ambari provides a RESTful API that enables integration with existing tools, such as Microsoft System Center and Teradata Viewpoint, to merge Hadoop with your established operational processes.

8

Page 9: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Hadoop cluster provisioning and ongoing management can be a

complicated task, especially when there are hundreds or thousands

of hosts involved. Ambari provides a single control point for

viewing, updating and managing Hadoop service life cycles, with

some important features.

9

Page 10: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

A m b a r i I m p o r t a n t F e a t u reFEATURE BENEFIT

WIZARD-DRIVEN INTERFACE FACILITATES INSTALLATION OF HADOOP ACROSS ANY NUMBER OF HOSTS

API-DRIVEN INSTALLATIONS AMBARI BLUEPRINTS FOR AUTOMATED PROVISIONING

GRANULAR CONTROL PRECISE MANAGEMENT OF HADOOP SERVICES AND COMPONENT LIFECYCLES

CONFIGURATION HISTORIES ONGOING MANAGEMENT OF HADOOP SERVICE CONFIGURATIONS

EXTENSIBLE FRAMEWORK BRINGS CUSTOM SERVICES UNDER MANAGEMENT VIA AMBARI STACKS

USABILITY IMPROVEMENTS INNOVATIVE USER EXPERIENCES VIA AMBARI VIEWS

RESTFUL APIS ENABLES INTEGRATION WITH ENTERPRISE SYSTEMS

10

Page 11: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Supported Hadoop Project

11

Page 12: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Supported OS

5 & 6

5 & 6

5 & 612

11

12

Page 13: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Ambari API v1• Authentication

• Monitoring

• Management

13

Page 14: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Ambari API v1

Authentication

• Every API call to Ambari API need the user authenticated.

• The authentication is using HTTP Basic Authentication method.

14

Page 15: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Ambari API v1

Monitoring

• This API provides access to monitoring and metrics information of an Apache Hadoop cluster.

15

Page 16: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

Ambari API v1

Management• This API provides for the management of the

resources of an Apache Hadoop cluster.

• This includes resource:

• creation,

• deletion,

• update

16

Page 17: Hadoop Personal Project: Apache Ambaridnslab.jnu.ac.kr/classes/old_courses/2014f_tds... · Apache Ambari A framework for provisioning, managing and monitoring Apache Hadoop clusters

감사합니다 Thank you