Hue: The Hadoop UI - Hadoop Singapore

25
HUE THE UI FOR APACHE HADOOP Enrico Berti Hadoop.SG Apr 10, 2014

description

Learn about Hue, the UI for Apache Hadoop. Presented by Enrico Berti at the Hadoop Singapore meetup. Find out everything you need about Hue at http://gethue.com

Transcript of Hue: The Hadoop UI - Hadoop Singapore

Page 1: Hue: The Hadoop UI - Hadoop Singapore

HUE THE UI FOR APACHE HADOOPEnrico BertiHadoop.SG Apr 10, 2014

Page 2: Hue: The Hadoop UI - Hadoop Singapore

WHATIS HUE?

WEB INTERFACE FOR MAKING HADOOP EASIER TO USE  Suite  of  apps  for  each  Hadoop  component,like  Hive,  Pig,  Impala,  Oozie,  Solr,  Sqoop2,  HBase...

Page 3: Hue: The Hadoop UI - Hadoop Singapore

VIEW FROM30K FEET

Hadoop Web Server You and eventhat friend

that uses IE9 ;)

Page 4: Hue: The Hadoop UI - Hadoop Singapore

ECOSYSTEM

PIGJO

B BROWSER

JOB DESIG

NER

OOZIE

HIVE IMPA

LA

METASTO

RE BROWSERSEARCH

HBASE BROWSER

SQOOP

ZOOKEEPERUSER ADMIN

DB QUERY

SPARK

HOME ...

GUI DESIG

N

FILE BROWSER

USER

USER WORKFL

OWS

USER

Page 5: Hue: The Hadoop UI - Hadoop Singapore

YARN JobTracker Oozie

Pig

HDFS

HiveServer2

Hive Metastore

Cloudera Impala

Solr

HBase

Sqoop2

Zookeeper

LDAP SAML

Hue Plugins

APPS

Page 6: Hue: The Hadoop UI - Hadoop Singapore

TARGETOF HUE

GETTING STARTED WITH HADOOP  BEING PRODUCTIVE EXPLORING DIFFERENT ANGLES OF THE PLATFORM !

LET ANY USER FOCUS ON BIG DATA PROCESSINGBEING COMPATIBLE WITH ANY HADOOP VERSION (0.20/1.2.0/2.3.0)

Page 7: Hue: The Hadoop UI - Hadoop Singapore

OPEN SOURCE

~3000 COMMITS  33 CONTRIBUTORS648 STARS212 FORKS !

github.com/cloudera/hue

Page 8: Hue: The Hadoop UI - Hadoop Singapore

THE CORETEAM PLAYERS

team.gethue.com

ABRAHAM ELMAHREK

ROMAIN RIGAUX

ENRICO BERTI

CHANG BEER

Page 9: Hue: The Hadoop UI - Hadoop Singapore

TALKS

Meetups  and  events  in  NYC,  Paris,  LA,  Tokyo,  SF,  Stockholm,  Vienna,  San  Jose,  Singapore… Coming  up  in  London,  West  coast

AROUNDTHE WORLD

RETREATS

Nov  13  Koh  Chang,  Thailand  May  14  Curaçao,  Netherlands  AnTlles

Page 10: Hue: The Hadoop UI - Hadoop Singapore

FAST PACE

LAST 30 DAYS

41  issues  created  and  38  resolved.  Core  team  +  Community

Page 11: Hue: The Hadoop UI - Hadoop Singapore

NEW APPS IN 6 MONTHS

PIGJO

B BROWSER

JOB DESIG

NER

OOZIE

HIVE IMPA

LA

METASTO

RE BROWSERSEARCH

HBASE BROWSER

SQOOP

ZOOKEEPERUSER ADMIN

DB QUERY

SPARK

HOME ...

GUI DESIG

N

FILE BROWSER

USER

USER WORKFL

OWS

USER

Page 12: Hue: The Hadoop UI - Hadoop Singapore

GROWINGCOMMUNITY

hue-­‐user@

0

125

250

375

500

Posts

Jul 12 Aug 12 Sep 12 Oct 12 Nov 12 Dec 12 Jan 13 Feb 13 Mar 13 Apr 13May 13 Jun 13 Jul 13 Aug 13 Sep 13 Oct 13 Nov 13

0

17,5

35

52,5

70

Topics

Page 13: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 1

Desktop-­‐like  in  a  browser,  did  its  job  but  pre\y  slow,  memory  leaks  and  not  very  IE  friendly  but  definitely  advanced  for  its  Tme  (2009-­‐2010).

Page 14: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 2

The  first  flat  structure  port,  with  Twi\er  Bootstrap  all  over  the  place.

Page 15: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 2.5

New  apps,  improved  the  UX  adding  new  nice  funcTonaliTes  like  autocomplete  and  drag  &  drop.

Page 16: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 3 ALPHA

Proposed  design,  didn’t  make  it.

Page 17: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 3

TransiTon  to  the  new  UI,  major  improvements  and  new  apps.

Page 18: Hue: The Hadoop UI - Hadoop Singapore

HISTORY

HUE 3.5+

Where  we  are  now,  new  UI,  several  new  apps,  the  most  user  friendly  features  to  date.

Page 19: Hue: The Hadoop UI - Hadoop Singapore

DEMO TIME

Page 20: Hue: The Hadoop UI - Hadoop Singapore

ROADMAP

CDH  5  with  Hue  3.5+  h\p://gethue.com/hadoop-­‐tutorial-­‐new-­‐impala-­‐and-­‐hive-­‐editors/  

CDH  5.1  with  Hue  3.6:  CHARTS,  Yarn,  Spark,  SEARCH  create  index,  Load  data,  Dashboard,  UX  ...  your  idea?

Inter-­‐app  integraTon  (e.g.  schedule  daily  Hive  query  in  one  click),  versioning,  export/import.  Oozie  revamp,  dashboard,  reporTng…  Come  talk  to  us  about  your  use  cases  and  what  you  would  like  to  see  next  in  Hue!

Hue  3.5  OSS  release  h\p://gethue.com/hue-­‐3-­‐5-­‐and-­‐its-­‐redesign-­‐are-­‐out/  

DECEMBER 2013 LAST WEEK Q2 2014

AFTER

Page 21: Hue: The Hadoop UI - Hadoop Singapore

MISSEDSOMETHING?

learn.gethue.com

Page 22: Hue: The Hadoop UI - Hadoop Singapore

LINKS

TWITTER

@gethue

USER GROUP

hue-­‐user@

WEBSITE

h\p://gethue.com

LEARN

h\p://learn.gethue.com

Page 23: Hue: The Hadoop UI - Hadoop Singapore

GET HUE

Try  in  advance  the  latest  and  greatest  but  you’ll  have  to  configure  everything  on  your  own.

Get  to  play  with  Hue  and  various  Hadoop  components  in  5  minutes.  It’s  a  self  contained  CDH  environment  ready  to  use.

Newer  version  than  HDP,  close  to  the  original  2.5  minus  apps  like  HBase,  Impala,  Sqoop,  Search.

The  newest  addition,  ships  Hue  3.0  through  the  GreenButton  products.  

Stable  and  highly  tested  releases  perfectly  integrated  with  the  Hadoop  ecosystem,  automagically  configured  by  Cloudera  Manager.

In  HDP  there’s  an  old  forked  version  of  Hue  2.3.

CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM

HORTONWORKS* MAPR* HP CLOUD*

* YOUR MILEAGE MAY VARY.

BIGTOP EMBEDDED/DEMO IN IND. COMPANIES

Page 24: Hue: The Hadoop UI - Hadoop Singapore

WHAT ARE YOUR USE CASES?

WHICH COMPONENTS DO YOU USE?

WHAT WOULD YOU LIKE TO SEE IN HUE?

INTERESTED IN CONTRIBUTING? WANNA SAY HELLO? DO YOU WANT A TAILOR

MADE TEAM RETREAT?

TEAM@ GETHUE.COM

Page 25: Hue: The Hadoop UI - Hadoop Singapore

THANK YOU நன்றி TERIMA KASIH 謝謝www.gethue.com