1

Hue HBase BrowserKevin Wang, Platform Intern, Cloudera@Kevinverse

2

Cloudera Hue

• Web Interface for making Hadoop easier to use • Aggregation of apps for each Hadoop component

(e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase...)

3

• Industry Usage

• Widespread HBase Usage• Meetups, HBaseCon

• Community Need

Product Mission - HBase Usage Size

Organic ExampleCommunity Expresses Need for HBase UI

4

Product Mission - Problem & Competition

Lack of Accessibility• Hard for beginnersLack of Familiarity• Unfamiliarity with Key-ValueUsability Challenges• Lack of any web UI• Lack of imaginative interface• Low-level• CDH - Command Line

HBase Manager’s Tabular View

Competing Application

5

• Open HBase usage to non-technical people• Drive HBase adoption in startups/organizations• Solve a pain point with a good product

• Knockout/JS/jQuery• Django • Thrift Hbase

Project Purpose – Addressing this Need

6

Demo

7

Technical Challenges - Design

• Design Innovation• Problem: HBase is a key-value store, not a traditional RDB • Solution: Collapse Sparse Data across HBase Tables

Tabular View HBase Browser Smartview

8

• Scale • Problem: Performance on Millions of Columns• Solution: Lazy loading & Truncation using Thrift FilterString

• Stream raw data cached MEM DOM elements dynamically generated• b64encode binary data to preserve during ASCII dump• Detect schema on preview reading byte headers• Capped, Lazy Loaded & Bound to DOM via MVVM Pattern

Technical Highlight - Scale

100MB Currently Streamed Thrift 5TB HBase Cluster

9

Technical Highlight - Flexible Searchbar

• Flexible Searchbar• Problem: Need high-level tool for complex data fetching &

analysis• Solution: Simple custom query language

• Supports HBase filter language• Supports selection & Copy + Paste, Gracefully degrades in IE• Autocomplete Help Menu• Regenerate Rendered Position – Firefox Bug

Row Key

Scan Length

Prefix Scan

Column/Family Filters

Thrift Filterstring

Searchbar Syntax Breakdown

10

Current• Ramp up for CDH 4.4 release• Tutorial Video & Blog Post• Tons of JIRAs

Roadmap, Timeline & Next Steps

Initial Release in Hue 2.5 Ship in CDH 4.4

11

Any Questions?Kevin, Platform Intern, ClouderaFollow me: @Kevinversewww.gethue.com

Hue HBase Browser250+ commits20000+ lines of code∞ cups of coffee

Pageviews

12

Icons (more to come)

13

Arrows

Working Elements