Contents*Overview of HBASEColumn Oriented DatabaseHBASE ArchitectureHBASE FeaturesHBASE COMPONENTS

What is Apache HBase?Apache HBase is an open source, distributed, column oriented, scalable, consistent, low latency, random access non-relational database built on Apache Hadoop*Overview of HBASE

Production Apache HBase ApplicationsInboxStorageWebSearchAnalyticsMonitoring

More Case Studies at http://www.hbasecon.com/agenda/

*Overview of HBASE

Why HBase ?HBase is a Bigtable clone.It is open sourceIt has a good community and promise for the futureIt is developed on top of and has good integration for the Hadoop platform.Linear Scalability.Automatic failoverOverview of HBASE*

Why HBase ?Consistent reads and writes.Sharding of tablesFailover supportClasses for backing hadoop mapreduce jobsJava API for client accessThrift gateway and a REST-ful WebShell support

Overview of HBASE*

Contents*Overview of HBASEColumn Oriented DatabaseHBASE ArchitectureHBASE FeaturesHBASE COMPONENTS

Column oriented databases Acolumn-oriented DBMSis adatabase management system(DBMS) that stores data tables as sections of columns of data rather than as rows of data.The goal of a columnar database is to efficiently write and read data to and from hard disk storage in order to speed up the time it takes to return a queryA column-oriented architecture looks the same on the surface, but stores data differently than legacy/row-based database.

Column Oriented Databases *

*Column vs. row orientation Column Oriented Databases *

Advantages of Column DatabaseOne of the main benefits of a columnar database is that data can be highlycompressed. The compression permits columnar operations like MIN, MAX, SUM, COUNT and AVG to be performed very rapidly.Another benefit is that because a column-based DBMSs is self-indexing, it uses less disk space than a relational database management system (RDBMS) containing the same data.Column architecture doesnt read unnecessary columns.Avoids decompression costs and perform operations faster.Use compression schemes allow us to lower our disk space requirements.

Column Oriented Databases *

Contents*Overview of HBASEColumn Oriented DatabaseHBASE ArchitectureHBASE FeaturesHBASE COMPONENTS

HBASE Architecture

Contents*Overview of HBASEColumn Oriented DatabaseHBASE ArchitectureHBASE FeaturesHBASE COMPONENTS

HBase Features*Auto sharding

*DistributionHBase Features

Unit of scalability in Hbase is region.Sorted, contigious range of rows.Spread randomly across region servers.Moved around for load balancing and failoverSplit automatically or manually to scale with growing dataCapacity is solely a factor of cluster nodes vs. regions per node.Auto sharding & DistributionHBase Features*

*Storage SeparationHBase Features

Column Families allow for separation of dataUsed By Columnar databases for fast analytical queries, but on column level onlyAllow different or no compression depending on the content type.Segragate information based on access patternData is stored in one or more storage file, called HFilesStorage Separation

HBase Features*

Contents*Overview of HBASEColumn Oriented DatabaseHBase ArchitectureHBase FeaturesHBase COMPONENTS

HMasterResponsible for monitoring region serversRedirect client to correct region serversMaster controls critical functions such as RegionServer failover and completing region splits. So while the cluster can still run for a time without the Master, the Master should be restarted as soon as possible. Is the interface for all metadata changes, it runs on the server which hosts namenode.

HBase Components*

RegionserversResponsible for serving and managing regions, its like a data node for Hbase.These can be thought of Datanode for Hadoop cluster. It serve the client request for the data.It handle the actual data storage and request.Send HeartBeat to MasterIt consists of Regions or in better words tables.RegionServers are usually configured to run on servers of HDFS DataNode. Running RegionServer on the DataNode server has the advantage of data locality tooHBase Components*

Zookeeper

Zookeeper is an open source software providing a highly reliable, distributed coordination service

Entry point for an HBase system

It includes tracking of region servers, where the root region is hosted

HBase Components*

APIInterface to HBaseUsing these we can we can access HBase and perform read/write and other operation on Hbase.REST, Thrift, and AvroThrift API framework, for scalable cross-language services development, combines a software stack with a code generation engine to build services that work efficiently and seamlessly between C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, JavaScript, Node.js, Smalltalk, OCaml and Delphi and other languages.HBase Components*

Thank You*

*Hbase is a project that solves this problem. In a sentence, Hbase is an open source, distributed, sorted map modeled after Googles BigTable.

Open-source: Apache HBase is an open source project with an Apache 2.0 license.

Distributed: HBase is designed to use multiple machines to store and serve data.

Sorted Map: HBase stores data as a map, and guarantees that adjacent keys will be stored next to each other on disk.

HBase is modeled after BigTable, a system that is used for hundreds of applications at Google.Copyright 2010 Cloudera - Do not distribute****Hfile : File System for hbase

Memstore: In memory store for hbase

Write Ahead Log (WAL) is that HLog edits will be written immediately*