Engineering Big Data with Hadoop

download Engineering Big Data with Hadoop

Embed Size (px)

description

This presentation explains about Introduction of BIG DATA with HADOOP.

Transcript of Engineering Big Data with Hadoop

  • Disclaimer: Some of the Images and content have been taken from multiple online sources and this presentation is intended only for knowledge sharing but not for any commercial business intention
  • HIGH VOLUME HIGH VELOCITY HIGH VARIETY
  • Source: http://www.emc.com/leadership/digital-universe/iview/index.htm
  • Bing ingests > 7 petabyte a month The Twitter community generates over 1 terabyte of tweets every day Cisco predicts that by 2013 annual internet traffic flowing will reach 667 exabytes
  • Source: http://www.emc.com/collateral/about/news/idc-emc-digital-universe-2011-infographic.pdf
  • Source: http://www.emc.com/collateral/about/news/idc-emc-digital-universe-2011-infographic.pdf
  • Source: http://cloudtimes.org/2013/06/25/hadoop-as-a-service-market-growing/
  • How does an Elephant Sneak up on you?
  • Chukwa Sqoop Zookeeper Pig HBase Avno Mahout Flume WhirrMap Reduce Engine Hama Hive Hadoop Distributed File System Hadoop Common
  • Source: http://indoos.wordpress.com/2010/08/16/hadoop-ecosystem-world-map/
  • Distribute data initially Let processors / nodes work on local data Minimize data transfer over network Replicate data multiple times for increased availability Write applications at a high level Programmers should not have to worry about network programming, temporal dependencies, low level infrastructure, etc Minimize talking between nodes (share-nothing) HADOOP: 30,000 FEETVIEW
  • BIGDATA&ANALYTICS Case Studies
  • checkout our video on
  • Plot no 63/A, 1st Floor, Road No 13, Film Nagar, Jubilee Hills, Hyderabad-500033 For Individuals (+91) 9502334561/62 For Corporates (+91) 9618 483 483 Facebook: www.facebook.com/insofe Slide share: www.slideshare.net/INSOFE International School of Engineering