Big data and Microsoft

15
http://k-mug.org/ https://www.facebook.com/TeamKmug

Transcript of Big data and Microsoft

Page 1: Big data and Microsoft

http://k-mug.org/

https://www.facebook.com/TeamKmug

Page 2: Big data and Microsoft

Huh, big data?PRAVEEN NAIR

Head of Technology & Architecture, Orion India Systems Kochihttp://www.ninethsense.com/

31 May 2014 – K-MUG UG Session

Page 3: Big data and Microsoft

What is Big Data?

Volume

Velocity

Veriety

Page 4: Big data and Microsoft

What is Big Data?

Volume

Velocity

Veriety

Veracity

Source: http://www.ibmbigdatahub.com/infographic/four-vs-big-data

Page 5: Big data and Microsoft

What is Big Data?

Volume

Velocity

VarietyVeracity

Virality

Viscosity

Variability

VisualizationValueVerisimilitude

Viability

Page 6: Big data and Microsoft

What is Big Data?

Page 7: Big data and Microsoft

Stories

1. Macy's Inc. and real-time pricing

2. Fast food and video

3. PredPol Inc. and repurposing

4. McLaren’s Formula One racing team

5. American Express Co. and business intelligence

6. Express Scripts Holding Co. and product generation.

7. Infinity Property & Casualty Corp. and dark data.

Page 8: Big data and Microsoft

Magic Quadrant for BI and Analytics Platforms

Source:http://www.gartner.com/technology/reprints.do?id=1-1QYUTPJ&ct=140220&st=sb

Page 9: Big data and Microsoft

Processing data(Map Reduce)

Storing Data(HDFS)

HadoopCommon utilities

YARN (Job and cluster management)

Page 10: Big data and Microsoft

Derivative Works

Distributions

Variants

Page 11: Big data and Microsoft

Apache projects for Hadoop

HivePig SQOO

PHCatalo

g

HBase

FlumeMahout

Ambari

Oozie

Zookeeper

Avro

Cassandra

Spark Tez

Chukwa

Page 12: Big data and Microsoft

Microsoft Power BI

Discover and CombinePower Query

VisualizePower ViewPower Map

Model and AnalyzePower Pivot

Page 13: Big data and Microsoft

Microsoft Analytics Platform System (APS)

Pre-Build and performance-tuned appliance

Linear scale-out to petabytes of data (up to 6pb)

MPP design and in-memory columnstore for 100x speed improvement and 15 time data compression

Dedicated region for Hadoop

Joining relational and non-relational data with Polybase

Page 14: Big data and Microsoft

HDInsight

Hadoop on Azure

Page 15: Big data and Microsoft

Thank You!