NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone...

4
Solution Brief

Transcript of NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone...

Page 1: NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone components in the Hadoop architecture. It is simply a matter of time before a disk fails.

Solution Brief

Page 2: NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone components in the Hadoop architecture. It is simply a matter of time before a disk fails.

Data Nodes NetApp E-Series

SAS/iSCSI/

FC

Data Nodes NetApp E-Series

SAS/iSCSI/

FC

Data Nodes NetApp® E-Series

SAS/iSCSI/

FC

Standby Node

Name Node

Had

oop

Softw

are

10G

B D

ata

Nod

e N

etw

ork

Page 3: NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone components in the Hadoop architecture. It is simply a matter of time before a disk fails.

Hadoop/Spark cluster

HDFS NFS

4 5 6 70 1 2 3 1 2 1 3 1 4 1 58 9 1 0 1 1 2 0 2 1 2 2 2 31 6 1 7 1 8 1 94 5 6 70 1 2 3 1 2 1 3 1 4 1 58 9 1 0 1 1 2 0 2 1 2 2 2 31 6 1 7 1 8 1 94 5 6 70 1 2 3 1 2 1 3 1 4 1 58 9 1 0 1 1 2 0 2 1 2 2 2 31 6 1 7 1 8 1 9

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

1600GB

NetApp StorageGRID

S3A

NetApp AFFNetApp AFF

Page 4: NetApp Solutions for Hadoop · Prevent Cluster Downtime Disk drives are the most fault-prone components in the Hadoop architecture. It is simply a matter of time before a disk fails.

Hadoop Installation Guide | Hadoop Configuration

Hadoop Installation Guide | Hadoop Configuration

The Downtime Woman

The Downtime Woman

Data Spillage In Hadoop Clusters - CERIAS · delete file method to a more secure method (e.g. NIST 800-88) ... the disk size: Larger the disk -> Longer processing time File types

Data Spillage In Hadoop Clusters - CERIAS · delete file method to a more secure method (e.g. NIST 800-88) ... the disk size: Larger the disk -> Longer processing time File types

Downtime Tech Mixer

Downtime Tech Mixer

Towards zero downtime

Towards zero downtime

for Database Acceleration Key Deployment Strategies Apache ... · Mainframe Distributed Ignite Persistence NoSQL Hadoop Disk Tier RDBMS Machine and Deep Learning Messaging Streaming

for Database Acceleration Key Deployment Strategies Apache ... · Mainframe Distributed Ignite Persistence NoSQL Hadoop Disk Tier RDBMS Machine and Deep Learning Messaging Streaming

Zero Downtime App Deployment using Hadoop

Zero Downtime App Deployment using Hadoop

Reducing Network Downtime

Reducing Network Downtime

CONTEMPORARY ANALYTICAL ECOSYSTEM · • Distributed analytics platform Hadoop MapReduce, disk-enabled SAS® High-Performance Analytics or SAS® LASR Analytic Server, in-memory Spark

CONTEMPORARY ANALYTICAL ECOSYSTEM · • Distributed analytics platform Hadoop MapReduce, disk-enabled SAS® High-Performance Analytics or SAS® LASR Analytic Server, in-memory Spark

Near Zero Downtime

Near Zero Downtime

Disk Array XP256alimartech.com/pdfs/hp_xp256_ds.pdf · Features Benefits No Single Point of Failure, Non-Disruptive Upgrades, & Multi-Terabyte Scalability without Downtime RAID 1

Disk Array XP256alimartech.com/pdfs/hp_xp256_ds.pdf · Features Benefits No Single Point of Failure, Non-Disruptive Upgrades, & Multi-Terabyte Scalability without Downtime RAID 1

Toward Zero Downtime

Toward Zero Downtime

Hadoop , Hadoop , Hadoop !!!

Hadoop , Hadoop , Hadoop !!!

Free Lunch: Exploiting Renewable Energy For Computing · Impact on Availability (for one VM) • VM downtime due to memory + disk: ≈ 0.5 seconds (10 Gbps link) • 615 migrations

Free Lunch: Exploiting Renewable Energy For Computing · Impact on Availability (for one VM) • VM downtime due to memory + disk: ≈ 0.5 seconds (10 Gbps link) • 615 migrations

Uptime, Downtime and Event Tracking - cdn.osisoft.com · Uptime, Downtime and Event Tracking RtTech Sean Rowlands ... – Downtime and KPI – No coding ... – Staple clients: Irving,

Uptime, Downtime and Event Tracking - cdn.osisoft.com · Uptime, Downtime and Event Tracking RtTech Sean Rowlands ... – Downtime and KPI – No coding ... – Staple clients: Irving,

Continuous Delivery for Linux/Windows/Hadoop...Beta Cluster Hadoop JobTracker Jenkins Slave Hadoop node Hadoop node Hadoop node Hadoop node Slave Node Gateway Prod. Cluster PigServer

Continuous Delivery for Linux/Windows/Hadoop...Beta Cluster Hadoop JobTracker Jenkins Slave Hadoop node Hadoop node Hadoop node Hadoop node Slave Node Gateway Prod. Cluster PigServer

SES314. Availability %Downtime / Year Downtime / Month Downtime / Week 99%3.65 days7.20 hours1.68 hours 99.9%8.76 hours43.20 minutes10.10 minutes.

SES314. Availability %Downtime / Year Downtime / Month Downtime / Week 99%3.65 days7.20 hours1.68 hours 99.9%8.76 hours43.20 minutes10.10 minutes.

20110227 hadoop disk-linuxfb

20110227 hadoop disk-linuxfb

Braindumps.70-533.101 - GRATIS EXAM - Convert … · available during network failures, local disk hardware failures, and any planned downtime. Combine the Azure Load Balancer with

Braindumps.70-533.101 - GRATIS EXAM - Convert … · available during network failures, local disk hardware failures, and any planned downtime. Combine the Azure Load Balancer with

2. Hadoop - lsd.ls.fi.upm.eslsd.ls.fi.upm.es/nuevas-tendencias-en-sistemas-distribuidos/Hadoop_… · Hadoop Hadoop Software Ecosystem Hadoop MapReduce Hadoop Distributed File System

2. Hadoop - lsd.ls.fi.upm.eslsd.ls.fi.upm.es/nuevas-tendencias-en-sistemas-distribuidos/Hadoop_… · Hadoop Hadoop Software Ecosystem Hadoop MapReduce Hadoop Distributed File System