The Art of War : Fast Track Data Warehouse… … and Fragmentation

James Rowland-Jones

@jrowlandjones

james@rowland-jones.com

featuring Pot and Kettle…

Agenda

• Appliances and Reference Architectures

• Fast Track Data Warehouse

• Fragmentation

• Design Patterns for minimal fragmentation

Introducing Pot and Kettle…

Appliance Reference Architecture

Understanding Appliances

Appliances are…

• Targeted

• Convenient

• Predictable

• Styled

• Customisable

• The Solution

Appliances are not…

Get to Know Reference Architectures

Ref. Architectures are… • Prescriptive • Balanced • Guide

Ref. Architectures are not…

• As Quick to set up

• The Solution

WHAT ABOUT DIY?

COMING TO THE RESCUE…

MAKING THE TEA …is always the solution…

MAKING THE I-TEA

WHAT HAVE YOU BOUGHT? Really…

THINKING ABOUT FAST TRACK Microsoft’s first Data Warehouse Reference Architecture

Fast Track v3.0

• V3 Launched Spring 2011

• Supported by

– HP

– IBM

– Cisco/EMC

• Range of platforms

from 4 to 80TB

400 MB/s

400 MB/s 400 MB/s

400 MB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

3GB/s

400 MB/s

400 MB/s 400 MB/s

400 MB/s

400 MB/s

400 MB/s 400 MB/s

400 MB/s

400 MB/s

400 MB/s 400 MB/s

400 MB/s

400 MB/s

400 MB/s 400 MB/s

400 MB/s

400 MB/s

400 MB/s 400 MB/s

400 MB/s

3GB/s

3GB/s

HBA1

HBA2

HBA3

HBA4

HBA5

8G

B/s

MCR 7GB/s

4 X7560 32 Cores

Fibre Switch

MPIO Configuration FT Std: Round Robin with Subset HP STD: Failover mpclaim utility

1 2 3 4

5 6 7 8

9 10 11 12

13 14 15 16

17 18 19 20

21 22 23 24

L1

L2

L3

ST1

HP 580 G7

6x P2000 G3

DATA & LOG LUNS RAID 1+0 (108 Disks)

Staging / FS LUN RAID 5 (6 Disks)

Hot Spares Global 2 per enc (12 Disks)

FRAGMENTATION A review…

PHYSICAL FRAGMENTATION

File Fragmentation

• Cause Random Disk head movement

• Extra Latency

• Lower Throughput

Page Density

LOGICAL FRAGMENTATION

Logical Fragmentation

PAGE 101 PAGE 102 PAGE 103 PAGE 100

Extent Fragmentation

Why is this a war?

Questions