Technion - Israel institute of technologydepartment of Electrical Engineering

High speed digital systems laboratory

Super Computer System

Characterization presentation

Developers : Anton Vainer and Atila FuadMentor : Mr. Assad Haick

Nov 23, 2011

Super Computer System Agenda

Background Project Objectives System Block Diagram Technical Specifications Risks Gantt Chart

Super Computer System Background

• For Validation of 10G Ethernet products, We need a computer that can generate high speed traffic. Standard Computer don’t have the bandwidth needed (e.g. lab exp : 4 i7 cpu’s x 4 cores , 32 Gbytes over TCP stack OS Linux F14, commercial driver, TX 10G bps, throughput 4.2G bps)

• Super computers are very large, expensive and loosely coupled systems. In the project we will build a small tightly coupled super computer system with four computer chassis each with 1-4 CPUs.

• This super computer will be able to deliver the bandwidth needed to stress test 10G products.

Super Computer System Project Objectives

• Build a super computer system which delivers a large bandwidth to a single 10Gps Network interface card (NIC).

• Developing a driver and application that manages a single NIC across 4 computers.

Super Computer System System Block Diagram

PEX8627*4PEX8627*4PEX8627*4PEX8617*4

Computer

Computer

Computer

Computer

PEX8648

The platforms will be connected together via PLX PCIe switches, together supplying sufficient bandwidth for 10G Ethernet products stress.(10G ixia)

Super Computer System Sub-system Block Diagram

PEX8617AIC RDK

PCIe x4

NICNT

BCPU

System1 PEX8648RDK

PEX8617AIC RDK

PCIe x4

PCIe x8 (Gen2)

PCIe x4 Cable CPU

System 2

PCIe x4 Cable

CPUSystem 3

NTBCPU

System4 PEX8617AIC RDK

NTB

PCIe x4

PCIe x4 Cable

X XX

X

X = x4 PCI Express Cable Kit               

Mini SAS Cable kit included with 8648 RDK

mini SAS Cables

PCIe x4 (Gen2) NT

B

Super Computer System System setup

Super Computer System Technical Specifications

• Software Tools:• LAD SV driver• PLX GUI• Programming languages : TCL , C• OS Linux F14

• Hardware: • 4 Rose-city server machines, each with 1-4 CPUs.• PLX PCIe switches (8617 & 8648 evaluation boards )• 10Gbps NIC• Link Partner – IXIA • Fiber Optic Cables

Super Computer System Risks

• Defective modules – working with less PC’s.• Knowledge gap – Working with technical

leaders in Intel and PLX.• First of a kind system (system bugs).

Super Computer System Gantt Chart

Task Durat

ionStart Date

Finish Date

Characterization presentation 5 18.11 23.11Specs/Tools learning 30 24.11 24.12Design the setup and driver abilities 15 1.12 15.12Setup bring-up 15 16.12 31.12Mid. Project Presentation 5 1.1 5.1Enabling of PCIe switch 20 20.12 10.1Implementing the driver 20 10.1 31.1Testing and validation 28 1.2 28.2Final project presentation 5 1.4 5.4