PALM-3000

ATST/BBSO Visit

Stephen GuiwitsP3K System Hardware

126 Cahill

February 11, 2010

PALM-3000Agenda

• High level overview of the P3K Electronics

• P3K System Hardware– RTC Electronics– Interfaces and Layout

• Xinetics GenIII Communications– High Speed

– Low Speed

• Xinetics GenIII Drivers– Stability

– Features

PALM-3000Overview

PALM-3000RTC Electronics

• Cluster of 10 PC’s in the computer room

• Real-time calculations performed on 16 Nvidia GPU’s

• PC 0 provides the servo control, central scheduling, and control of the cluster

• PC 1 – PC 8 provides GPU calculations

• PC 9 is dedicated to telemetry recording

• Cluster communication provided by the high speed Quadrics switch

• QsNet II (16 way solution)

• 1064 Mbytes/s

• 900 MB/S Sustainable

4

PALM-3000

5

RTC Electronics

• RAID System– NexSAN Technologies– Configured for throughput optimization

• RAID 0• Two partitions

– High Speed data

– All other data

• Optical Splitter provides duplicates frames to all 8 PC’s

• All PC’s running Red Hat Enterprise Linux 5– Kickstart set up for automated, repeatable installations – Custom RPMS built and tested specifically for P3K

PALM-3000

6

RTC Electronics

PC 0 – 9

RAID System

KVM Switch

Quadrics High Speed Switch

16 Port Gigabit Ethernet Switch

Optical Splitter

PALM-3000Electronics Interfaces and Layout

Wavefront Processor(computer room)

DM Racks(Cass cage pos. 2 & 3)

Controller Racks(Cass cage pos. 4 & 5)

User Workstation(Data Room)

FiberSplitter

AO Bench

Ethernet

Pvt net

PALM-3000

8

Xinetics GenIII Communications

• P3K Requires high speed communication and low speed communication with the Xinetics GenIII Drivers

• Low Speed (serial interface) to configure and monitor driver states

• High Speed (SOR-422U) for DM control

PALM-3000High Speed Communications

PALM-3000

10

High Speed Communications

Transmit End• Curtiss Wright FibreXtreme SL240 PCIe 2.5 Gb/s Data Link Card

– Up to 247 MB/s per channel sustained data rate per channel

– Low overhead ANSI/VITA 17.1-2003 Serial FPDP Protocol• Based on Fiber Channel. Uses similar ordered sets

– Low latency (about 1us)

– 4 independent channels

PALM-3000High Speed Communications

Receive End• Curtiss Wright FibreXtreme SL240 CMC 2.5 Gb/s Data Link Card

– IEEE P1386 Common Mezzanine Card form factor (same as PMC)

– 32-bit parallel FPDP data bus @ 62.5 MHz

•Custom Carrier Board–6U VME form factor. FPGA based.

–Four SOR-422U parallel output ports for connection to Xinetics Drivers.

–P1 port for connection to LODM and TTM amplifiers.

PALM-3000Low Speed Communications

• Serial Communication @ 115200 Baud

• Communicate with each driver through a terminal server – Terminal server has 16 RJ 45 ethernet ports

– Each driver has a 9 pin DE 9 connector

– 9 pin – RJ 45 adapter required

• Drivers have a Primary/Secondary configuration– Specially developed by Xinetics for P3K

12

PALM-3000Xinetics GenIII Drivers

• Software– Written for the low speed serial interface

– Communicates via serial terminal server• PC ethernet terminal server RJ-45 9 pin driver

• Certain commands are required for each driver while others are only required by the Primary driver

– Commands tested for all 8 drivers• Power up

• Power down

• Put driver in proper mode (Normal or Test)

• Clear faults on the drive (Xinetics feature)

• Mute the drivers

• Drive actuator values

• Drive bias value

• Read back voltage table (needs adjusting)

• Read status table

PALM-3000Xinetics GenIII Drivers

• Stability– Idle issues. Random driver will fault when powered

on and not used– Work well after running

• Had multiple runs over a 48+ hour period

– Thousands of commands sent to date

• Features– Daisy Chain

• Developed for P3K by Xinetics

– Undocumented software API– API bugs must be worked around (trial and error)

14

PALM-3000Questions, Comments, Suggestions