PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions...

129
Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 1 of 128 PDR.03 Requirements Analysis Document number………………………………………………….…….SKA-TEL-SDP-0000033 Context………………………………………………………………………………..…………….SE Revision………………………………………………………………………………………….……1 Author………………………………………………………………………………………F. Graser Release Date……………………………………………………………………………2015-02-09 Document Classification………………………………………………………………Unrestricted Status……………………………………………………………………………………………Draft

Transcript of PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions...

Page 1: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 1 of 128

PDR.03 Requirements Analysis

Document number………………………………………………….…….SKA-TEL-SDP-0000033

Context………………………………………………………………………………..…………….SE

Revision………………………………………………………………………………………….……1

Author………………………………………………………………………………………F. Graser

Release Date……………………………………………………………………………2015-02-09

Document Classification………………………………………………………………Unrestricted

Status……………………………………………………………………………………………Draft

Page 2: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 2 of 128

Name Designation Affiliation

P. Alexander SDP lead University of Cambridge

Signature & Date:

Name Designation Affiliation

F. Graser SDP System Engineer SCS Space

Signature & Date:

Version Date of Issue Prepared by Comments

1.0 2015-02-09 F. Graser

ORGANISATION DETAILS

Name Science Data Processor Consortium

Signature:

Email:

Signature:

Email:

Ferdl Graser (Feb 9, 2015)Ferdl Graser

[email protected]

Paul Alexander (Feb 9, 2015)Paul Alexander

[email protected]

Page 3: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 3 of 128

Table of Contents 1. Introduction .................................................................................................................................... 4

2. System Description ......................................................................................................................... 4

2.1. Product tree ............................................................................................................................ 4

C Science Data Processor .................................................................................................................... 5

C.1 Hardware Compute Platform .................................................................................................... 5

C.2 Software Compute Platform ..................................................................................................... 6

C.3 Data Layer ................................................................................................................................. 7

C.4 Pipeline Components ................................................................................................................ 8

C.5 Data Delivery Platform .............................................................................................................. 9

C.6 Local Monitoring and Control ................................................................................................. 10

2.2. Functional decomposition .................................................................................................... 11

3. Requirements Analysis .................................................................................................................. 13

3.1. SDP Functional Requirements ............................................................................................... 13

F.1 Continuum Imaging ................................................................................................................. 13

F.2 Spectral line Imaging ............................................................................................................... 29

F.3 Ingest Data .............................................................................................................................. 42

F.4 Real-time Calibration............................................................................................................... 50

F.5 Drift Scan Imaging ................................................................................................................... 51

F.6 Science Analysis ....................................................................................................................... 63

F.7 Imaging Transient Search ........................................................................................................ 65

F.8 Non-Imaging Transient Post Processing .................................................................................. 70

F.9 Pulsar Timing Post Processing ................................................................................................. 72

F.10 Pulsar Search Post Processing ............................................................................................... 75

F.11 Update Global Sky Model ...................................................................................................... 80

F.12 Archiving ................................................................................................................................ 80

F.13 Regional Centre Interface ..................................................................................................... 88

F.14 SKA Archive User Interface.................................................................................................... 90

F.15 SDP LMC ................................................................................................................................ 99

F.16 Commissioning .................................................................................................................... 112

3.2. SDP non-functional requirements ...................................................................................... 113

NF.1 Security ............................................................................................................................... 113

NF.2 Equipment & Component Specifications ............................................................................ 113

NF.3 Production & Manufacturing Specifications ....................................................................... 117

Page 4: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 4 of 128

NF.4 Operations .......................................................................................................................... 118

NF.5 EMC & RFI ........................................................................................................................... 119

NF.6 Health, Safety & Environment ............................................................................................ 120

NF.7 Maintenance, Test & Support ............................................................................................. 124

NF.8 VLBI ..................................................................................................................................... 127

1. Introduction This document defines the requirements, functions and components that comprise the Science Data

Processor (SDP) element that is responsible for processing output data for the three SKA

Observatory telescopes.

All the information presented in this document is managed by the systems engineering tool

Innoslate (https://www.innoslate.com/) and can be accessed on-line in order to interactively

interrogate the content. Refer to Addendum A for further details.

Also included with this document are the complete functional decomposition diagram and product

tree diagrams in .png format as well as a spreadsheet containing the following:

All requirements

All functions

All components

Functions – requirements matrix (only functional requirements)

Components – functions matrix

2. System Description

2.1. Product tree The physical hierarchy of the SDP system is shown below in text format and a series of diagrams.

These diagrams are taken from the Innoslate tool and are shown separately due to limitations of the

document format.

Page 5: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 5 of 128

C Science Data Processor SDP System

C.1 Hardware Compute Platform

All hardware components within the SKA Science Data Processor

C.1.1 Compute Island

The basic replicatable unit of the SKA Science Data Processor

C.1.1.1 Management Compute Island

Dedicated hardware and software to facilitate efficient management of

the compute island hardware

C.1.1.2 Compute Node

Basic replicatable unit of the compute island

C.1.2 Buffer

Hardware to buffer intermediate data to facilitate iterative processing

C.1.3 SDP Infrastructure

Local cooling, rack space and local power distribution. Interfaces with the data

centre infrastructure resources.

Page 6: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 6 of 128

C.1.3.1 Racks

The racks to house the science data processor equipment. Includes

integrated water-cooling if applicable.

C.1.4 Hierarchical Storage

Hierarchical storage system for science data

C.1.4.1 Medium Performance Buffer

Part of the Hierarchical storage.

C.1.4.2 Long Term Storage

Long term storage equipment for science products

C.1.5 Interconnect System

The collection of data transport networks within the Science Data processor

C.1.5.1 Low-latency network core switch

hardware to interconnect the internal low-latency networks present

within each compute island

C.1.5.2 Management Network

dedicated network to manage and control the various hardware

resources within the SDP. Connects the management compute island

resources as well.

C.1.5.3 Data Transport Network

The data transport network responsible for the bulk data transport into

and out of the compute islands

C.1.6 Delivery Platform Hardware

Dedicated hardware for data delivery

C.1.7 LMC Hardware

Dedicated hardware for Local Monitoring and control

C.2 Software Compute Platform

The collection of software that is required to effciently utilize and manage the

hardware compute platform. Provides software services to the data layer.

C.2.1 Compute OS software

Operating system(s) running on SDP hardware

C.2.2 Middleware

Software that provides services to other software components beyond those

available from the operating system.

Page 7: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 7 of 128

C.2.2.1 Messaging Layer

Software that provides communication services to other software

components

C.2.2.2 Logging system

Software component that handles the generation, collection,

aggregation and analysis of system logs.

C.2.2.3 Platform Management System

Software systems to deploy, maintain and control the hardware in the

Science data processor

C.2.2.4 System Optimisation Tools

Software tools designed to facilitate system optimisation efforts

C.2.3 Hierarchical Storage Management software

Software that automates the movement of data across various storage tiers

C.2.4 Application Development Environment and SDK

The suite of software components that support and facilitate software

development

C.2.5 Scheduler

Software component responsible for hardware allocation and hardware

requirements estimates

C.3 Data Layer

The software system responsible for data persistence, data base and data life-cycle

services as well as the pipeline framework

C.3.1 Data Manager

Distributed software component that deals with the creation, monitoring and

termination of Data Objects.

C.3.1.1 Data Manager interface to Pipeline Components

C.3.2 Data Life Cycle Manager

Software component that implements a rule driven system for data movement,

persistence and release based on hardware parameters and policies.

C.3.3 Science Archive Software

Software component that implements the database and query capabilities

required for users to discover and retrieve released science data products.

Page 8: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 8 of 128

C.3.4 Local Database Services

Generic database services for the SDP, including the Science Archive, the

LMC and potentially source catalogues.

C.3.5 Ingest Data from CSP into Data Layer

High speed data interface between the CSP and SDP.

C.4 Pipeline Components

Software components that, once executed one after the other, form a Data Processing

Pipeline

C.4.1 Processing Library

Software Library of processing components and supporting software

C.4.1.1 Non-imaging processing components

Software components for processing of voltage domain time series

data

C.4.1.2 RM Synthesis Component

Software Component for RM Synthesis of Image Cubes

C.4.1.3 Ingest Components

Software Components for the Ingest Pipeline

C.4.1.3.1 Flagging Component

Software Component for Flagging of RFI

C.4.1.3.2 Demixing Component

Software Component for removal of bright sources outside the

FoV

C.4.1.4 Calibration components

Software Components for performing the Calibration on visibility data

C.4.1.5 Source Finding Components

Software Compmentent for Finding Sources from Image Cubes

C.4.1.6 Imaging Components

Software Components for transforming visibility data into image cubes

C.4.1.6.1 Gridding

Software Component for putting visibility data on a regular

grid

Page 9: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 9 of 128

C.4.1.6.2 Deconvolution

Software Component for decovolving Image Cubes

C.4.1.6.3 FFT

Software Component for Fast Fourier Transformation

C.4.2 Algorithmic Software

C.4.3 Sky Model Use and Creation

The Sky Model contains the (parameterized) known sky.

C.4.4 QA components

Quality Assurance components.

C.4.4.1 Global Sky Model QA

Quality Assurance of the Sky Model components

C.5 Data Delivery Platform

A software stack whose purpose is to enable users to search for and access data

products. It includes services to tansport data to specified remote sites and to perform

remote visualisation of data products. This will be deployed at SDP sites and be

available to deploy other Regional Centres.

C.5.2 Tiered Data Transfer Service

Service for managing the movement of data objects to specified remote sites

(e.g., Regional Centres)

C.5.2.1 LMC interface for data scheduling & reporting

Interface for LMC to request data movement using the Tiered Data

Transfer Service, reporting back information from the data delivery

services and for these services to be able to access Authn and AuthZ

information

C.5.3 User Portal

Web based platform hosting user tools and services related to the data delivery

subsystem

C.5.3.1 Astronomer/ Telescope Operator/ Public Interfaces

Web GUI and API interfaces to the data delivery subsystems

C.5.4 Data Discovery Service

Service to enable searching for data objects based on information describing

the objects

Page 10: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 10 of 128

C.5.4.1 IVOA Models and Services

C.5.5 Data Visualisation Service

Service that enables remote visualisation of data products

C.5.6 Regional Centre Interface

The interface to move data to the Regional Centres

C.6 Local Monitoring and Control

Provides bridge between external monitor and control requirements and internal sub-

elements.

C.6.1 Local Telescope Model

Storage of meta-data relevant to current observation. Wide variety of data is

stored from static configuration information through to components of the

Local Sky Model.

C.6.2 Data Flow Manager (LMC)

Responsible for constructing physically realisable data flow graphs for

deployment into the data layer.

C.6.3 QA monitoring

Aggregates and inteprets lower level QA data arriving from the various

pipelines.

C.6.4 User Interfaces

Visual environment for presenting QA data. Allows user interaction with the

metric calculations.

C.6.5 Master Controller and error handling

Single instance central controller for all instantiated SDP capabilities. Main

point of contact for TM.

C.6.6 Event monitoring and logging

Logging, alarm and event handling services. Includes aggregation and

granular control.

C.6.7 Data Flow Models

Model describing the sequence in which Pipeline Components are to be

executed

C.6.7.1 Non-imaging pipeline

Voltage domain time series processing

Page 11: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 11 of 128

C.6.7.1.1 Pulsar Timing Post Processing

Timing of known Pulsars

C.6.7.1.2 Pulsar Search Post Processing

Post-processing of Pulsar Search candidates

C.6.7.1.3 Non-imaging transient post processing

Single Pulse / Fast Transients

C.6.7.2 Continuum Imaging Pipeline

Continuum Imaging Pipeline

C.6.7.3 Fast Imaging (Slow Transients)

Real-time continuum imaging for slow transient detection

C.6.7.4 Ingest Pipeline

Data Reception and pre-processing

C.6.7.5 Science Analysis Pipeline

Science Analysis pipelines

C.6.7.5.1 Postage Stamp Source Detection

Source Finding component

C.6.7.5.2 RM Synthesis

RM-Synthesis pipeline

C.6.7.6 Calibration Pipeline

Calibration pipeline for EoR processing

C.6.7.7 Real-time calibration pipeline

Real-time calibration pipeline for feedback to CSP

C.6.7.8 Spectral Line Imaging Pipeline

Spectral Line Imaging Pipeline

2.2. Functional decomposition The top level functional hierarchy of the SDP system is shown below in a diagram. Further diagrams

of the functional hierarchy are not practical to show in this format and are therefore omitted.

Complete diagrams are available together with this document.

Page 12: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 12 of 128

Page 13: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 13 of 128

3. Requirements Analysis The functional breakdown presented earlier in the document is used to categorise the functional

requirements.

3.1. SDP Functional Requirements

F.1 Continuum Imaging

To make science-ready images cubes with spectral dimension representing a Taylor

expansion of continuum spectra, and any alternative representations which are found

to be appropriate, or spectral cubes at low spectral resolution

SDP_REQ-278 Local sky model

The SDP shall use a Local Sky Model, derived from a Global Sky Model or previous

Local Sky Model.

SDP_REQ-372 Early science processing capability

The SDP shall support per telescope early science processing rates 10% of those

required for full observing, as described in the SDP construction plan.

SDP_REQ-386 Continuum imaging pipeline

The SDP shall provide a Continuum Imaging pipeline that constructs wide-band

images. Polarisation shall be available if requested or necessary for calibration or

quality assurance.

SDP_REQ-390 Multi-frequency synthesis imaging

The SDP shall construct and make use of frequency-dependent image models over the

entire observed bandwidth.

SDP_REQ-392 Peeling

The continuum pipeline shall enable peeling of bright sources (strength limited by

signal to noise ratio) from the visibility data.

SDP_REQ-467 Perform Imaging Pipeline Automatic QA

The Imaging Pipeline shall perform standardised, automated Quality Assessment of

Images along the axes of astrometry, photometry, radiometry, polarimetry, and

spectrometry.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SDP_REQ-619 Combine multiple image cubes

The Continuum Imaging and Spectral line pipeline shall be able to combine multiple

image cubes appropriately.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2128 Continuum and spectral line imaging mode.

Continuum and spectral line imaging mode. All three SKA1 telescopes shall be

capable of operating in a Continuum and Spectral-line imaging mode concurrently.

SKA1-SYS_REQ-2134 Electromagnetic frequency range.

Page 14: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 14 of 128

Electromagnetic frequency range. SKA1_Low shall be able to measure

electromagnetic radiation in a frequency range from 50 MHz to 350 MHz.

SKA1-SYS_REQ-2140 SKA1_Low station diameter

SKA1_Low station diameter . The station diameter will be 35 metres, which is

consistent with being able to provide a single, circularly symmetric, beam of 5

degrees at the half-power points at 100 MHz (centre of the EoR frequency range)

while meeting the sensitivity requirements with 256 antennas per station evenly

distributed in an irregular-random configuration.

SKA1-SYS_REQ-2142 SKA1_Low number of stations.

SKA1_L ow number of stations . The SKA1_Low shall comprise of 1024 stations.

SKA1-SYS_REQ-2147 Instantaneous bandwidth.

Instantaneous bandwidth. The SKA1_Low shall be capable of simultaneously

processing 300 MHz of bandwidth.

SKA1-SYS_REQ-2148 SKA1_Low channelisation

SKA1_Low channelisation. The SKA1_Low channelisation for each sub array shall

provide up to 256,000 linearly spaced frequency channels across the available

frequency range of each band.

SKA1-SYS_REQ-2153 Diameter

Diameter. SKA1 dishes shall have a projected diameter of larger than or equal to 15m

and smaller than 16.5m.

SKA1-SYS_REQ-2165 Polarisation Purity

Polarisation Purity. The IXR shall be better than 15 dB over the whole observing

bandwidth within the HPBW

SKA1-SYS_REQ-2173 MeerKAT array

MeerKAT array. The monitor and control functions of MeerKAT shall be made

available to SKA1_Mid via a Foreign Telescope interface consisting of a Local

Monitor and Control system connected to the SKA1_Mid Telescope Manager.

SKA1-SYS_REQ-2174 Combined SKA1_Mid configuration.

Combined SKA1 Mid Configuration. 42 % of the Combined SKA1_Mid shall be

within a radius of 400 m of the array centre.

SKA1-SYS_REQ-2178 Combined SKA1_Mid configuration

Combined SKA1_Mid configuration. 14 % of the combined SKA1_Mid array shall be

within a radius between 4,000m and 100,000 m of the array centre.

SKA1-SYS_REQ-2185 RF system sampled bandwidth band 1

RF system sampled bandwidth band 1. The instantaneous bandwidth for band 1 will

be 700MHz and shall be sampled to at least 2.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2186 RF system sampled bandwidth band 2

RF system sampled bandwidth band 2. The instantaneous bandwidth for band 2 will

be 810 MHz and shall be sampled to at least 2.0 G sample per second for each

polarisation.

SKA1-SYS_REQ-2187 RF system sampled bandwidth band 3

RF system sampled bandwidth band 3 The instantaneous bandwidth for band 3 will be

1,403 MHz and shall be sampled to at least 5.0 G samples per second for each

polarisation.

Page 15: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 15 of 128

SKA1-SYS_REQ-2188 RF system sampled bandwidth band 4

RF system sampled bandwidth band 4 The instantaneous bandwidth for band 4 will be

2,380 MHz and shall be sampled at at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2189 RF system sampled bandwidth band 5

RF system sampled bandwidth band 5 The SKA_Mid, for band 5, shall digitise two

separate 2.5 GHz bands for each polarisation.

SKA1-SYS_REQ-2195 SKA1_Mid channelisation

SKA1_Mid channelisation. The SKA1_Mid channelisation for each sub array shall

provide up to 256, 000 linearly spaced frequency channels across the sampled

bandwidth of each band.

SKA1-SYS_REQ-2236 SKA1_Survey configuration

SKA1_Survey configuration. 22% of the SKA1_Survey array shall be within a radius

of 4,000 m and 25,000 m of the array centre

SKA1-SYS_REQ-2238 RF system frequency range PAF band 1

RF system frequency range PAF band 1 The SKA1_Survey PAF for band 1 shall have

a frequency range from 350 to 900 MHz for each polarisation.

SKA1-SYS_REQ-2239 RF system frequency range PAF band 2

RF system frequency range PAF band 2 The SKA1_Survey PAF for band 2 shall have

a frequency range from 0.650 to 1.670 GHz for each polarisation.

SKA1-SYS_REQ-2240 RF system frequency range PAF band 3

RF system frequency range PAF band 3. The SKA1_Survey PAF for band 3 shall

have a frequency range from 1.500 to RF system frequency range PAF band 3 The

SKA1_Survey PAF for band 3 shall have a frequency range from 1.500 to 4.000 GHz

for each polarisation.

SKA1-SYS_REQ-2241 Maximum available bandwidth

Maximum available bandwidth The SKA1_Survey shall have a PAF bandwidth of at

least 500 MHz for each polarisation and beam

SKA1-SYS_REQ-2242 SKA1_Survey digitised bandwidth

SKA1_Survey digitised bandwidth The SKA1_Survey digitised bandwidth for each

PAF shall be greater than 500 MHz for each polarisation.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the element

signals in each band to provide 36 full bandwidth, dual polarisation beams per

antenna.

SKA1-SYS_REQ-2250 SKA1_Survey channelisation.

SKA1_Survey channelisation. The SKA1_Survey channelisation shall provide 256,

000 linearly spaced frequency channels across the frequency band of each PAF band.

SKA1-SYS_REQ-2252 SKA1_Survey correlator dump period.

SKA1_Survey correlator dump period. The SKA1_Survey correlator shall have a

programmable dump period in the range 3 seconds to 0.3 seconds

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey array

shall have an imaging dynamic range of greater than:band 1: 55dB for a 1000 hour

Page 16: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 16 of 128

single-field integrationband 2: 56dB for a 1000 hour single-field integrationband 3:

54dB for a 1000 hour single-field integration.

SKA1-SYS_REQ-2259 SKA1_Survey spectral dynamic range.

SKA1_Survey spectral dynamic range. The spectral dynamic range for SKA1_Survey

shall be better than 30dB between adjacent channels and 60dB globally.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the 36

ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2263 SKA1_Survey single array operation.

SKA1_Survey single array operation . SKA1-Survey shall be capable of operating

ASKAP and SKA1 dishes as single array for frequency band 2.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame independent

of parallactic angle.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by comparison of

observed with GSM predictions with a time scale appropriate to the component and

physical effect being calibrated and fed back to the telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction algorithms

shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local Sky

Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use of

frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2325 Scale sensitive deconvolution

Deconvolution of single channels Scale sensitive two-dimensional (i.e. on the tangent

plane) deconvolution shall be available.

SKA1-SYS_REQ-2328 Solution for pointing errors.

Solution for pointing errors. It shall be possible to solve for and correct time- and

station-dependent pointing errors with accuracy and timescale limited by signal to

noise ratio.

SKA1-SYS_REQ-2330 Peeling.

Peeling. Peeling of bright sources (strength limited by signal to noise ratio) from the

visibility data shall be possible.

SKA1-SYS_REQ-2338 Calibration pipeline.

Calibration pipeline. There shall be a Calibration pipeline that derives current

telescope parameters using a recent observation and a Global Sky Model, either a

known GSM or the most recent GSM.

SKA1-SYS_REQ-2339 Continuum imaging pipeline.

Page 17: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 17 of 128

Continuum imaging pipeline. There shall be a Continuum Imaging pipeline that shall

have the goal of constructing noise-limited wide-band images for observations up to

1000h integration time. Polarisation shall be available if requested or necessary for

calibration or quality assurance.

SKA1-SYS_REQ-2340 Continuum imaging data products.

Continuum imaging data products. The Data Products shall include the first n moment

images for multi-frequency synthesis, corresponding residual images (if

deconvolved), sensitivity image and representative PSF image, where n is set by

signal to noise ratio.

SKA1-SYS_REQ-2634 Calibration update rate

Calibration update rate. Calibration measurements shall be necessary at a rate of no

more than 10seconds.

SKA1-SYS_REQ-2724 Aperture Array DDE

Aperture Array DDE . There shall be a direction dependent model for the aperture

array primary beam to be used in calibration and imaging.

SKA1-SYS_REQ-2725 Faraday rotation DDE

Faraday rotation DDE. There shall be a direction dependent Faraday Rotation model

for use in calibration and imaging.

SKA1-SYS_REQ-2726 PAF DDE

PAF DDE. There shall be a direction dependent model for the dish phased array feed

sensitivity pattern to be used in calibration and imaging.

SKA1-SYS_REQ-2727 Dish DDE

Dish DDE. There shall be a direction dependent model for the dish primary beam to

be used in calibration and imaging.

SKA1-SYS_REQ-2729 Calibration and Imaging formalism

Calibration and imaging formalism. The Calibration and Imaging formalism shall be

based upon the Rau framework [14].

SKA1-SYS_REQ-2745 Astrometry performance metric

Astrometric performance metric: The Astrometric performance metric (APM) shall

measure deviation (rms, average offset, and med) of source positions from known

standards.

SKA1-SYS_REQ-2825 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms.

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64 antennas

in both monitor and control and data collection functions.

SKA1-SYS_REQ-???? Mosiacking

Waiting for the description from Bojan.

Page 18: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 18 of 128

F.1.1 RFI flagging and excision

To flag visibility data that are affected by RFI or instrumental glitches

SDP_REQ-476 Flag RFI

The SDP shall be capable of automatically flagging known and unknown RFI.

SDP_REQ-477 Excise RFI

The SDP shall be capable of automatically excising known and unknown RFI.

SDP_REQ-487 Flag Data

The ingest shall flag data indicated as bad by the Telescope Manager

SDP_REQ-488 Flag Lightning

The ingest pipeline shall flag RFI from lightning.

SDP_REQ-490 Data Quality

The ingest pipeline shall generate metrics (TBD) about the data quality during

flagging.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

F.1.4.1 Apply t-f flagger

F.1.1.1 Determine spatial filter weights

F.1.1.2 Apply Spatial filter

SDP_REQ-491 Spatial Filtering

The RFI mitigation step shall perform spatial filtering

SDP_REQ-495 Spatial Filter Weights

The Spatial Filtering step will set the weights for spatial filtering

F.1.1.3 Determine RFI detection threshhold

SDP_REQ-478 Detect RFI

The SDP shall be capable of detecting data that is corrupted by RFI.

SDP_REQ-486 Determine RFI Threshold

The RFI detection will determine the RFI detection threshold

SDP_REQ-489 Covariance Matrices

The ingest pipeline shall compute the appropriate types of covariance

matrices needed to improve the robustness of RFI mitigation

F.1.2 Store LSM

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

Page 19: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 19 of 128

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

Page 20: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 20 of 128

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.3 Forward Estimate

To estimate a trial sky image cube from visibility data

F.1.4 Deconvolution

To deconvolve the data for the interferometer instrumental response by

subtracting a sky model from the visibility data

SDP_REQ-397 Imager

The imaging pipeline shall provide a clean map image, clean beam image,

clean component map image and residual map image (or the equivalent set of

image cubes in the case of spectral line).

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a clean

map image, clean beam image, clean component map image and residual map

image (or the equivalent set of image cubes in the case of spectral line).

SDP_REQ-447 Major and minor deconvolution cycles

The deconvolution step shall contain a major and a minor cycle

SDP_REQ-504 Scale sensitive deconvolution

The SDP shall provide scale sensitive two-dimensional (i.e. on the tangent

plane) deconvolution.

SKA1-SYS_REQ-2325 Scale sensitive deconvolution

Deconvolution of single channels Scale sensitive two-dimensional (i.e. on the

tangent plane) deconvolution shall be available.

F.1.4.1 Apply t-f flagger

F.1.4.2 Subtract Component in Image Plane

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.3 Identify Component

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.4 iFFT

SDP_REQ-402 Fourier Transform Algorithm

Page 21: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 21 of 128

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.5 De-gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.6 Subtract from uv-data

SDP_REQ-396 LSM subtraction

The Continuum pipeline shall subtract the current local sky model

from the averaged visibilities.

F.1.4.7 Gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.8 FFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.9 Major Cycle Loop

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

Page 22: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 22 of 128

F.1.5 Initial Calibration (averaged data)

Initial calibration is already done in the ingest pipeline on full resolution data.

This function exists in case initial calibration needs to be done on averaged

data.

SDP_REQ-417 Calibration pipeline.

SDP shall have a Calibration pipeline that derives current telescope parameters

using a recent observation and either a known or the most recent Global Sky

Model.

F.1.6.5 Correct

SDP_REQ-499 Correct

The calibration pipeline shall be able to correct for direction

independent effects.

F.1.6 Calibration

Skip this step the first time its executed. (this is not shown in the diagram to

reduce complexity)

SDP_REQ-278 Local sky model

The SDP shall use a Local Sky Model, derived from a Global Sky Model or

previous Local Sky Model.

SDP_REQ-412 SKA1_Survey spectral dynamic range.

The SDP contribution to the spectral dynamic range for SKA1_Survey shall

be better than TBD between adjacent channels and TBD globally.

SDP_REQ-417 Calibration pipeline.

SDP shall have a Calibration pipeline that derives current telescope parameters

using a recent observation and either a known or the most recent Global Sky

Model.

SDP_REQ-424 Polarisation purity.

The SKA1_low station beams shall have a polarisation purity at the zenith

better than TBD after calibration.

SDP_REQ-430 Flux scale

The SDP shall preserve the absolute flux scale provided by the global sky

model.

SDP_REQ-437 SKA1_Survey inclusion of ASKAP.

The SDP shall process data from the SKA1_Survey FoV including the 36

ASKAP antennas including both monitor and control and data collection

functions.

SDP_REQ-441 Automated Quality Assessment.

The SDP shall perform standardised, automated Quality Assessment of Images

along the axes of astrometry, photometry, radiometry, polarimetry, and

spectrometry.

SDP_REQ-442 Astrometric performance metric

The SDP Astrometric performance metric (APM) shall measure deviation

(rms, average offset, and med) of source positions from known standards.

SDP_REQ-443 Photometric performance metric

Page 23: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 23 of 128

The SDP Photometric performance metric (PPM) shall measure deviation

(rms, average offset, and med) of source fluxes from known standards.

SDP_REQ-444 Radiometric performance metric

The SDP Radiometric performance metric (RPM) shall measure noise

fluctuations (rms, average offset, and med) in an Image..

SDP_REQ-445 Polarimetric performance metric

The SDP Polarimetric performance metric (OPM) shall measure deviation

(rms, average offset, and med) of source polarisations (polarisation degree and

angle) from known standards.

SDP_REQ-446 Spectrometric performance metric

The SDP Spectrometric performance metric (SPM) shall measure deviation

(rms, average offset, and med) of source spectral lines from known standards.

SDP_REQ-466 Perform Calibration Pipeline Automatic QA

The Calibration Pipeline shall perform standardised, automated Quality

Assessment of Images along the axes of astrometry, photometry, radiometry,

polarimetry, and spectrometry.

SDP_REQ-500 Self-calibration loop

The continuum pipeline shall be able to perform self-calibration in order to

achieve noise-limited performance.

SDP_REQ-536 Pulsar Timing Polarisation Calibration

Pulsar Timing Post Processing shall apply polarisation calibration parameters

provided by TM to pulsar timing data

SDP_REQ-553 Pulsar Timing Flux Calibration

Pulsar Timing Post Processing shall apply flux calibration parameters

provided by TM to pulsar timing data

SKA1-SYS_REQ-2128 Continuum and spectral line imaging mode.

Continuum and spectral line imaging mode. All three SKA1 telescopes shall

be capable of operating in a Continuum and Spectral-line imaging mode

concurrently.

SKA1-SYS_REQ-2158 Pointing repeatability.

Pointing repeatability. The pointing repeatability shall be better than 10 arc

seconds rms for winds < 7 m/s at night time.

SKA1-SYS_REQ-2159 Pointing repeatability - Low wind / day time

Pointing repeatability . The pointing repeatability shall be better than 17 arc

seconds rms for an average wind speed of < 7 m/s in the day time

SKA1-SYS_REQ-2160 Pointing repeatability - Higher wind

Pointing repeatability. The pointing repeatability shall be better than 180 arc

seconds rms for an average wind speed between 7 and 20 m/s

SKA1-SYS_REQ-2173 MeerKAT array

MeerKAT array. The monitor and control functions of MeerKAT shall be

made available to SKA1_Mid via a Foreign Telescope interface consisting of

a Local Monitor and Control system connected to the SKA1_Mid Telescope

Manager.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

Page 24: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 24 of 128

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the

element signals in each band to provide 36 full bandwidth, dual polarisation

beams per antenna.

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey

array shall have an imaging dynamic range of greater than:band 1: 55dB for a

1000 hour single-field integrationband 2: 56dB for a 1000 hour single-field

integrationband 3: 54dB for a 1000 hour single-field integration.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the

36 ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame

independent of parallactic angle.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by

comparison of observed with GSM predictions with a time scale appropriate to

the component and physical effect being calibrated and fed back to the

telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction

algorithms shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local

Sky Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use

of frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2328 Solution for pointing errors.

Solution for pointing errors. It shall be possible to solve for and correct time-

and station-dependent pointing errors with accuracy and timescale limited by

signal to noise ratio.

SKA1-SYS_REQ-2330 Peeling.

Peeling. Peeling of bright sources (strength limited by signal to noise ratio)

from the visibility data shall be possible.

SKA1-SYS_REQ-2338 Calibration pipeline.

Calibration pipeline. There shall be a Calibration pipeline that derives current

telescope parameters using a recent observation and a Global Sky Model,

either a known GSM or the most recent GSM.

SKA1-SYS_REQ-2621 Spectral stability

Spectral stability: The spectral stability, on a time scale of 600 sec.,of the

station beam bandpass, post station calibration and RFI-mitigation, shall be

within 1.3 %, 0.4 %, 0.6 % and 1.1 % at 50 MHz, 100 MHz, 160 MHz, and

Page 25: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 25 of 128

220 MHz respectively compared to the full polarization, parameterized beam

model.

SKA1-SYS_REQ-2629 Station beam stability

Station beam stability. The difference between the parameterized station beam

model and the actual station beam shall remain smaller than 1.3 %, 0.4 %, 0.6

% and 1.1 % relative to the main beam peak power, after calibration, at 50

MHz, 100 MHz, 160 MHZ and 220 MHz respectively

SKA1-SYS_REQ-2634 Calibration update rate

Calibration update rate. Calibration measurements shall be necessary at a rate

of no more than 10seconds.

SKA1-SYS_REQ-2635 Real time calibration

Real-time calibration. The LFAA reception system at station level shall

provide on-line instrumental calibration functions with an update rate of 10

minutes

SKA1-SYS_REQ-2724 Aperture Array DDE

Aperture Array DDE . There shall be a direction dependent model for the

aperture array primary beam to be used in calibration and imaging.

SKA1-SYS_REQ-2725 Faraday rotation DDE

Faraday rotation DDE. There shall be a direction dependent Faraday Rotation

model for use in calibration and imaging.

SKA1-SYS_REQ-2726 PAF DDE

PAF DDE. There shall be a direction dependent model for the dish phased

array feed sensitivity pattern to be used in calibration and imaging.

SKA1-SYS_REQ-2727 Dish DDE

Dish DDE. There shall be a direction dependent model for the dish primary

beam to be used in calibration and imaging.

SKA1-SYS_REQ-2729 Calibration and Imaging formalism

Calibration and imaging formalism. The Calibration and Imaging formalism

shall be based upon the Rau framework [14].

SKA1-SYS_REQ-2824 SKA1_Low Absolute flux scale

Absolute flux scale : The absolute flux scale shall be accurate to 5%

SKA1-SYS_REQ-2825 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms.

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

F.1.6.1 Solve

SDP_REQ-498 Fit model parameters

The calibration pipeline shall fit model parameters for the instrumental

and or sky models taking observed and predicted visibilities as input.

Page 26: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 26 of 128

F.1.6.2 Predict

SDP_REQ-501 Predict visibilities

The calibration pipeline shall produce visibilities by taking as input the

local sky model and instrument models.

F.1.6.3 Subtract (calibration)

SDP_REQ-497 Subtract (calibration)

The calibration pipeline shall be able to subtract observed and

predicted visibilities from each other.

F.1.6.4 Flag (calibration)

SDP_REQ-503 Flag (calibration)

The calibration pipeline shall be able to flag visibilities on the basis of

calibration solutions.

F.1.6.5 Correct

SDP_REQ-499 Correct

The calibration pipeline shall be able to correct for direction

independent effects.

F.1.7 Image Plane Spectral Averaging

SDP_REQ-404 Image plane spectral averaging

The continuum pipeline shall perform cube averaging of frequency channels

post-imaging to avoid smearing effects and accommodate quality assessment.

SDP_REQ-405 Image plane averaging 2

The continuum pipeline shall provide optional re-projection of data.

F.1.8 Specify continuum pipeline

To specify the combinations of processing tasks and their parameters to be

done to produce continuum image cubes

F.1.9 Execute continuum pipeline

To execute processing tasks for continuum imaging

F.1.10 Continuum pipeline buffering

To store intermediate data products (visibilities and grids) during iterative

processing for continuum imaging.

SDP_REQ-618 Tranfer images from archive to buffer

The Data Layer shall be able to transfer image cubes from the science data

archive to the buffer for further processing.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

Page 27: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 27 of 128

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

Page 28: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 28 of 128

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.11 Continuum pipeline data transport

To transport data between processing tasks of the continuum imaging

pipeline.

SDP_REQ-617 Restore images from archive to buffer

The SDP shall be able to restore image cubes from the science data archive to

the buffer in order to produce image cubes combining multiple cubes from

previously processed data.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

Page 29: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 29 of 128

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.12 Continuum Source Finding

SDP_REQ-507 Calibration Source Finding

The science analysis pipeline shall find the location of bright sources of

emission for use in the sky model.

F.1.12.1 Fast Point Source Detection

F.2 Spectral line Imaging

To make science-ready image cubes with high or moderate spectral resolution.

SDP_REQ-372 Early science processing capability

The SDP shall support per telescope early science processing rates 10% of those

required for full observing, as described in the SDP construction plan.

Page 30: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 30 of 128

SDP_REQ-387 Spectral line emission pipeline

The SDP shall provide a Spectral Line Emission pipeline that constructs channel

cubes of spectral line emission either with continuum emission remaining or with

continuum emission removed.

SDP_REQ-388 Spectral line absorption pipeline

The SDP shall provide a Spectral Line Absorption pipeline that constructs channel

cubes of spectral line absorption with continuum sources removed.

SDP_REQ-467 Perform Imaging Pipeline Automatic QA

The Imaging Pipeline shall perform standardised, automated Quality Assessment of

Images along the axes of astrometry, photometry, radiometry, polarimetry, and

spectrometry.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2134 Electromagnetic frequency range.

Electromagnetic frequency range. SKA1_Low shall be able to measure

electromagnetic radiation in a frequency range from 50 MHz to 350 MHz.

SKA1-SYS_REQ-2140 SKA1_Low station diameter

SKA1_Low station diameter . The station diameter will be 35 metres, which is

consistent with being able to provide a single, circularly symmetric, beam of 5

degrees at the half-power points at 100 MHz (centre of the EoR frequency range)

while meeting the sensitivity requirements with 256 antennas per station evenly

distributed in an irregular-random configuration.

SKA1-SYS_REQ-2142 SKA1_Low number of stations.

SKA1_L ow number of stations . The SKA1_Low shall comprise of 1024 stations.

SKA1-SYS_REQ-2147 Instantaneous bandwidth.

Instantaneous bandwidth. The SKA1_Low shall be capable of simultaneously

processing 300 MHz of bandwidth.

SKA1-SYS_REQ-2148 SKA1_Low channelisation

SKA1_Low channelisation. The SKA1_Low channelisation for each sub array shall

provide up to 256,000 linearly spaced frequency channels across the available

frequency range of each band.

SKA1-SYS_REQ-2153 Diameter

Diameter. SKA1 dishes shall have a projected diameter of larger than or equal to 15m

and smaller than 16.5m.

SKA1-SYS_REQ-2165 Polarisation Purity

Polarisation Purity. The IXR shall be better than 15 dB over the whole observing

bandwidth within the HPBW

SKA1-SYS_REQ-2173 MeerKAT array

Page 31: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 31 of 128

MeerKAT array. The monitor and control functions of MeerKAT shall be made

available to SKA1_Mid via a Foreign Telescope interface consisting of a Local

Monitor and Control system connected to the SKA1_Mid Telescope Manager.

SKA1-SYS_REQ-2174 Combined SKA1_Mid configuration.

Combined SKA1 Mid Configuration. 42 % of the Combined SKA1_Mid shall be

within a radius of 400 m of the array centre.

SKA1-SYS_REQ-2178 Combined SKA1_Mid configuration

Combined SKA1_Mid configuration. 14 % of the combined SKA1_Mid array shall be

within a radius between 4,000m and 100,000 m of the array centre.

SKA1-SYS_REQ-2185 RF system sampled bandwidth band 1

RF system sampled bandwidth band 1. The instantaneous bandwidth for band 1 will

be 700MHz and shall be sampled to at least 2.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2186 RF system sampled bandwidth band 2

RF system sampled bandwidth band 2. The instantaneous bandwidth for band 2 will

be 810 MHz and shall be sampled to at least 2.0 G sample per second for each

polarisation.

SKA1-SYS_REQ-2187 RF system sampled bandwidth band 3

RF system sampled bandwidth band 3 The instantaneous bandwidth for band 3 will be

1,403 MHz and shall be sampled to at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2188 RF system sampled bandwidth band 4

RF system sampled bandwidth band 4 The instantaneous bandwidth for band 4 will be

2,380 MHz and shall be sampled at at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2189 RF system sampled bandwidth band 5

RF system sampled bandwidth band 5 The SKA_Mid, for band 5, shall digitise two

separate 2.5 GHz bands for each polarisation.

SKA1-SYS_REQ-2195 SKA1_Mid channelisation

SKA1_Mid channelisation. The SKA1_Mid channelisation for each sub array shall

provide up to 256, 000 linearly spaced frequency channels across the sampled

bandwidth of each band.

SKA1-SYS_REQ-2236 SKA1_Survey configuration

SKA1_Survey configuration. 22% of the SKA1_Survey array shall be within a radius

of 4,000 m and 25,000 m of the array centre

SKA1-SYS_REQ-2238 RF system frequency range PAF band 1

RF system frequency range PAF band 1 The SKA1_Survey PAF for band 1 shall have

a frequency range from 350 to 900 MHz for each polarisation.

SKA1-SYS_REQ-2239 RF system frequency range PAF band 2

RF system frequency range PAF band 2 The SKA1_Survey PAF for band 2 shall have

a frequency range from 0.650 to 1.670 GHz for each polarisation.

SKA1-SYS_REQ-2240 RF system frequency range PAF band 3

RF system frequency range PAF band 3. The SKA1_Survey PAF for band 3 shall

have a frequency range from 1.500 to RF system frequency range PAF band 3 The

Page 32: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 32 of 128

SKA1_Survey PAF for band 3 shall have a frequency range from 1.500 to 4.000 GHz

for each polarisation.

SKA1-SYS_REQ-2241 Maximum available bandwidth

Maximum available bandwidth The SKA1_Survey shall have a PAF bandwidth of at

least 500 MHz for each polarisation and beam

SKA1-SYS_REQ-2242 SKA1_Survey digitised bandwidth

SKA1_Survey digitised bandwidth The SKA1_Survey digitised bandwidth for each

PAF shall be greater than 500 MHz for each polarisation.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the element

signals in each band to provide 36 full bandwidth, dual polarisation beams per

antenna.

SKA1-SYS_REQ-2250 SKA1_Survey channelisation.

SKA1_Survey channelisation. The SKA1_Survey channelisation shall provide 256,

000 linearly spaced frequency channels across the frequency band of each PAF band.

SKA1-SYS_REQ-2252 SKA1_Survey correlator dump period.

SKA1_Survey correlator dump period. The SKA1_Survey correlator shall have a

programmable dump period in the range 3 seconds to 0.3 seconds

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey array

shall have an imaging dynamic range of greater than:band 1: 55dB for a 1000 hour

single-field integrationband 2: 56dB for a 1000 hour single-field integrationband 3:

54dB for a 1000 hour single-field integration.

SKA1-SYS_REQ-2259 SKA1_Survey spectral dynamic range.

SKA1_Survey spectral dynamic range. The spectral dynamic range for SKA1_Survey

shall be better than 30dB between adjacent channels and 60dB globally.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the 36

ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2263 SKA1_Survey single array operation.

SKA1_Survey single array operation . SKA1-Survey shall be capable of operating

ASKAP and SKA1 dishes as single array for frequency band 2.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame independent

of parallactic angle.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by comparison of

observed with GSM predictions with a time scale appropriate to the component and

physical effect being calibrated and fed back to the telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction algorithms

shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Page 33: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 33 of 128

Global sky model. Calibration and continuum subtraction shall use a Local Sky

Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use of

frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2328 Solution for pointing errors.

Solution for pointing errors. It shall be possible to solve for and correct time- and

station-dependent pointing errors with accuracy and timescale limited by signal to

noise ratio.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the pipeline

processing log, and Quality Assessment log.

SKA1-SYS_REQ-2341 Spectral line emission pipeline.

Spectral line emission pipeline. There shall be a Spectral Line Emission pipeline that

is optimised for constructing noise-limited (up to 1000h integration) channel cubes of

spectral line emission either with continuum emission remaining or with continuum

emission removed.

SKA1-SYS_REQ-2342 Spectral line emission data products.

Spectral line emission data products. The data products shall include spectral line

cube image, continuum model images, sensitivity image, and representative point

spread function.

SKA1-SYS_REQ-2343 Spectral line absorption pipeline.

Spectral line absorption pipeline. There shall be a Spectral Line Absorption pipeline

that is optimised for constructing noise-limited channel cubes of spectral line

absorption with continuum sources removed.

SKA1-SYS_REQ-2344 Spectral line absorption data products.

Spectral line absorption data products. The data products shall include spectral line

cube image, continuum model images, sensitivity image, and representative point

spread function.

SKA1-SYS_REQ-2724 Aperture Array DDE

Aperture Array DDE . There shall be a direction dependent model for the aperture

array primary beam to be used in calibration and imaging.

SKA1-SYS_REQ-2725 Faraday rotation DDE

Faraday rotation DDE. There shall be a direction dependent Faraday Rotation model

for use in calibration and imaging.

SKA1-SYS_REQ-2726 PAF DDE

PAF DDE. There shall be a direction dependent model for the dish phased array feed

sensitivity pattern to be used in calibration and imaging.

SKA1-SYS_REQ-2727 Dish DDE

Dish DDE. There shall be a direction dependent model for the dish primary beam to

be used in calibration and imaging.

SKA1-SYS_REQ-2729 Calibration and Imaging formalism

Calibration and imaging formalism. The Calibration and Imaging formalism shall be

based upon the Rau framework [14].

Page 34: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 34 of 128

SKA1-SYS_REQ-2824 SKA1_Low Absolute flux scale

Absolute flux scale : The absolute flux scale shall be accurate to 5%

SKA1-SYS_REQ-2825 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms.

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64 antennas

in both monitor and control and data collection functions.

SKA1-SYS_REQ-???? Mosiacking

Waiting for the description from Bojan.

F.1.1 RFI flagging and excision

To flag visibility data that are affected by RFI or instrumental glitches

SDP_REQ-476 Flag RFI

The SDP shall be capable of automatically flagging known and unknown RFI.

SDP_REQ-477 Excise RFI

The SDP shall be capable of automatically excising known and unknown RFI.

SDP_REQ-487 Flag Data

The ingest shall flag data indicated as bad by the Telescope Manager

SDP_REQ-488 Flag Lightning

The ingest pipeline shall flag RFI from lightning.

SDP_REQ-490 Data Quality

The ingest pipeline shall generate metrics (TBD) about the data quality during

flagging.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

F.1.4.1 Apply t-f flagger

F.1.1.1 Determine spatial filter weights

F.1.1.2 Apply Spatial filter

SDP_REQ-491 Spatial Filtering

The RFI mitigation step shall perform spatial filtering

SDP_REQ-495 Spatial Filter Weights

The Spatial Filtering step will set the weights for spatial filtering

F.1.1.3 Determine RFI detection threshhold

SDP_REQ-478 Detect RFI

The SDP shall be capable of detecting data that is corrupted by RFI.

SDP_REQ-486 Determine RFI Threshold

Page 35: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 35 of 128

The RFI detection will determine the RFI detection threshold

SDP_REQ-489 Covariance Matrices

The ingest pipeline shall compute the appropriate types of covariance

matrices needed to improve the robustness of RFI mitigation

F.1.2 Store LSM

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

Page 36: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 36 of 128

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.3 Forward Estimate

To estimate a trial sky image cube from visibility data

F.1.4 Deconvolution

To deconvolve the data for the interferometer instrumental response by

subtracting a sky model from the visibility data

SDP_REQ-397 Imager

The imaging pipeline shall provide a clean map image, clean beam image,

clean component map image and residual map image (or the equivalent set of

image cubes in the case of spectral line).

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a clean

map image, clean beam image, clean component map image and residual map

image (or the equivalent set of image cubes in the case of spectral line).

SDP_REQ-447 Major and minor deconvolution cycles

The deconvolution step shall contain a major and a minor cycle

SDP_REQ-504 Scale sensitive deconvolution

The SDP shall provide scale sensitive two-dimensional (i.e. on the tangent

plane) deconvolution.

SKA1-SYS_REQ-2325 Scale sensitive deconvolution

Page 37: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 37 of 128

Deconvolution of single channels Scale sensitive two-dimensional (i.e. on the

tangent plane) deconvolution shall be available.

F.1.4.1 Apply t-f flagger

F.1.4.2 Subtract Component in Image Plane

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.3 Identify Component

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.4 iFFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.5 De-gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.6 Subtract from uv-data

SDP_REQ-396 LSM subtraction

The Continuum pipeline shall subtract the current local sky model

from the averaged visibilities.

F.1.4.7 Gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

Page 38: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 38 of 128

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.8 FFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.9 Major Cycle Loop

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.2.5 Initial Calibration (high spectral resolution)

To apply correction for known instrumental or atmospheric effect that are

relevant at high spectral resolution

F.2.6 Calibration (high spectral resolution)

To solve for instrumental or atmospheric effects relevant at high spectral

resolution by comparing model and observed data

F.2.7 Spectral Line Source Finding

To estimated a spectral-line model for the sky a residual spectral cube by

image-plane deconvolution

F.2.8 Spectral line pipeline buffering

To store intermediate data products (visibilities and grids) during iterative

processing for spectral line imaging.

SDP_REQ-618 Tranfer images from archive to buffer

The Data Layer shall be able to transfer image cubes from the science data

archive to the buffer for further processing.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

Page 39: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 39 of 128

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

Page 40: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 40 of 128

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.2.9 Spectral line pipeline data transport

To transport data between processing tasks of the spectral line pipeline.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

Page 41: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 41 of 128

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.2.10 Postage Stamp Selection

SDP_REQ-600 Postage Stamp Selection

The spectral line pipelines shall be able to image multiple pre-determined

areas smaller than the full field of view within a single pointing.

F.2.10.1 uv Plane Averaging

SDP_REQ-395 Additional Visibility Averaging

The continuum pipeline shall perform optional additional visibility

averaging to reduce computational load.

SDP_REQ-405 Image plane averaging 2

The continuum pipeline shall provide optional re-projection of data.

F.2.10.2 Phase Rotation

SDP_REQ-448 Phase Rotation

The spectral line pipelines shall rotate the visibility phase centre to a

given direction within the field of view.

Page 42: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 42 of 128

F.2.11 Continuum Subtraction

Continuum subtraction on full resolution spectral cubes

SDP_REQ-601 Continuum Subtraction

The spectral line pipelines shall have the ability to remove continuum

structure based on the products of the continuum imaging pipeline.

F.2.12 Specify spectral line pipeline

To specify the combinations of processing tasks and their parameters for

producing spectral line data products

F.2.13 Execute spectral line pipeline

To execute processing tasks for spectral line imaging

F.3 Ingest Data

To receive, store or forward data from CSP (and other sources) and prepares data for

further processing. (This will satisfy requirements for doing EoR).

SDP_REQ-372 Early science processing capability

The SDP shall support per telescope early science processing rates 10% of those

required for full observing, as described in the SDP construction plan.

SDP_REQ-437 SKA1_Survey inclusion of ASKAP.

The SDP shall process data from the SKA1_Survey FoV including the 36 ASKAP

antennas including both monitor and control and data collection functions.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2128 Continuum and spectral line imaging mode.

Continuum and spectral line imaging mode. All three SKA1 telescopes shall be

capable of operating in a Continuum and Spectral-line imaging mode concurrently.

SKA1-SYS_REQ-2133 Mode transition

Mode transition. The switching time between telescope operating modes shall take

less than 30 seconds (not including antenna slewing time)

SKA1-SYS_REQ-2134 Electromagnetic frequency range.

Electromagnetic frequency range. SKA1_Low shall be able to measure

electromagnetic radiation in a frequency range from 50 MHz to 350 MHz.

SKA1-SYS_REQ-2140 SKA1_Low station diameter

SKA1_Low station diameter . The station diameter will be 35 metres, which is

consistent with being able to provide a single, circularly symmetric, beam of 5

degrees at the half-power points at 100 MHz (centre of the EoR frequency range)

while meeting the sensitivity requirements with 256 antennas per station evenly

distributed in an irregular-random configuration.

SKA1-SYS_REQ-2142 SKA1_Low number of stations.

SKA1_L ow number of stations . The SKA1_Low shall comprise of 1024 stations.

Page 43: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 43 of 128

SKA1-SYS_REQ-2147 Instantaneous bandwidth.

Instantaneous bandwidth. The SKA1_Low shall be capable of simultaneously

processing 300 MHz of bandwidth.

SKA1-SYS_REQ-2148 SKA1_Low channelisation

SKA1_Low channelisation. The SKA1_Low channelisation for each sub array shall

provide up to 256,000 linearly spaced frequency channels across the available

frequency range of each band.

SKA1-SYS_REQ-2150 SKA1_Low correlator Integration rate.

SKA1_Low correlator Integration rate . T he SKA1_Low correlator for each sub array

shall have independently configurable visibility integration periods in the range 6s to

0.6s.

SKA1-SYS_REQ-2153 Diameter

Diameter. SKA1 dishes shall have a projected diameter of larger than or equal to 15m

and smaller than 16.5m.

SKA1-SYS_REQ-2165 Polarisation Purity

Polarisation Purity. The IXR shall be better than 15 dB over the whole observing

bandwidth within the HPBW

SKA1-SYS_REQ-2173 MeerKAT array

MeerKAT array. The monitor and control functions of MeerKAT shall be made

available to SKA1_Mid via a Foreign Telescope interface consisting of a Local

Monitor and Control system connected to the SKA1_Mid Telescope Manager.

SKA1-SYS_REQ-2174 Combined SKA1_Mid configuration.

Combined SKA1 Mid Configuration. 42 % of the Combined SKA1_Mid shall be

within a radius of 400 m of the array centre.

SKA1-SYS_REQ-2178 Combined SKA1_Mid configuration

Combined SKA1_Mid configuration. 14 % of the combined SKA1_Mid array shall be

within a radius between 4,000m and 100,000 m of the array centre.

SKA1-SYS_REQ-2185 RF system sampled bandwidth band 1

RF system sampled bandwidth band 1. The instantaneous bandwidth for band 1 will

be 700MHz and shall be sampled to at least 2.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2186 RF system sampled bandwidth band 2

RF system sampled bandwidth band 2. The instantaneous bandwidth for band 2 will

be 810 MHz and shall be sampled to at least 2.0 G sample per second for each

polarisation.

SKA1-SYS_REQ-2187 RF system sampled bandwidth band 3

RF system sampled bandwidth band 3 The instantaneous bandwidth for band 3 will be

1,403 MHz and shall be sampled to at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2188 RF system sampled bandwidth band 4

RF system sampled bandwidth band 4 The instantaneous bandwidth for band 4 will be

2,380 MHz and shall be sampled at at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2189 RF system sampled bandwidth band 5

Page 44: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 44 of 128

RF system sampled bandwidth band 5 The SKA_Mid, for band 5, shall digitise two

separate 2.5 GHz bands for each polarisation.

SKA1-SYS_REQ-2195 SKA1_Mid channelisation

SKA1_Mid channelisation. The SKA1_Mid channelisation for each sub array shall

provide up to 256, 000 linearly spaced frequency channels across the sampled

bandwidth of each band.

SKA1-SYS_REQ-2197 SKA1_Mid correlator integration rate.

SKA1_Mid correlation integration period. The SKA1_Mid shall have independently

configurable visibility integration period from a maximum integration time of 0.8s to

a minimum of 0.08s for each subarray.

SKA1-SYS_REQ-2236 SKA1_Survey configuration

SKA1_Survey configuration. 22% of the SKA1_Survey array shall be within a radius

of 4,000 m and 25,000 m of the array centre

SKA1-SYS_REQ-2238 RF system frequency range PAF band 1

RF system frequency range PAF band 1 The SKA1_Survey PAF for band 1 shall have

a frequency range from 350 to 900 MHz for each polarisation.

SKA1-SYS_REQ-2239 RF system frequency range PAF band 2

RF system frequency range PAF band 2 The SKA1_Survey PAF for band 2 shall have

a frequency range from 0.650 to 1.670 GHz for each polarisation.

SKA1-SYS_REQ-2240 RF system frequency range PAF band 3

RF system frequency range PAF band 3. The SKA1_Survey PAF for band 3 shall

have a frequency range from 1.500 to RF system frequency range PAF band 3 The

SKA1_Survey PAF for band 3 shall have a frequency range from 1.500 to 4.000 GHz

for each polarisation.

SKA1-SYS_REQ-2241 Maximum available bandwidth

Maximum available bandwidth The SKA1_Survey shall have a PAF bandwidth of at

least 500 MHz for each polarisation and beam

SKA1-SYS_REQ-2242 SKA1_Survey digitised bandwidth

SKA1_Survey digitised bandwidth The SKA1_Survey digitised bandwidth for each

PAF shall be greater than 500 MHz for each polarisation.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the element

signals in each band to provide 36 full bandwidth, dual polarisation beams per

antenna.

SKA1-SYS_REQ-2250 SKA1_Survey channelisation.

SKA1_Survey channelisation. The SKA1_Survey channelisation shall provide 256,

000 linearly spaced frequency channels across the frequency band of each PAF band.

SKA1-SYS_REQ-2252 SKA1_Survey correlator dump period.

SKA1_Survey correlator dump period. The SKA1_Survey correlator shall have a

programmable dump period in the range 3 seconds to 0.3 seconds

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey array

shall have an imaging dynamic range of greater than:band 1: 55dB for a 1000 hour

single-field integrationband 2: 56dB for a 1000 hour single-field integrationband 3:

54dB for a 1000 hour single-field integration.

Page 45: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 45 of 128

SKA1-SYS_REQ-2259 SKA1_Survey spectral dynamic range.

SKA1_Survey spectral dynamic range. The spectral dynamic range for SKA1_Survey

shall be better than 30dB between adjacent channels and 60dB globally.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the 36

ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2264 SKA1_Survey sub-arraying.

SKA1_Survey sub-arraying. It shall be possible to split the SKA1_Survey array into

independent operable ASKAP and SKA1 dish sub-arrays.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame independent

of parallactic angle.

SKA1-SYS_REQ-2285 Latency of TOO scheduling block initiation.

Latency of TOO scheduling block initiation . Scheduling intervention on TOO

triggers shall be initiated within 1s of receiving the trigger.

SKA1-SYS_REQ-2286 Discard previous scheduling block.

Discard previous scheduling block . At the launching of a TOO Scheduling Block, the

results from any active Scheduling Blocks shall be discarded.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by comparison of

observed with GSM predictions with a time scale appropriate to the component and

physical effect being calibrated and fed back to the telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction algorithms

shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local Sky

Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use of

frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the pipeline

processing log, and Quality Assessment log.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will convert the

output data from the CSP into science data products to be stored in the science data

archive.

SKA1-SYS_REQ-2472 RFI flagging

RFI flagging. The SKA1 telescopes shall automatically flag frequency data with a

resolution of one channel and time data to the resolution of the integration unit if the

data is corrupted by RFI.

SKA1-SYS_REQ-2473 RFI excision

Page 46: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 46 of 128

RFI excision. The SKA1 Telescopes shall automatically excise data that is corrupted

by RFI.

SKA1-SYS_REQ-2474 RFI masking

RFI masking. The SKA1 Telescopes shall flag data according to a pre-selected RFI

Mask.

SKA1-SYS_REQ-2640 Clipped Data Flagging

Clipped data flagging. Clipped data shall be flagged accordingly within the data

stream .

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64 antennas

in both monitor and control and data collection functions.

F.3.1 Integrate in time and frequency

SDP_REQ-502 Ingest Pipeline

The SDP shall have an ingest pipeline to condition the input data.

SDP_REQ-526 Average Input Data In Time

Pulsar Timing Post Processing shall be able to average input data in time using

a weighted sum of sub-integrations with precomputed weights.

F.3.1.1 Send (u,v) data to Calibration function

F.3.1.2 Compress

F.3.1.3 Integrate in time and frequency (base-line dependant)

SDP_REQ-480 Integrate Data

The SDP shall be capable of integrating data in time and/or frequency.

F.3.1.4 Transpose, reorder

F.1.1 RFI flagging and excision

To flag visibility data that are affected by RFI or instrumental glitches

SDP_REQ-476 Flag RFI

The SDP shall be capable of automatically flagging known and unknown RFI.

SDP_REQ-477 Excise RFI

The SDP shall be capable of automatically excising known and unknown RFI.

SDP_REQ-487 Flag Data

The ingest shall flag data indicated as bad by the Telescope Manager

SDP_REQ-488 Flag Lightning

The ingest pipeline shall flag RFI from lightning.

SDP_REQ-490 Data Quality

The ingest pipeline shall generate metrics (TBD) about the data quality during

flagging.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

F.1.4.1 Apply t-f flagger

F.1.1.1 Determine spatial filter weights

F.1.1.2 Apply Spatial filter

SDP_REQ-491 Spatial Filtering

Page 47: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 47 of 128

The RFI mitigation step shall perform spatial filtering

SDP_REQ-495 Spatial Filter Weights

The Spatial Filtering step will set the weights for spatial filtering

F.1.1.3 Determine RFI detection threshhold

SDP_REQ-478 Detect RFI

The SDP shall be capable of detecting data that is corrupted by RFI.

SDP_REQ-486 Determine RFI Threshold

The RFI detection will determine the RFI detection threshold

SDP_REQ-489 Covariance Matrices

The ingest pipeline shall compute the appropriate types of covariance

matrices needed to improve the robustness of RFI mitigation

F.3.2 Receive and buffer (u,v) data

SDP_REQ-301 SDP ingest data rate

The SDP system shall ingest CSP data at TBD Gbps, while losing less than

TBD% (0.01%?) of the data.

SDP_REQ-470 Receive Data

The SDP shall receive the data packets from CSP in compliance with the CSP-

SDP ICD.

SDP_REQ-496 Set Weight

The Ingest Pipeline shall set the correct data weights

F.3.2.1 Buffer (u,v) data ~0.5s

SDP_REQ-471 Buffer Data

The Ingest Pipeline shall be capable of buffering the input data for the

purpose of receiving and aligning data from the CSP.

F.3.2.2 Receive (u,v) data from CSP

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Page 48: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 48 of 128

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

Page 49: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 49 of 128

F.3.3 Handle missing and out of order packets

F.3.3.1 Detect missing packets

SDP_REQ-472 Handle Missing Data

The SDP shall be capable of handling missing data packets coming

from CSP.

SDP_REQ-483 Missing Data

The HandleMissingData step will be able to detect missing data

packets

F.3.3.2 Order (u,v) data over time

SDP_REQ-482 Order UV Data

The ingest pipeline will be able to order (u,v) data over time.

F.3.5 Merge Metadata from TM

F.3.5.1 Input Metadata from TM

SDP_REQ-484 Input Meta Data

The ingest pipeline will be capable of ingesting metadata from the

Telescope Manager.

F.3.5.2 Merge missing packet info with TM metadata

SDP_REQ-473 Merge Meta Data

The SDP shall merge the metadata stream from the Telescope Manager

with the data stream from CSP.

F.3.6 Strong source removal

SDP_REQ-479 Remove Sources

The SDP shall be capable of removing strong sources at high data resolution.

F.3.7 Receive and Apply Initial Calibration (optional)

Optional. Only needed if initial calibration needs to be one on full resolution

data (related to F.5.1 Initial calibration).

SDP_REQ-417 Calibration pipeline.

SDP shall have a Calibration pipeline that derives current telescope parameters

using a recent observation and either a known or the most recent Global Sky

Model.

SDP_REQ-615 EoR Calibration Pipeline

The SDP shall provide a calibration pipeline for EoR purposes.

F.3.8 Phase Rotation

F.3.9 Partial gather and transpose

F.3.9.1 transpose data

SDP_REQ-475 Transpose Data

The ingest pipeline shall be capable of transposing data.

F.3.9.2 Combine time, frequency channels, baselines & polarisation

SDP_REQ-474 Gather Data

The ingest shall be capable of gathering data

SDP_REQ-485 Combine Data

The ingest pipeline shall be able to combine data based on time,

frequency channels, baselines and polarisation.

Page 50: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 50 of 128

F.3.10 Specify Ingest Pipeline

To specify the combinations of processing tasks and their parameters for

ingesting data.

F.3.11 Execute Ingest Pipeline

To execute processing tasks for ingesting data.

F.4 Real-time Calibration

To calculate calibration parameters in real-time for other elements of the SKA.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by comparison of

observed with GSM predictions with a time scale appropriate to the component and

physical effect being calibrated and fed back to the telescope.

SKA1-SYS_REQ-2338 Calibration pipeline.

Calibration pipeline. There shall be a Calibration pipeline that derives current

telescope parameters using a recent observation and a Global Sky Model, either a

known GSM or the most recent GSM.

SKA1-SYS_REQ-2634 Calibration update rate

Calibration update rate. Calibration measurements shall be necessary at a rate of no

more than 10seconds.

F.1.6.2 Predict

SDP_REQ-501 Predict visibilities

The calibration pipeline shall produce visibilities by taking as input the local

sky model and instrument models.

F.1.6.1 Solve

SDP_REQ-498 Fit model parameters

The calibration pipeline shall fit model parameters for the instrumental and or

sky models taking observed and predicted visibilities as input.

F.1.6.5 Correct

SDP_REQ-499 Correct

The calibration pipeline shall be able to correct for direction independent

effects.

F.1.6.4 Flag (calibration)

SDP_REQ-503 Flag (calibration)

The calibration pipeline shall be able to flag visibilities on the basis of

calibration solutions.

F.1.6.3 Subtract (calibration)

SDP_REQ-497 Subtract (calibration)

Page 51: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 51 of 128

The calibration pipeline shall be able to subtract observed and predicted

visibilities from each other.

F.5 Drift Scan Imaging

A technique which involves a continuously changing pointing centre and step-wise

changing phase centres, with the whole field then jointly deconvolved.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-???? Drift Scan Imaging

Waiting for the description from Bojan

F.1.1 RFI flagging and excision

To flag visibility data that are affected by RFI or instrumental glitches

SDP_REQ-476 Flag RFI

The SDP shall be capable of automatically flagging known and unknown RFI.

SDP_REQ-477 Excise RFI

The SDP shall be capable of automatically excising known and unknown RFI.

SDP_REQ-487 Flag Data

The ingest shall flag data indicated as bad by the Telescope Manager

SDP_REQ-488 Flag Lightning

The ingest pipeline shall flag RFI from lightning.

SDP_REQ-490 Data Quality

The ingest pipeline shall generate metrics (TBD) about the data quality during

flagging.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

F.1.4.1 Apply t-f flagger

F.1.1.1 Determine spatial filter weights

F.1.1.2 Apply Spatial filter

SDP_REQ-491 Spatial Filtering

The RFI mitigation step shall perform spatial filtering

SDP_REQ-495 Spatial Filter Weights

The Spatial Filtering step will set the weights for spatial filtering

F.1.1.3 Determine RFI detection threshhold

SDP_REQ-478 Detect RFI

The SDP shall be capable of detecting data that is corrupted by RFI.

SDP_REQ-486 Determine RFI Threshold

The RFI detection will determine the RFI detection threshold

SDP_REQ-489 Covariance Matrices

The ingest pipeline shall compute the appropriate types of covariance

matrices needed to improve the robustness of RFI mitigation

Page 52: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 52 of 128

F.1.2 Store LSM

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

Page 53: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 53 of 128

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.3 Forward Estimate

To estimate a trial sky image cube from visibility data

F.1.4 Deconvolution

To deconvolve the data for the interferometer instrumental response by

subtracting a sky model from the visibility data

SDP_REQ-397 Imager

The imaging pipeline shall provide a clean map image, clean beam image,

clean component map image and residual map image (or the equivalent set of

image cubes in the case of spectral line).

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a clean

map image, clean beam image, clean component map image and residual map

image (or the equivalent set of image cubes in the case of spectral line).

SDP_REQ-447 Major and minor deconvolution cycles

The deconvolution step shall contain a major and a minor cycle

SDP_REQ-504 Scale sensitive deconvolution

The SDP shall provide scale sensitive two-dimensional (i.e. on the tangent

plane) deconvolution.

SKA1-SYS_REQ-2325 Scale sensitive deconvolution

Deconvolution of single channels Scale sensitive two-dimensional (i.e. on the

tangent plane) deconvolution shall be available.

Page 54: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 54 of 128

F.1.4.1 Apply t-f flagger

F.1.4.2 Subtract Component in Image Plane

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.3 Identify Component

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.4 iFFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.5 De-gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.6 Subtract from uv-data

SDP_REQ-396 LSM subtraction

The Continuum pipeline shall subtract the current local sky model

from the averaged visibilities.

F.1.4.7 Gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

Page 55: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 55 of 128

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.8 FFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.9 Major Cycle Loop

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.5 Initial Calibration (averaged data)

Initial calibration is already done in the ingest pipeline on full resolution data.

This function exists in case initial calibration needs to be done on averaged

data.

SDP_REQ-417 Calibration pipeline.

SDP shall have a Calibration pipeline that derives current telescope parameters

using a recent observation and either a known or the most recent Global Sky

Model.

F.1.6.5 Correct

SDP_REQ-499 Correct

The calibration pipeline shall be able to correct for direction

independent effects.

F.1.6 Calibration

Skip this step the first time its executed. (this is not shown in the diagram to

reduce complexity)

SDP_REQ-278 Local sky model

The SDP shall use a Local Sky Model, derived from a Global Sky Model or

previous Local Sky Model.

SDP_REQ-412 SKA1_Survey spectral dynamic range.

The SDP contribution to the spectral dynamic range for SKA1_Survey shall

be better than TBD between adjacent channels and TBD globally.

SDP_REQ-417 Calibration pipeline.

SDP shall have a Calibration pipeline that derives current telescope parameters

using a recent observation and either a known or the most recent Global Sky

Model.

SDP_REQ-424 Polarisation purity.

The SKA1_low station beams shall have a polarisation purity at the zenith

better than TBD after calibration.

SDP_REQ-430 Flux scale

The SDP shall preserve the absolute flux scale provided by the global sky

model.

Page 56: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 56 of 128

SDP_REQ-437 SKA1_Survey inclusion of ASKAP.

The SDP shall process data from the SKA1_Survey FoV including the 36

ASKAP antennas including both monitor and control and data collection

functions.

SDP_REQ-441 Automated Quality Assessment.

The SDP shall perform standardised, automated Quality Assessment of Images

along the axes of astrometry, photometry, radiometry, polarimetry, and

spectrometry.

SDP_REQ-442 Astrometric performance metric

The SDP Astrometric performance metric (APM) shall measure deviation

(rms, average offset, and med) of source positions from known standards.

SDP_REQ-443 Photometric performance metric

The SDP Photometric performance metric (PPM) shall measure deviation

(rms, average offset, and med) of source fluxes from known standards.

SDP_REQ-444 Radiometric performance metric

The SDP Radiometric performance metric (RPM) shall measure noise

fluctuations (rms, average offset, and med) in an Image..

SDP_REQ-445 Polarimetric performance metric

The SDP Polarimetric performance metric (OPM) shall measure deviation

(rms, average offset, and med) of source polarisations (polarisation degree and

angle) from known standards.

SDP_REQ-446 Spectrometric performance metric

The SDP Spectrometric performance metric (SPM) shall measure deviation

(rms, average offset, and med) of source spectral lines from known standards.

SDP_REQ-466 Perform Calibration Pipeline Automatic QA

The Calibration Pipeline shall perform standardised, automated Quality

Assessment of Images along the axes of astrometry, photometry, radiometry,

polarimetry, and spectrometry.

SDP_REQ-500 Self-calibration loop

The continuum pipeline shall be able to perform self-calibration in order to

achieve noise-limited performance.

SDP_REQ-536 Pulsar Timing Polarisation Calibration

Pulsar Timing Post Processing shall apply polarisation calibration parameters

provided by TM to pulsar timing data

SDP_REQ-553 Pulsar Timing Flux Calibration

Pulsar Timing Post Processing shall apply flux calibration parameters

provided by TM to pulsar timing data

SKA1-SYS_REQ-2128 Continuum and spectral line imaging mode.

Continuum and spectral line imaging mode. All three SKA1 telescopes shall

be capable of operating in a Continuum and Spectral-line imaging mode

concurrently.

SKA1-SYS_REQ-2158 Pointing repeatability.

Pointing repeatability. The pointing repeatability shall be better than 10 arc

seconds rms for winds < 7 m/s at night time.

Page 57: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 57 of 128

SKA1-SYS_REQ-2159 Pointing repeatability - Low wind / day time

Pointing repeatability . The pointing repeatability shall be better than 17 arc

seconds rms for an average wind speed of < 7 m/s in the day time

SKA1-SYS_REQ-2160 Pointing repeatability - Higher wind

Pointing repeatability. The pointing repeatability shall be better than 180 arc

seconds rms for an average wind speed between 7 and 20 m/s

SKA1-SYS_REQ-2173 MeerKAT array

MeerKAT array. The monitor and control functions of MeerKAT shall be

made available to SKA1_Mid via a Foreign Telescope interface consisting of

a Local Monitor and Control system connected to the SKA1_Mid Telescope

Manager.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the

element signals in each band to provide 36 full bandwidth, dual polarisation

beams per antenna.

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey

array shall have an imaging dynamic range of greater than:band 1: 55dB for a

1000 hour single-field integrationband 2: 56dB for a 1000 hour single-field

integrationband 3: 54dB for a 1000 hour single-field integration.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the

36 ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame

independent of parallactic angle.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by

comparison of observed with GSM predictions with a time scale appropriate to

the component and physical effect being calibrated and fed back to the

telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction

algorithms shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local

Sky Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use

of frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2328 Solution for pointing errors.

Solution for pointing errors. It shall be possible to solve for and correct time-

and station-dependent pointing errors with accuracy and timescale limited by

signal to noise ratio.

Page 58: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 58 of 128

SKA1-SYS_REQ-2330 Peeling.

Peeling. Peeling of bright sources (strength limited by signal to noise ratio)

from the visibility data shall be possible.

SKA1-SYS_REQ-2338 Calibration pipeline.

Calibration pipeline. There shall be a Calibration pipeline that derives current

telescope parameters using a recent observation and a Global Sky Model,

either a known GSM or the most recent GSM.

SKA1-SYS_REQ-2621 Spectral stability

Spectral stability: The spectral stability, on a time scale of 600 sec.,of the

station beam bandpass, post station calibration and RFI-mitigation, shall be

within 1.3 %, 0.4 %, 0.6 % and 1.1 % at 50 MHz, 100 MHz, 160 MHz, and

220 MHz respectively compared to the full polarization, parameterized beam

model.

SKA1-SYS_REQ-2629 Station beam stability

Station beam stability. The difference between the parameterized station beam

model and the actual station beam shall remain smaller than 1.3 %, 0.4 %, 0.6

% and 1.1 % relative to the main beam peak power, after calibration, at 50

MHz, 100 MHz, 160 MHZ and 220 MHz respectively

SKA1-SYS_REQ-2634 Calibration update rate

Calibration update rate. Calibration measurements shall be necessary at a rate

of no more than 10seconds.

SKA1-SYS_REQ-2635 Real time calibration

Real-time calibration. The LFAA reception system at station level shall

provide on-line instrumental calibration functions with an update rate of 10

minutes

SKA1-SYS_REQ-2724 Aperture Array DDE

Aperture Array DDE . There shall be a direction dependent model for the

aperture array primary beam to be used in calibration and imaging.

SKA1-SYS_REQ-2725 Faraday rotation DDE

Faraday rotation DDE. There shall be a direction dependent Faraday Rotation

model for use in calibration and imaging.

SKA1-SYS_REQ-2726 PAF DDE

PAF DDE. There shall be a direction dependent model for the dish phased

array feed sensitivity pattern to be used in calibration and imaging.

SKA1-SYS_REQ-2727 Dish DDE

Dish DDE. There shall be a direction dependent model for the dish primary

beam to be used in calibration and imaging.

SKA1-SYS_REQ-2729 Calibration and Imaging formalism

Calibration and imaging formalism. The Calibration and Imaging formalism

shall be based upon the Rau framework [14].

SKA1-SYS_REQ-2824 SKA1_Low Absolute flux scale

Absolute flux scale : The absolute flux scale shall be accurate to 5%

SKA1-SYS_REQ-2825 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms.

Page 59: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 59 of 128

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

F.1.6.1 Solve

SDP_REQ-498 Fit model parameters

The calibration pipeline shall fit model parameters for the instrumental

and or sky models taking observed and predicted visibilities as input.

F.1.6.2 Predict

SDP_REQ-501 Predict visibilities

The calibration pipeline shall produce visibilities by taking as input the

local sky model and instrument models.

F.1.6.3 Subtract (calibration)

SDP_REQ-497 Subtract (calibration)

The calibration pipeline shall be able to subtract observed and

predicted visibilities from each other.

F.1.6.4 Flag (calibration)

SDP_REQ-503 Flag (calibration)

The calibration pipeline shall be able to flag visibilities on the basis of

calibration solutions.

F.1.6.5 Correct

SDP_REQ-499 Correct

The calibration pipeline shall be able to correct for direction

independent effects.

F.1.7 Image Plane Spectral Averaging

SDP_REQ-404 Image plane spectral averaging

The continuum pipeline shall perform cube averaging of frequency channels

post-imaging to avoid smearing effects and accommodate quality assessment.

SDP_REQ-405 Image plane averaging 2

The continuum pipeline shall provide optional re-projection of data.

F.1.8 Specify continuum pipeline

To specify the combinations of processing tasks and their parameters to be

done to produce continuum image cubes

F.1.9 Execute continuum pipeline

To execute processing tasks for continuum imaging

F.1.10 Continuum pipeline buffering

To store intermediate data products (visibilities and grids) during iterative

processing for continuum imaging.

SDP_REQ-618 Tranfer images from archive to buffer

The Data Layer shall be able to transfer image cubes from the science data

archive to the buffer for further processing.

Page 60: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 60 of 128

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

Page 61: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 61 of 128

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.1.11 Continuum pipeline data transport

To transport data between processing tasks of the continuum imaging

pipeline.

SDP_REQ-617 Restore images from archive to buffer

The SDP shall be able to restore image cubes from the science data archive to

the buffer in order to produce image cubes combining multiple cubes from

previously processed data.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final

delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow

from the reception of raw data from CSP to the delivery of science

products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall

be capable of operating concurrently and independently. It shall be

possible to run additional instances of the data layer manager for other

purposes such as: commissioning, maintenance and simulation in

parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a

Local Sky Model, derived from a Global Sky Model or previous Local

Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Page 62: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 62 of 128

Role of science processing centres. The science-processing centre will

convert the output data from the CSP into science data products to be

stored in the science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of

data items through the various life cycle states starting from the

initial storage. This shall entail the migration of data items

between storage layers and include backup copies until the data

items become obsolete and are deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage

system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of

the data locality based on the specific performance and I/O

work load at runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves

data between high-cost and low-cost storage media for

optimised performance

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality

to other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be

independent of the physical schema of the underlying compute

infrastructure.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

Page 63: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 63 of 128

F.1.12 Continuum Source Finding

SDP_REQ-507 Calibration Source Finding

The science analysis pipeline shall find the location of bright sources of

emission for use in the sky model.

F.1.12.1 Fast Point Source Detection

F.6 Science Analysis

SDP_REQ-372 Early science processing capability

The SDP shall support per telescope early science processing rates 10% of those

required for full observing, as described in the SDP construction plan.

SDP_REQ-469 Perform Science Analysis Pipeline Automatic QA

The Science Analysis Pipeline shall perform standardised, automated Quality

Assessment of Images along the axes of astrometry, photometry, radiometry,

polarimetry, and spectrometry.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-2195 SKA1_Mid channelisation

SKA1_Mid channelisation. The SKA1_Mid channelisation for each sub array shall

provide up to 256, 000 linearly spaced frequency channels across the sampled

bandwidth of each band.

SKA1-SYS_REQ-2333 Continuum source finding.

Continuum source finding. Where appropriate, continuum source finding shall be

conducted on images generated by the Continuum Imaging pipeline. Polarization shall

be fitted if available.

SKA1-SYS_REQ-2334 Spectral line source finding.

Spectral line source finding. Where appropriate, spectral line source finding shall be

conducted on image cube generated by the Spectral Line pipeline.

SKA1-SYS_REQ-2335 Stacking.

Stacking. Where appropriate, spectral line stacking shall be conducted on image cubes

generated by the pipelines using a priori known source lists.

SKA1-SYS_REQ-???? Rotation Measure Synthesis

Placeholder requirement for RM synthesis.

F.6.1 Input Data Conditioning for Science Analysis

Interface to PIP.IMG

SDP_REQ-510 Science Analysis input data conditioning

The science analysis pipeline shall transform the images and cubes received

from the imaging pipelines into a form suitable for source detection and

characterisation.

F.6.1.1 Imaging Cube Gridding

SDP_REQ-520 Image Cube management

The science analysis pipeline shall transform image cubes so that each

frequency channel has consistent spatial scale.

Page 64: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 64 of 128

F.6.1.2 Image Processing Cadence

SDP_REQ-521 Image Cadence management

The science analysis pipeline shall combine real time updates of

images to form a composite image for source detection and

characterisation.

F.6.2 Source Analysis

SDP_REQ-514 Source Analysis (TBC)

The science analysis pipeline shall analyse sources...... TBD

F.6.2.1 Rotation Measure Synthesis

F.6.2.2 Spectral Line Profile Determination (delete)

SDP_REQ-515 Spectral Line Profile Determination

The science analysis pipeline shall extract the profile of sources

detected in image cubes.

F.6.2.3 Spectral Index Determination (delete)

SDP_REQ-509 Spectral Index Determination

The science analysis pipeline shall calculate the spectral indices of

detected continuum sources.

F.6.3 Source Finding

To convert the sky model into a data product.

SDP_REQ-511 Continuum Source Finding

The science analysis pipeline shall perform continuum source finding.

F.6.3.1 Point Source Detection

SDP_REQ-518 Point Source Detection

The science analysis pipeline shall locate point sources within images.

F.6.3.2 Spectral Line Source Detection

SDP_REQ-516 Spectral Line Source Detection

The science analysis pipeline shall locate sources of spectral line

emission in image cubes.

F.6.3.3 Extended Source Detection

SDP_REQ-508 Extended Source Detection

The science analysis pipeline shall locate extended sources within

images.

F.6.4 Stacking

SDP_REQ-512 Stacking

The science analysis pipeline shall perform stacking. Details TBD.

F.6.4.1 Continuum Stacking

SDP_REQ-519 Continuum Stacking

The science analysis pipeline shall perform stacking of continuum

sources. Details TBD.

F.6.4.2 H1 Stacking

SDP_REQ-513 H1 Stacking

The science analysis pipeline shall perform stacking of spectral line

sources. Details TBD

Page 65: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 65 of 128

F.7 Imaging Transient Search

SDP_REQ-372 Early science processing capability

The SDP shall support per telescope early science processing rates 10% of those

required for full observing, as described in the SDP construction plan.

SDP_REQ-389 Slow transient pipeline

The SDP shall provide a Slow Transient imaging pipeline that shall be capable of

constructing a continuum image after a GSM has been subtracted for every correlator

integration time or slower, searching for transient sources, and producing a time-

ordered catalog.

SDP_REQ-614 Numerical Precision

The scientific quality and usability of SDP outputs shall be no worse than if all of the

relevant processing steps inside the SDP were carried in double precision floating

point arithmetic.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2131 Transient search mode

Transient search mode . Each of the SKA1 telescopes shall be capable of operating in

a transient search mode TBC

SKA1-SYS_REQ-2134 Electromagnetic frequency range.

Electromagnetic frequency range. SKA1_Low shall be able to measure

electromagnetic radiation in a frequency range from 50 MHz to 350 MHz.

SKA1-SYS_REQ-2140 SKA1_Low station diameter

SKA1_Low station diameter . The station diameter will be 35 metres, which is

consistent with being able to provide a single, circularly symmetric, beam of 5

degrees at the half-power points at 100 MHz (centre of the EoR frequency range)

while meeting the sensitivity requirements with 256 antennas per station evenly

distributed in an irregular-random configuration.

SKA1-SYS_REQ-2142 SKA1_Low number of stations.

SKA1_L ow number of stations . The SKA1_Low shall comprise of 1024 stations.

SKA1-SYS_REQ-2147 Instantaneous bandwidth.

Instantaneous bandwidth. The SKA1_Low shall be capable of simultaneously

processing 300 MHz of bandwidth.

SKA1-SYS_REQ-2148 SKA1_Low channelisation

SKA1_Low channelisation. The SKA1_Low channelisation for each sub array shall

provide up to 256,000 linearly spaced frequency channels across the available

frequency range of each band.

SKA1-SYS_REQ-2153 Diameter

Diameter. SKA1 dishes shall have a projected diameter of larger than or equal to 15m

and smaller than 16.5m.

SKA1-SYS_REQ-2165 Polarisation Purity

Polarisation Purity. The IXR shall be better than 15 dB over the whole observing

bandwidth within the HPBW

Page 66: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 66 of 128

SKA1-SYS_REQ-2173 MeerKAT array

MeerKAT array. The monitor and control functions of MeerKAT shall be made

available to SKA1_Mid via a Foreign Telescope interface consisting of a Local

Monitor and Control system connected to the SKA1_Mid Telescope Manager.

SKA1-SYS_REQ-2174 Combined SKA1_Mid configuration.

Combined SKA1 Mid Configuration. 42 % of the Combined SKA1_Mid shall be

within a radius of 400 m of the array centre.

SKA1-SYS_REQ-2178 Combined SKA1_Mid configuration

Combined SKA1_Mid configuration. 14 % of the combined SKA1_Mid array shall be

within a radius between 4,000m and 100,000 m of the array centre.

SKA1-SYS_REQ-2185 RF system sampled bandwidth band 1

RF system sampled bandwidth band 1. The instantaneous bandwidth for band 1 will

be 700MHz and shall be sampled to at least 2.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2186 RF system sampled bandwidth band 2

RF system sampled bandwidth band 2. The instantaneous bandwidth for band 2 will

be 810 MHz and shall be sampled to at least 2.0 G sample per second for each

polarisation.

SKA1-SYS_REQ-2187 RF system sampled bandwidth band 3

RF system sampled bandwidth band 3 The instantaneous bandwidth for band 3 will be

1,403 MHz and shall be sampled to at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2188 RF system sampled bandwidth band 4

RF system sampled bandwidth band 4 The instantaneous bandwidth for band 4 will be

2,380 MHz and shall be sampled at at least 5.0 G samples per second for each

polarisation.

SKA1-SYS_REQ-2189 RF system sampled bandwidth band 5

RF system sampled bandwidth band 5 The SKA_Mid, for band 5, shall digitise two

separate 2.5 GHz bands for each polarisation.

SKA1-SYS_REQ-2195 SKA1_Mid channelisation

SKA1_Mid channelisation. The SKA1_Mid channelisation for each sub array shall

provide up to 256, 000 linearly spaced frequency channels across the sampled

bandwidth of each band.

SKA1-SYS_REQ-2236 SKA1_Survey configuration

SKA1_Survey configuration. 22% of the SKA1_Survey array shall be within a radius

of 4,000 m and 25,000 m of the array centre

SKA1-SYS_REQ-2238 RF system frequency range PAF band 1

RF system frequency range PAF band 1 The SKA1_Survey PAF for band 1 shall have

a frequency range from 350 to 900 MHz for each polarisation.

SKA1-SYS_REQ-2239 RF system frequency range PAF band 2

RF system frequency range PAF band 2 The SKA1_Survey PAF for band 2 shall have

a frequency range from 0.650 to 1.670 GHz for each polarisation.

SKA1-SYS_REQ-2240 RF system frequency range PAF band 3

RF system frequency range PAF band 3. The SKA1_Survey PAF for band 3 shall

have a frequency range from 1.500 to RF system frequency range PAF band 3 The

Page 67: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 67 of 128

SKA1_Survey PAF for band 3 shall have a frequency range from 1.500 to 4.000 GHz

for each polarisation.

SKA1-SYS_REQ-2241 Maximum available bandwidth

Maximum available bandwidth The SKA1_Survey shall have a PAF bandwidth of at

least 500 MHz for each polarisation and beam

SKA1-SYS_REQ-2242 SKA1_Survey digitised bandwidth

SKA1_Survey digitised bandwidth The SKA1_Survey digitised bandwidth for each

PAF shall be greater than 500 MHz for each polarisation.

SKA1-SYS_REQ-2247 SKA1_Survey number of beams.

SKA1_Survey number of beams. The SKA1_Survey shall beam-form the element

signals in each band to provide 36 full bandwidth, dual polarisation beams per

antenna.

SKA1-SYS_REQ-2250 SKA1_Survey channelisation.

SKA1_Survey channelisation. The SKA1_Survey channelisation shall provide 256,

000 linearly spaced frequency channels across the frequency band of each PAF band.

SKA1-SYS_REQ-2252 SKA1_Survey correlator dump period.

SKA1_Survey correlator dump period. The SKA1_Survey correlator shall have a

programmable dump period in the range 3 seconds to 0.3 seconds

SKA1-SYS_REQ-2256 SKA1_Survey imaging dynamic range.

SKA1_Survey imaging dynamic range – band 1. The SKA1_Survey array

shall have an imaging dynamic range of greater than:band 1: 55dB for a 1000 hour

single-field integrationband 2: 56dB for a 1000 hour single-field integrationband 3:

54dB for a 1000 hour single-field integration.

SKA1-SYS_REQ-2259 SKA1_Survey spectral dynamic range.

SKA1_Survey spectral dynamic range. The spectral dynamic range for SKA1_Survey

shall be better than 30dB between adjacent channels and 60dB globally.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the 36

ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2263 SKA1_Survey single array operation.

SKA1_Survey single array operation . SKA1-Survey shall be capable of operating

ASKAP and SKA1 dishes as single array for frequency band 2.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame independent

of parallactic angle.

SKA1-SYS_REQ-2319 Closed loop calibration.

Closed loop calibration. The telescope calibration shall be solved by comparison of

observed with GSM predictions with a time scale appropriate to the component and

physical effect being calibrated and fed back to the telescope.

SKA1-SYS_REQ-2321 Direction dependent effects.

Direction dependent effects. Self-calibration and image reconstruction algorithms

shall be capable of dealing with direction dependent effects.

SKA1-SYS_REQ-2322 Global sky model.

Page 68: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 68 of 128

Global sky model. Calibration and continuum subtraction shall use a Local Sky

Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2324 Multi-frequency synthesis imaging.

Multi-frequency synthesis imaging . All imaging shall construct and make use of

frequency dependent image models over the entire observed bandwidth.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the pipeline

processing log, and Quality Assessment log.

SKA1-SYS_REQ-2345 Slow transient pipeline.

Slow transient pipeline. There shall be a Slow Transient imaging pipeline that shall be

capable of constructing a continuum image after a GSM has been subtracted for every

correlator integration time or slower, searching for transient sources, and producing a

time-ordered catalogue.

SKA1-SYS_REQ-2346 Slow transient data products.

Slow transient data products. The data products shall include a catalogue of found

sources, a sensitivity image, and representative PSF image.

SKA1-SYS_REQ-2725 Faraday rotation DDE

Faraday rotation DDE. There shall be a direction dependent Faraday Rotation model

for use in calibration and imaging.

SKA1-SYS_REQ-2727 Dish DDE

Dish DDE. There shall be a direction dependent model for the dish primary beam to

be used in calibration and imaging.

SKA1-SYS_REQ-2824 SKA1_Low Absolute flux scale

Absolute flux scale : The absolute flux scale shall be accurate to 5%

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64 antennas

in both monitor and control and data collection functions.

F.7.2 Generate Alert for Transients

To generate an alert that a transient has been observed.

F.1.4 Deconvolution

To deconvolve the data for the interferometer instrumental response by

subtracting a sky model from the visibility data

SDP_REQ-397 Imager

The imaging pipeline shall provide a clean map image, clean beam image,

clean component map image and residual map image (or the equivalent set of

image cubes in the case of spectral line).

SDP_REQ-403 Deconvolution

Page 69: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 69 of 128

The deconvolution step shall transform the calibrated visibilities into a clean

map image, clean beam image, clean component map image and residual map

image (or the equivalent set of image cubes in the case of spectral line).

SDP_REQ-447 Major and minor deconvolution cycles

The deconvolution step shall contain a major and a minor cycle

SDP_REQ-504 Scale sensitive deconvolution

The SDP shall provide scale sensitive two-dimensional (i.e. on the tangent

plane) deconvolution.

SKA1-SYS_REQ-2325 Scale sensitive deconvolution

Deconvolution of single channels Scale sensitive two-dimensional (i.e. on the

tangent plane) deconvolution shall be available.

F.1.4.1 Apply t-f flagger

F.1.4.2 Subtract Component in Image Plane

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.3 Identify Component

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.4.4 iFFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.5 De-gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.6 Subtract from uv-data

SDP_REQ-396 LSM subtraction

Page 70: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 70 of 128

The Continuum pipeline shall subtract the current local sky model

from the averaged visibilities.

F.1.4.7 Gridding

SDP_REQ-398 Gridding & de-gridding

The continuum pipeline shall transform ungridded visibilities and

corresponding weights into gridded visibilities and corresponding

weights (and visa versa).

SDP_REQ-399 Anti-aliasing kernel

The gridding convolution kernel shall contain an anti-aliasing term.

SDP_REQ-400 w-kernel

The gridding convolution kernel shall contain a w-term (wide-field

effect).

SDP_REQ-401 A-kernel

The gridding convolution kernel shall contain an A-term representing

the receptor primary beam (direction-dependent effect).

F.1.4.8 FFT

SDP_REQ-402 Fourier Transform Algorithm

The continuum pipeline shall use a Fourier Transform algorithm to

transform data and weights between the image plane and visibility

plane (and visa versa).

F.1.4.9 Major Cycle Loop

SDP_REQ-403 Deconvolution

The deconvolution step shall transform the calibrated visibilities into a

clean map image, clean beam image, clean component map image and

residual map image (or the equivalent set of image cubes in the case of

spectral line).

F.1.12 Continuum Source Finding

SDP_REQ-507 Calibration Source Finding

The science analysis pipeline shall find the location of bright sources of

emission for use in the sky model.

F.1.12.1 Fast Point Source Detection

F.8 Non-Imaging Transient Post Processing

SDP_REQ-148 Non-imaging Transient Search Number of Beams

SDP, when in non-imaging transient search mode, shall be capable of performing

post-processing on up to a total of 2222 beams per observation.

SDP_REQ-468 Perform Non-Imaging Pipeline Automatic QA

The Non-Imaging Pipeline shall perform standardised, automated Quality Assessment

of [TBD]

SDP_REQ-532 Non-imaging Transient Post Processing

SDP shall be capable of operating in a non-imaging transient search mode,

concurrently with continuum imaging mode and periodicity search mode

F.8.1 Archive Transient Search Candidates

SDP_REQ-546 Non-imaging Transient Search Output

Page 71: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 71 of 128

SDP shall output a single ranked list of non-imaging transient candidates from

each observation

SDP_REQ-562 Non-imaging Transient Search Archive Products

Pulsar Search Post Processing shall archive all non-imaging transient

candidates recieved from CSP.

F.8.2 Merge SPOCLDs from multiple beams

SDP_REQ-554 Identify Multi-beam Candidates (transients)

Pulsar Search Post Processing shall determine how many beams each non-

imaging transient candidate is detected in and add that information to the

candidate data stream.

SDP_REQ-563 Merge Data from Multiple Beams (transients)

Pulsar Search Post Processing shall combine non-imaging transient candidates

from all beams received from CSP.

F.8.3 Generation and extraction of candidate heuristics

SDP_REQ-545 Extract non-imaging transient heuristics

Pulsar Search Post Processing shall generate a set of heuristics that can be

used to assign a probability to each non-imaging transient candidate.

SDP_REQ-559 Extract pulsar search heuristics

Periodicity Search Post Processing shall generate a set of heuristics that can be

used to assign a probability to each pulsar candidate.

F.8.4 Candidate Selection

SDP_REQ-557 Periodicity Search List Products

Pulsar Search Post Processing shall output a single ranked list of pulsar

candidates from each observation with data content described by TBD [SDP

data archive description document]

SDP_REQ-566 Non-imaging Transient List Products

Pulsar Search Post Processing shall output a single ranked list of pulsar

candidates from each observation with data content described by TBD [SDP

data archive description document]

F.8.5 Candidate Classification

SDP_REQ-547 Classify Candidates (pulsars)

Periodicity Search Post Processing shall classify pulsar candidates using a

classifier which achieves TBD values for false positives, false negatives,

accuracy, and ???

SDP_REQ-570 Classify Candidates (transients)

Pulsar Search Post Processing shall classify non-imaging transient candidates

using a classifier which achieves TBD values for false positives, false

negatives, accuracy and ???

F.8.6 Alert Generator

SDP_REQ-537 Response Rate for Pulsar Alerts

Preliminary alerts for pulsar discoveries shall be sent to the TM within 1 hour

of the candidate data having arrived at Pulsar Search Post Processing

SDP_REQ-541 False Alarm Rate for Pulsar Alerts

Page 72: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 72 of 128

Pulsar Search Post Processing shall alert the telescope manager of the

discovery of a pulsar with an average false alarm rate of better than (TBD) 1

per day.

SDP_REQ-544 Non-imaging Transient Alerts

SDP shall provide preliminary alerts for the detection of fast transient events

within 10s (TBC) of the data containing that event arriving at SDP.

SDP_REQ-564 Response Rate for Non-imaging Transients

Preliminary alerts for non-imaging transient events shall be sent to the TM

within 10 seconds of the candidate data having arrived at Pulsar Search Post

Processing

SDP_REQ-568 False Alarm Rate for Non-imaging Transients

Pulsar Search Post Processing shall alert the telescope manager of the

detection of a non-imaging transient event with an average false alarm rate of

better than (TBD) 1 per day.

F.9 Pulsar Timing Post Processing

SDP_REQ-468 Perform Non-Imaging Pipeline Automatic QA

The Non-Imaging Pipeline shall perform standardised, automated Quality Assessment

of [TBD]

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2130 Pulsar Timing Mode.

Pulsar Timing Mode. The SKA1_mid telescope shall be capable of operating in a

Pulsar timing mode, concurrently with continuum imaging mode.

SKA1-SYS_REQ-2201 Beam-former sub-array support.

Beam-former sub-array support. The SKA1_Mid central beam-former shall be able to

form beams or more beams for one to sixteen sub-arrays independently and

concurrently.

SKA1-SYS_REQ-2207 Number of beams: Pulsar timing.

Number of beams: Pulsar timing. The SKA1_Mid central beam-former for Pulsar

timing shall be capable of forming up to 16 dual polarisation coherent beams in total

across all timing sub-arrays.

SKA1-SYS_REQ-2208 Beamformer S/N ratio: Pulsar timing

Beamforming S/N ratio: Pulsar timing. The SKA1_Mid for Pulsar timing shall have a

Signal to Noise ratio greater or equal to 98% of an ideal analogue beam former.

SKA1-SYS_REQ-2224 Frequency agility.

Frequency agility. The SKA1_Mid system shall, for each timing sub-array, be able to

change from observing in any frequency band, to observing in any other frequency

band in less than or equal to 30 seconds.

SKA1-SYS_REQ-2230 Multiple timings.

Multiple timings. The SKA Phase 1 shall be capable of timing up to 16 pulsars

simultaneously in total across all timing sub arrays .

SKA1-SYS_REQ-2231 Pulsar timing Dispersion Measure

Page 73: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 73 of 128

Pulsar timing Dispersion Measure. The SKA1_Mid shall be capable of timing pulsars

with dispersion measures between 0 to 3000 pc cm -3 such that residual dispersive

smearing is less than 500 ns.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the pipeline

processing log, and Quality Assessment log.

SKA1-SYS_REQ-2738 CSP to SDP Interface

CSP to SDP interface . The interface between CSP and SDP shall be compliant with

the SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001 Interface Control Document

SKA1-SYS_REQ-2830 SKA1_Mid Pulsar phase bin width

SKA1_Mid Pulsar phase bin width. The SKA1_Mid shall be capable of providing

pulsar phase bin widths with a time resolution of better than 10us.

F.9.1 Pulsar Timing ToA Determination

SDP_REQ-529 Pulsar Timing Precision

When provided with a suitable template, signal-to-noise and pulsar

parameters, SDP shall be able to measure the arrival time of a pulse with a

precision of 5ns

SDP_REQ-530 Pulsar Timing ToA Determinination

SDP shall be capable of determining the time-of-arrival of a pulse from pulsar

timing data

SDP_REQ-542 Pulsar Timing Error Estimation

SDP shall be able to estimate the uncertainty in the arrival time of a pulse to

better than 5%

SDP_REQ-543 Pulsar Timing Systematic Error

SDP shall introduce no more than 5ns systematic error in the time-of-arrival

determination.

F.9.2 Pulsar Timing Data Preparation

SDP_REQ-524 Pulsar Timing Input

SDP shall be capable of receiving pulsar timing data in accordance with the

SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001 Interface Control Document.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

SDP_REQ-534 Pulsar Timing Data Preparation

SDP shall be capable of performing data pre-processing on pulsar timing data.

F.9.2.1 Data Receptor (Pulsar Timing)

SDP_REQ-548 Pulsar Timing Input Data Reception

Pulsar Timing Post Processing shall be able to receive at least 16

folded pulsar data streams per observation, from CSP

F.9.2.2 RFI mitigation

F.9.2.3 Calibration

F.9.2.4 Averaging

SDP_REQ-540 Average Input Data In Frequency To Given

Significance

Page 74: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 74 of 128

Pulsar Timing Post Processing shall be able to average input data in

time to increase the significance metric of the input data per sub-

integration to a precomputed value

SDP_REQ-549 Dynamic Range When Averaging Pulsar Profiles

Pulsar Timing Post Processing shall use at least 32 bits of precision

when averaging

SDP_REQ-561 Average Input Data In Time To Given Significance

Pulsar Timing Post Processing shall be able to average input data in

time to increase the significance metric of the input data per sub-band

to a precomputed value

SDP_REQ-569 Average Input Data In Frequency

Pulsar Timing Post Processing shall be able to average input data in

frequency using a weighted sum of sub-bands with precomputed

weights

F.9.2.5 Archive products generated

F.9.2.6 Data Receptor (Pulsar Search)

SDP_REQ-528 Pulsar Search Data Input Data Reception

Pulsar Search Post Processing shall be able to receive pulsar candidates

and associated data from CSP.

F.9.2.7 Data Receptor (Non-Imaging Transient Search)

SDP_REQ-539 Non-imaging Transient Input

SDP shall be capable of receiving non-imaging transient search data in

accordance with the SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001

Interface Control Document.

F.9.3 Pulsar Timing Model Fitting

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

SDP_REQ-565 Pulsar Timing Model Fitting

SDP shall be capable of fitting a pulsar timing model to pulsar times-of-arrival

F.9.3.1 Generate Residual

SDP_REQ-531 Generate Residual Output

Pulsar Timing Post Processing shall output residuals for each profile

from each observed pulsar.

SDP_REQ-551 Generate Residual Precision

Pulsar Timing Post Processing shall be able to compute the difference

(residual) between the measured arrival time of a pulse and that

predicted by a pulsar timing model without increasing the error budget

by more than 1 ns.

F.9.3.2 Append residuals to update model

SDP_REQ-538 Form Covariance Matrix of Residuals

Pulsar Timing Post Processing shall estimate the covariance matrix of

the residuals using a provided model of the noise processes in the

residuals

Page 75: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 75 of 128

SDP_REQ-550 Weighting Scheme for Pulsar Timing Model

Fitting

Pulsar Timing Post Processing shall use a covariance matrix to weight

the fit of the pulsar timing model.

SDP_REQ-555 Output of Pulsar Timing Model

Pulsar Timing Post Processing shall output an updated pulsar timing

model for each observed pulsar.

SDP_REQ-556 Update Timing Model

Pulsar Timing Post Processing shall compute an updated pulsar timing

model for each observed pulsar by performing a generalised fit to the

computed residuals, including those extracted from the archive that

have been computed from previous observations.

F.10 Pulsar Search Post Processing

To sieve pulsar candidates to find confirmed pulsars.

SDP_REQ-468 Perform Non-Imaging Pipeline Automatic QA

The Non-Imaging Pipeline shall perform standardised, automated Quality Assessment

of [TBD]

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of operating independently

with one to sixteen sub-arrays (i.e. collecting area is split and allocated to separate,

concurrently observing programmes).

SKA1-SYS_REQ-2129 Pulsar Search Mode.

Pulsar Search Mode . The SKA1_mid telescope shall be capable of operating in a

Pulsar search mode, concurrently with Continuum imaging mode.

SKA1-SYS_REQ-2131 Transient search mode

Transient search mode . Each of the SKA1 telescopes shall be capable of operating in

a transient search mode TBC

SKA1-SYS_REQ-2201 Beam-former sub-array support.

Beam-former sub-array support. The SKA1_Mid central beam-former shall be able to

form beams or more beams for one to sixteen sub-arrays independently and

concurrently.

SKA1-SYS_REQ-2203 Number of beams: Pulsar search

Number of beams: Pulsar search. SKA1_Mid, when performing the Pulsar Search

function, shall simultaneously form up to a total of 2222 beams per observation across

all sub arrays .

SKA1-SYS_REQ-2205 Beamformer S/N pulsar search

Beamformer S/N pulsar search. The SKA1_Mid central beam-forming for each sub

array shall have a Signal to Noise ratio greater or equal to 98% of ideal analogue

beam forming for the same sub array:

SKA1-SYS_REQ-2216 Time resolution

Time resolution. The time resolution of the SKA1_Mid pulsar search processing for

each sub-array shall be equivalent to the temporal smearing due to dispersion at the

observation frequency and bandwidth of the observation with a quantisation of value

in powers of 2 from 50 µs to 800 us

Page 76: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 76 of 128

SKA1-SYS_REQ-2220 Binary search

Binary search. For each Pulsar search sub-array within SKA1_Mid the processing

shall be capable of searching for binary systems with accelerations due to their orbital

motion of up to 350 ms -2 .

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the pipeline

processing log, and Quality Assessment log.

SKA1-SYS_REQ-2616 SKA1_Mid Pulsar phase binning

SKA1_Mid Pulsar phase binning. The SKA1_Mid, for each subarray, shall allow for

pulse phase-resolved observations supporting the product of the number of phase bins,

channel and polarisation products up to 1,000,000 (i.e. 4 x 256,000).

SKA1-SYS_REQ-2738 CSP to SDP Interface

CSP to SDP interface . The interface between CSP and SDP shall be compliant with

the SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001 Interface Control Document

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64 antennas

in both monitor and control and data collection functions.

F.9.1 Pulsar Timing ToA Determination

SDP_REQ-529 Pulsar Timing Precision

When provided with a suitable template, signal-to-noise and pulsar

parameters, SDP shall be able to measure the arrival time of a pulse with a

precision of 5ns

SDP_REQ-530 Pulsar Timing ToA Determinination

SDP shall be capable of determining the time-of-arrival of a pulse from pulsar

timing data

SDP_REQ-542 Pulsar Timing Error Estimation

SDP shall be able to estimate the uncertainty in the arrival time of a pulse to

better than 5%

SDP_REQ-543 Pulsar Timing Systematic Error

SDP shall introduce no more than 5ns systematic error in the time-of-arrival

determination.

F.10.1 Periodicity Search Post Processing

SDP_REQ-133 Periodicity Search Post Processing

SDP shall be capable of operating in a periodicity search mode, concurrently

with continuum imaging mode and non-imaging transient search mode.

SDP_REQ-147 Periodicity Search Number of Beams

SDP when in pulsar search mode, shall be capable of performing post-

processing on up to a total of 2222 beams per observation

SDP_REQ-527 Pulsar Search Data Input

SDP shall be capable of receiving pulsar periodicity search data in accordance

with the SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001 Interface Control

Document.

SDP_REQ-535 Non-imaging Transient Input Data

Page 77: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 77 of 128

Pulsar Search Post Processing shall be able to receive non-imaging transient

candidates and associated data from CSP.

SDP_REQ-552 Periodicity Search Alerts

SDP shall provide alerts for the probable discovery of pulsars within a TBD

timeframe of data potentially containing that pulsar arriving at the SDP.

SDP_REQ-558 Periodicity Search Output

SDP shall output a single ranked list of pulsar periodicity candidates from

each observation.

F.8.4 Candidate Selection

SDP_REQ-557 Periodicity Search List Products

Pulsar Search Post Processing shall output a single ranked list of pulsar

candidates from each observation with data content described by TBD

[SDP data archive description document]

SDP_REQ-566 Non-imaging Transient List Products

Pulsar Search Post Processing shall output a single ranked list of pulsar

candidates from each observation with data content described by TBD

[SDP data archive description document]

F.10.1.6 Archive Periodicity Search Candidates

SDP_REQ-567 Periodicity Search Archive Products

Pulsar Search Post Processing shall archive all periodicity search

candidates recieved from CSP.

F.8.6 Alert Generator

SDP_REQ-537 Response Rate for Pulsar Alerts

Preliminary alerts for pulsar discoveries shall be sent to the TM within

1 hour of the candidate data having arrived at Pulsar Search Post

Processing

SDP_REQ-541 False Alarm Rate for Pulsar Alerts

Pulsar Search Post Processing shall alert the telescope manager of the

discovery of a pulsar with an average false alarm rate of better than

(TBD) 1 per day.

SDP_REQ-544 Non-imaging Transient Alerts

SDP shall provide preliminary alerts for the detection of fast transient

events within 10s (TBC) of the data containing that event arriving at

SDP.

SDP_REQ-564 Response Rate for Non-imaging Transients

Preliminary alerts for non-imaging transient events shall be sent to the

TM within 10 seconds of the candidate data having arrived at Pulsar

Search Post Processing

SDP_REQ-568 False Alarm Rate for Non-imaging Transients

Pulsar Search Post Processing shall alert the telescope manager of the

detection of a non-imaging transient event with an average false alarm

rate of better than (TBD) 1 per day.

F.8.3 Generation and extraction of candidate heuristics

SDP_REQ-545 Extract non-imaging transient heuristics

Page 78: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 78 of 128

Pulsar Search Post Processing shall generate a set of heuristics that can

be used to assign a probability to each non-imaging transient

candidate.

SDP_REQ-559 Extract pulsar search heuristics

Periodicity Search Post Processing shall generate a set of heuristics

that can be used to assign a probability to each pulsar candidate.

F.8.5 Candidate Classification

SDP_REQ-547 Classify Candidates (pulsars)

Periodicity Search Post Processing shall classify pulsar candidates

using a classifier which achieves TBD values for false positives, false

negatives, accuracy, and ???

SDP_REQ-570 Classify Candidates (transients)

Pulsar Search Post Processing shall classify non-imaging transient

candidates using a classifier which achieves TBD values for false

positives, false negatives, accuracy and ???

F.10.1.1 Merge OCLDs from multiple beams

SDP_REQ-533 Merge Data from Multiple Beams

Pulsar Search Post Processing shall combine periodicity search

candidates from all beams received from CSP.

SDP_REQ-560 Identify multi-beam candidates

Pulsar Search Post Processing shall determine how many beams each

pulsar candidate is detected in and add that information to the

candidate data stream.

F.9.2 Pulsar Timing Data Preparation

SDP_REQ-524 Pulsar Timing Input

SDP shall be capable of receiving pulsar timing data in accordance with the

SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001 Interface Control Document.

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

SDP_REQ-534 Pulsar Timing Data Preparation

SDP shall be capable of performing data pre-processing on pulsar timing data.

F.9.2.1 Data Receptor (Pulsar Timing)

SDP_REQ-548 Pulsar Timing Input Data Reception

Pulsar Timing Post Processing shall be able to receive at least 16

folded pulsar data streams per observation, from CSP

F.9.2.2 RFI mitigation

F.9.2.3 Calibration

F.9.2.4 Averaging

SDP_REQ-540 Average Input Data In Frequency To Given

Significance

Pulsar Timing Post Processing shall be able to average input data in

time to increase the significance metric of the input data per sub-

integration to a precomputed value

Page 79: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 79 of 128

SDP_REQ-549 Dynamic Range When Averaging Pulsar Profiles

Pulsar Timing Post Processing shall use at least 32 bits of precision

when averaging

SDP_REQ-561 Average Input Data In Time To Given Significance

Pulsar Timing Post Processing shall be able to average input data in

time to increase the significance metric of the input data per sub-band

to a precomputed value

SDP_REQ-569 Average Input Data In Frequency

Pulsar Timing Post Processing shall be able to average input data in

frequency using a weighted sum of sub-bands with precomputed

weights

F.9.2.5 Archive products generated

F.9.2.6 Data Receptor (Pulsar Search)

SDP_REQ-528 Pulsar Search Data Input Data Reception

Pulsar Search Post Processing shall be able to receive pulsar candidates

and associated data from CSP.

F.9.2.7 Data Receptor (Non-Imaging Transient Search)

SDP_REQ-539 Non-imaging Transient Input

SDP shall be capable of receiving non-imaging transient search data in

accordance with the SKA-TEL.SDP.SE-TEL.CSP.SE-ICD-001

Interface Control Document.

F.9.3 Pulsar Timing Model Fitting

SDP_REQ-525 Pulsar Timing RFI Mitigation

Pulsar Timing Post Processing shall be capable of identifying and removing

RFI signals from pulsar timing data.

SDP_REQ-565 Pulsar Timing Model Fitting

SDP shall be capable of fitting a pulsar timing model to pulsar times-of-arrival

F.9.3.1 Generate Residual

SDP_REQ-531 Generate Residual Output

Pulsar Timing Post Processing shall output residuals for each profile

from each observed pulsar.

SDP_REQ-551 Generate Residual Precision

Pulsar Timing Post Processing shall be able to compute the difference

(residual) between the measured arrival time of a pulse and that

predicted by a pulsar timing model without increasing the error budget

by more than 1 ns.

F.9.3.2 Append residuals to update model

SDP_REQ-538 Form Covariance Matrix of Residuals

Pulsar Timing Post Processing shall estimate the covariance matrix of

the residuals using a provided model of the noise processes in the

residuals

SDP_REQ-550 Weighting Scheme for Pulsar Timing Model

Fitting

Pulsar Timing Post Processing shall use a covariance matrix to weight

the fit of the pulsar timing model.

Page 80: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 80 of 128

SDP_REQ-555 Output of Pulsar Timing Model

Pulsar Timing Post Processing shall output an updated pulsar timing

model for each observed pulsar.

SDP_REQ-556 Update Timing Model

Pulsar Timing Post Processing shall compute an updated pulsar timing

model for each observed pulsar by performing a generalised fit to the

computed residuals, including those extracted from the archive that

have been computed from previous observations.

F.11 Update Global Sky Model

To calculate updates to the global sky model.

SDP_REQ-505 Global Sky Model Update

The continuum pipeline shall update the global sky model based on the current local

sky model.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local Sky

Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2824 SKA1_Low Absolute flux scale

Absolute flux scale : The absolute flux scale shall be accurate to 5%

SKA1-SYS_REQ-2825 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms.

SKA1-SYS_REQ-2826 SKA1_Mid Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms.

SKA1-SYS_REQ-2828 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 5% rms

SKA1-SYS_REQ-2829 SKA1_Survey Absolute flux scale

Absolute flux scale: The absolute flux scale shall be accurate to 3% rms

F.12 Archiving

To archive science ready data products produced by the SKA.

SDP_REQ-271 Data Products

The archive shall support an extensible set of data products resulting from observing

modes and science cases, which include but are not limited to the following types:

Continuum imaging, spectral line emission and absorption, and slow transients. The

term support refers to the capability of ingesting, indexing, performing life cycle

management and redistributing data products based on their type.

SDP_REQ-281 Backup sites

All Science Archives shall have an off-line (e.g. tape) backup stored in a secure

location.

SDP_REQ-282 Backup Archive Retrieval

SDP shall support the retrieval of items from a backup archive to the full Science

Archive within 24 hours.

SDP_REQ-289 Archive lifetime.

The science data archives shall be designed to provide an archived data lifetime of not

less than 50 years from the start of archived observations.

Page 81: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 81 of 128

SDP_REQ-290 Secure Archive Environment

The SDP will protect the data archives from security and environmental threats

SDP_REQ-57 Spectrum Archive Metadata

The Archive API shall deliver science archive metadata for TBD data products, that

is, as a minimum, consistent with the IVOA Standard Spectrum Data Model

(SpectrumDM). The SpectrumDM data model may be used to represent spectra, time

series data, segments of spectral energy distributions, and other spectral or temporal

associations.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will convert the

output data from the CSP into science data products to be stored in the science data

archive.

SKA1-SYS_REQ-2350 Mirror sites.

Mirror sites. All data within Science Archives shall have a secondary copy located

offsite in a secure location.

SKA1-SYS_REQ-2355 Data product provenance.

Data product provenance. An official data product shall have known, documented

provenance, and shall have been produced via SKA observations and processing.

SKA1-SYS_REQ-2358 Third party data products.

Third party data products. Third party data products shall not be admitted to the

archive.

SKA1-SYS_REQ-2360 Science data product archive policy.

Science data product archive policy. There shall be a policy, developed and

administered by Operations, governing which types and sizes of data products will be

retained in the archive and for how long.

SKA1-SYS_REQ-2361 Archive access.

Archive access. A telescope archive will be nominally open for access 24/7/365, with

no more than 24 hrs planned downtime per year. Unplanned downtime shall be

consistent with availability budget.

SKA1-SYS_REQ-2363 Archive lifetime.

Archive lifetime. The science data archives shall be designed to provide an archived

data lifetime of not less than 50 years from the start of archived observations.

SKA1-SYS_REQ-2364 Data migration plan.

Data migration plan. Operations shall maintain at all times and update yearly a current

data migration plan covering the contingency of moving from one archive platform to

another.

SKA1-SYS_REQ-2479 Archive security

Archive security. The observatory shall provide a secure environment for all its data

archives.

SKA1-SYS_REQ-2660 Backup archive retrieval

Backup archive retrieval . Backup archive items shall be retrievable to the full archive

from an alternate source within 24 hours

SKA1-SYS_REQ-2661 Backup archive user access conversion

Backup archive user access conversion. Users shall have access to the data of the

entire archive within one week following an incident.

Page 82: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 82 of 128

SKA1-SYS_REQ-2688 Data access rights

Commensal Observing Data access rights. There shall be a documented data access

rights policy for commensal observing for data sets shared across projects.

SKA1-SYS_REQ-2728 Data migration design

Data migration design. The archive design shall support and facilitate migration from

one medium to another.

SKA1-SYS_REQ-2821 Archive

Archive. There shall be an archive for each telescope, located in the Science

Processing Centre, for storing selected science data products for subsequent access by

users according to science data access policy.

F.12.1 Data Layer Management

Manages and executes the logical data flow from CSP to the final delivery

SDP_REQ-247 Data Layer Management

There shall be a system of software systems that manages the data flow from

the reception of raw data from CSP to the delivery of science products.

SDP_REQ-251 Concurrency

The data layer manager of each SKA telescope and all sub-arrays shall be

capable of operating concurrently and independently. It shall be possible to

run additional instances of the data layer manager for other purposes such as:

commissioning, maintenance and simulation in parallel.

SKA1-SYS_REQ-2322 Global sky model.

Global sky model. Calibration and continuum subtraction shall use a Local

Sky Model, derived from a Global Sky Model or previous Local Sky Model.

SKA1-SYS_REQ-2348 Role of science processing centres.

Role of science processing centres. The science-processing centre will convert

the output data from the CSP into science data products to be stored in the

science data archive.

F.12.1.1 Data Life Cycle Control

Automation and management of lifecycle states of data objects

SDP_REQ-248 Data Life Cycle Management

There shall be a mechanism that automates the migration of data items

through the various life cycle states starting from the initial storage.

This shall entail the migration of data items between storage layers and

include backup copies until the data items become obsolete and are

deleted.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the lifetime of any

of the hardware and software components comprising the archive.

F.12.1.1.1 Aggregation

Accumulation of data objects into data products

SDP_REQ-252 Concurrent Workflows

The data layer manager shall concurrently generate data

products for multiple observing programs. It shall also support

Page 83: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 83 of 128

a single observing program concurrently generating multiple

data products as well as a mix of both scenarios.

SDP_REQ-255 Tracing Data

It shall be possible to trace each data product in the archive

back to a scheduling block and an observing program.

Reversely, it shall be possible to either search by observing

program or scheduling block and to subsequently retrieve all or

part of the associated archived data. This includes relevant

logging and monitoring information as well as quality

assessment data collected during the observations and the

standard processing.

F.12.1.1.2 Replication of Data Objects

Copies Data Objects to or from an alternate source

SDP_REQ-260 Archive Backup

In case of data loss from the Science Archive it shall be

possible to restore the lost data items. Individual data products

shall be retrievable from a backup copy within 24 hours. The

backup mechanism shall support scheduled, as well as

incremental and full backup options.

SDP_REQ-261 Restoring Archive Operations of a failed

site

There shall be a mechanism to operate the archive from a

backup copy to meet a recovery time limit of 1 week,

independent of the total size of the archive.

SDP_REQ-283 Restore archive access

The SDP shall provide the capability to restore access to the

entire archive within one week following an incident.

F.12.1.1.3 Migration

Migration of data from one storage medium to another.

SDP_REQ-263 Data Migration Design

The data layer manager shall contain a data life cycle

management subsystem which shall incorporate mechanisms

for copying, moving and retiring whole physical volumes or

storage units.

SDP_REQ-268 Rejuvenation

The lifetime of archived data shall not be limited by the

lifetime of any of the hardware and software components

comprising the archive.

SDP_REQ-269 Storage Technology Transition

A strategy for phasing in new storage technology, e.g. new

media types, and phasing out obsolete storage technology shall

be part of the data migration plan.

F.12.1.1.4 Retirement

Cleanup of expired, temporary data

Page 84: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 84 of 128

SDP_REQ-256 Discard Scheduling Block

The system shall provide a mechanism for discarding the

results and associated data artefacts from a given active

scheduling while it is still processed and before the next

scheduling block starts.

F.12.1.2 Hierarchical Storage Management

Policy driven placement of data objects in tiered storage system

SDP_REQ-253 Workload Balance

The data layer shall provide a load balancing optimisation of the data

locality based on the specific performance and I/O work load at

runtime.

SDP_REQ-598 Storage Hierarchy

There shall be a mass storage system that automatically moves data

between high-cost and low-cost storage media for optimised

performance

F.12.1.2.1 Transaction Management

Provision of data object integrity across storage tiers and

lifecycle states

SDP_REQ-383 Data Integrity

The data integrity of the hierarchical storage management

system shall be defined and maintained across the entire data

life-cycle.

F.12.1.2.2 Buffering

short-term storage of data objects

SDP_REQ-618 Tranfer images from archive to buffer

The Data Layer shall be able to transfer image cubes from the

science data archive to the buffer for further processing.

F.12.1.2.3 Data Product Storage

Long term storage of data products

F.12.1.2.4 Database Access

Persisting metadata and state information

SDP_REQ-250 DB Interface

There shall be a database interface providing transparent access

to both the telescope state repository and the persistent storage

database services.

F.12.1.3 Data Layer Services

Services and API interfaces providing middleware functionality to

other SDP elements.

SDP_REQ-599 Data Service Layer

The Data Service Layer ensures that data access shall be independent

of the physical schema of the underlying compute infrastructure.

Page 85: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 85 of 128

F.12.1.3.1 Special Purpose Functions

Individual data services; for instance, consistent access to sky

models.

SDP_REQ-257 Sky Model Access

The data layer manager shall provide concurrent read access to

the local and global sky model. It shall also provide write

access for the purpose of refining the global sky model and

creating new local sky models.

F.12.1.3.2 Raw Data Reception

Receiving network packages from CSP and instantiating

respective data object.

F.12.1.3.3 Aborting/Resetting

Discard an incompletely processed scheduling block and free

allocated resources

SDP_REQ-256 Discard Scheduling Block

The system shall provide a mechanism for discarding the

results and associated data artefacts from a given active

scheduling while it is still processed and before the next

scheduling block starts.

F.12.1.4 Monitoring

Access to system monitoring and application performance data

SDP_REQ-266 Status Information

System status information shall be made available in compliance with

the capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-287 Continuous performance monitoring.

Performance monitoring shall be compliant with the capabilities

specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-001.

F.12.1.4.1 Load Measurement

gather application performance data

SDP_REQ-265 Continuous Performance Monitoring

Metrics

Performance monitoring shall be compliant with the

capabilities specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

F.12.1.4.2 Status Reporting

returns processing status

SDP_REQ-266 Status Information

System status information shall be made available in

compliance with the capabilities specified in SKA-

TEL.SDP.SE-TEL.TM.SE-ICD-001.

SDP_REQ-267 Availability Metric

Page 86: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 86 of 128

The data layer manager's subsystems shall have a defined

metric for deriving the overall availability of a given runtime

configuration.

F.12.1.4.3 Alerting

generation of alerts under pre-defined conditions

SDP_REQ-384 Notification Event

Data services shall be capable of generating pre-defined

notification events such as alarms.

F.12.2 Product Ingest

Creation of science data product catalogue.

SDP_REQ-276 Data Product Provenance

A SDP data product shall have known, documented provenance, and shall

have been produced via SKA observations and processing.

SDP_REQ-574 Science Data Archive

The SDP shall provide an archive for each telescope, located in the Science

Processing Centre, for storing selected science data products for subsequent

access by users according to science data access policy.

F.12.2.1 Indexing

Generation of archival search index.

SDP_REQ-255 Tracing Data

It shall be possible to trace each data product in the archive back to a

scheduling block and an observing program. Reversely, it shall be

possible to either search by observing program or scheduling block and

to subsequently retrieve all or part of the associated archived data. This

includes relevant logging and monitoring information as well as

quality assessment data collected during the observations and the

standard processing.

SDP_REQ-578 Data Model Compliance

The science archive shall be loaded with TBD standard data model

compliant meta data for the purpose of discovery and characterization

of data products. IVOA data models shall be supported where

applicable

F.12.2.2 Branding/Provenance

Population of archival metadata schema

SDP_REQ-254 Provenance

All data products stored in the Science Archive shall contain

provenance information. Science archive users shall be able to use this

provenance information to unambiguously reference data products in

publications.

F.12.3 Archive Access

science archive data access

SDP_REQ-262 Data Layer Product Distribution

Page 87: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 87 of 128

The SDP shall provide an internal interface to allow access to bulk data and

data contained in databases (from the science archive) in order to deliver data

products.

SDP_REQ-275 Remote Processing

It shall be possible to run the SDP software at Partner Facilities. TBC

SDP_REQ-573 Third party data products

The SDP shall not admit third party data products to the science data archive.

SDP_REQ-574 Science Data Archive

The SDP shall provide an archive for each telescope, located in the Science

Processing Centre, for storing selected science data products for subsequent

access by users according to science data access policy.

F.12.3.1 Metadata Service

Access to science archive metadata

SDP_REQ-523 Archive Database Service

The Data Layer shall provide a service to allow access to data

contained in databases in the science archive.

SDP_REQ-577 Decoupling real-time Ops

Access methods to the science data archive shall not impact the

performance of telescope operations such as science data product

ingest.

F.12.3.2 Data Product Service

Access to science data products

SDP_REQ-522 Archive Bulk Data Access Service

The Data Layer shall provide a service to allow access to bulk data

contained in the science archive.

SDP_REQ-576 Data Product Replication

The data layer shall provide an access method to science data products.

SDP_REQ-577 Decoupling real-time Ops

Access methods to the science data archive shall not impact the

performance of telescope operations such as science data product

ingest.

F.12.3.3 Access Control

Policy based access control to science data products

SDP_REQ-264 Access Rules

The Science Data Archive shall provide an operator interface that

allows the creation and subsequent maintenance of access rules based

on user role and product type.

SDP_REQ-270 Archive Security Traceability

Measures for protecting the data layer management system from

unauthorised access shall be documented for security auditing

purposes.

SDP_REQ-274 Single Sign-On

The Archive API shall provide single sign-on capability to science

archive users.

Page 88: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 88 of 128

SDP_REQ-286 Levels of access to the archive

Access to the archive shall be either anonymous with correspondingly

limited capabilities or via SKA authentication and authorisation.

SDP_REQ-574 Science Data Archive

The SDP shall provide an archive for each telescope, located in the

Science Processing Centre, for storing selected science data products

for subsequent access by users according to science data access policy.

SDP_REQ-609 Release Status

The Science Data Archive shall have a release status for each data

product and the system shall support scheduled changes to this status

information.

SDP_REQ-610 Consistent Release State

The Science Data Archive shall provide methods for consistently

setting and updating the release status of shared data products in the

context of commensal observing.

SDP_REQ-611 User Roles

The Science Data Archive shall support an extensible list of defined

user roles for the purpose of authorisation.

SDP_REQ-612 Data Product Types

The Science Data Archive shall support an extensible set of data

product types.

SDP_REQ-613 Meta Access

The Science Data Archive shall have the ability to define access to

metadata and data products separately.

F.13 Regional Centre Interface

To provide an interface for data transfer between the SKA Science Data Archive and

Regional Centres.

SKA1-SYS_REQ-2366 Distribution of data products.

Distribution of data products. As limited by resource constraints, it will be possible to

deliver science data products to approved off-site facilities, which may be globally

distributed.

F.13.1 Data distribution policy

SDP_REQ-106 Product distribution

The Archive API shall provide the capability to control archive data product

distribution to a set of pre-determined destinations.

F.13.1.1 Maintain remote products

SDP_REQ-107 Identify distribution destination

The Archive API shall support the identification of a destination for

delivery of science data products.

F.13.1.1.1 Analyse Data

SDP_REQ-114 Analysis output storage

The RCs shall support the Archive API by providing storage

for the output of the science data analysis software.

SDP_REQ-127 RC Product Renewal

Page 89: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 89 of 128

Changes in products shall cause the Archive API to trigger

changes to delivered data product copies.

F.13.1.1.2 Delete Remote Products

SDP_REQ-125 Trigger data removal

The Archive API shall trigger the removal of all copies of data

products when a TBD low-quality threshold is reached.

F.13.1.1.3 Update Remote Products

SDP_REQ-126 Trigger data update

The Archive API shall trigger the delivery of an updated data

product to replace all copies when an archive data product is

updated at the SDP.

F.13.2 Bulk Data Transfer

SDP_REQ-262 Data Layer Product Distribution

The SDP shall provide an internal interface to allow access to bulk data and

data contained in databases (from the science archive) in order to deliver data

products.

F.13.2.1 WAN Interface

SDP_REQ-110 RC storage capacity

The RCs shall support the Archive API by providing a minimum of

TBD ?B of storage for archive data.

SDP_REQ-111 RC data transfer rate

The RCs shall support the Archive API by accommodating a data

transfer rate of TBD ?B/s.

SDP_REQ-112 RC storage rate

The RCs shall support the Archive API by providing storage that will

accumulate data at the TBD transfer rate.

SDP_REQ-113 RC analysis execution

The RCs shall support the Archive API by providing the execution of

science data analysis software.

SDP_REQ-114 Analysis output storage

The RCs shall support the Archive API by providing storage for the

output of the science data analysis software.

SDP_REQ-115 Metadata replication

The RCs shall support the Archive API by providing for the replication

of the metadata for the archive data products.

SDP_REQ-116 RC expected downtime

The RCs shall limit expected downtime to 5% (TBC).

SDP_REQ-117 RC unexpected downtime

The RCs shall limit unexpected downtime to 3% (TBC).

SDP_REQ-99 User Credentials Replication

The RCs shall support the Archive API by providing for the replication

of user credentials from the SDP.

F.13.2.2 Receive Data at Regional Centre

SDP_REQ-108 Delivery performance

Page 90: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 90 of 128

The Archive API shall provide a transfer rate of TBD ?B/s for delivery

of data products.

SDP_REQ-109 Delivery interruption

The Archive API shall provide the capability to interrupt any or all

data deliveries.

F.13.2.3 Schedule data delivery

SDP_REQ-118 Delivery strategy

The Archive API shall schedule external data delivery.

F.13.2.3.1 Check previous deliveries

SDP_REQ-119 Delivery Count Limit

The Achieve API will limit the number of times failed transfers

are retried.

SDP_REQ-124 Delivery strategy data model

The Archive API shall track delivery strategy information for

data delivery and track which Data products s are transferred to

each RC.

F.13.2.3.2 Check Data Transfer budget

SDP_REQ-121 Data delivery budget

The Archive API data delivery scheduler shall identify capacity

by (TBC): 1 project; 2 user

SDP_REQ-122 High priority delivery

The Archive API shall support a default priority of urgent for

the delivery of the initial copy of a data product.

SDP_REQ-123 Low priority delivery

The Archive API shall deliver additional copies of data

products at the lowest priority.

F.13.2.3.3 Prioritise data for delivery

SDP_REQ-120 Data delivery priority

The Archive API data delivery schedule shall identify priorities

by (TBC): 1 product type; 2 project; 3 user

F.13.2.4 Send data to Regional Centre

F.13.2.5 Log Receiving data

SDP_REQ-98 User access log consistency

A log of user behavior (e.g. access history) will be kept by the

Delivery Platform which will be synchronized across geographically

distributed locations.

F.14 SKA Archive User Interface

To provide an interface for all outside parties to access and query the Science Data

Archive.

SKA1-SYS_REQ-2352 Web interface.

Web interface. The science data archives shall be accessible from the internet via a

standardised web interface.

SKA1-SYS_REQ-2353 Virtual Observatory interface.

Page 91: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 91 of 128

Virtual Observatory interface. The science data archives shall be accessible via a set

of recommended IVOA services chosen to allow access to all approved data products.

SKA1-SYS_REQ-2354 Archive API.

Archive API. The science data archives shall publish a user accessible, open API in a

small number of complementary languages such as Python, C++, and Java.

SKA1-SYS_REQ-2361 Archive access.

Archive access. A telescope archive will be nominally open for access 24/7/365, with

no more than 24 hrs planned downtime per year. Unplanned downtime shall be

consistent with availability budget.

SKA1-SYS_REQ-2366 Distribution of data products.

Distribution of data products. As limited by resource constraints, it will be possible to

deliver science data products to approved off-site facilities, which may be globally

distributed.

SKA1-SYS_REQ-2482 Accessibility

Accessibility. It shall be possible to control on a per user basis which SKA1 facilities

and resources (both hardware and software) may be accessed by the user.

SKA1-SYS_REQ-2739 Levels of access to the archive

Levels of access . Access to the archive shall be either anonymous with

correspondingly limited capabilities or via SKA authentication and authorisation.

F.14.1 Authenticate and Authorise

SDP_REQ-274 Single Sign-On

The Archive API shall provide single sign-on capability to science archive

users.

SDP_REQ-571 Access to data and metadata

SDP shall provide authenticated users authorized access to proprietary

metadata and data.

F.14.1.1 Authorise User

SDP_REQ-90 Anonymous delivery

The Archive API shall implement anonymous delivery of TBD public

science archive metadata and data products.

SDP_REQ-94 User Authorisation

The Archive API shall implement authorized access to proprietary

science archive data for delivery.

F.14.1.1.1 Authorise User (Service)

SDP_REQ-277 User Defined Access Control

The SDP Delivery Platform shall provide a mechanism that

considers user-defined groups for authorised access.

SDP_REQ-95 Delivery by Role

The Archive API shall authorize role maintenance, metadata

description, metadata retrieval, and data delivery, by user role.

F.14.1.1.2 Authorise User (Client)

SDP_REQ-89 Federated authentication

Page 92: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 92 of 128

The Archive API shall provide an interface to multiple static or

dynamic federated identity management mechanisms for

authenticating user credentials.

SDP_REQ-95 Delivery by Role

The Archive API shall authorize role maintenance, metadata

description, metadata retrieval, and data delivery, by user role.

SDP_REQ-97 Authorisation client

The SDP Delivery Platform shall provide a client that executes

the Archive API authorization facilities.

F.14.1.2 Authenticate User

SDP_REQ-88 User Authentication

The Archive API shall provide a mechanism to recognize

authentication credentials.

F.14.1.2.1 Authenticate User (Client)

SDP_REQ-89 Federated authentication

The Archive API shall provide an interface to multiple static or

dynamic federated identity management mechanisms for

authenticating user credentials.

SDP_REQ-91 Certificate Authentication

The Archive API shall support certificate-based credential

authentication.

F.14.1.2.2 Authenticate User (Service)

SDP_REQ-91 Certificate Authentication

The Archive API shall support certificate-based credential

authentication.

F.14.1.3 Maintain User Credentials

Add and remove users and groups.

SDP_REQ-101 Authentication provider list

The SDP shall support the Archive API by maintaining a reference to

a list of accredited identity providers.

F.14.1.3.1 Maintain User Credentials (Client)

SDP_REQ-100 Authorisation credential client

The SDP Delivery Platform shall provide a client that will

access the credential maintenance service.

SDP_REQ-102 User Roles

The SDP shall support the Archive API by maintaining

classification of users by role.

F.14.1.3.2 Maintain User Credentials (Service)

SDP_REQ-102 User Roles

The SDP shall support the Archive API by maintaining

classification of users by role.

F.14.1.3.3 Associate Identities

SDP_REQ-93 External Credentials

Page 93: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 93 of 128

The Archive API shall support the linking of an external

authentication credential with an SKA authentication

credential.

F.14.1.4 Maintain user-defined groups

User maintenance of user-defined groups.

SDP_REQ-277 User Defined Access Control

The SDP Delivery Platform shall provide a mechanism that considers

user-defined groups for authorised access.

SDP_REQ-279 User-defined Group Management

The Delivery Platform will support collaboration by providing user-

defined group management.

F.14.2 Discover Data

SDP_REQ-130 VOEvent Delivery

The Archive API shall deliver archive VO event data (transient events) as

defined by the IVOA Standard for VO Event transport.

SDP_REQ-385 Web Interface

The SDP shall provide access to the science data archives from the internet via

a standardised web interface.

SDP_REQ-54 Archive Metadata

The SDP shall provide science archive metadata for the purpose of data

discovery.

SDP_REQ-55 ObsCore Archive Metadata

The Archive API shall deliver science archive metadata that is, as a minimum,

consistent with the IVOA Standard Observation Data Model Core

Components (ObsCoreDM). The ObsCoreDM defines the core components of

an Observation data model that are necessary to perform data discovery.

SDP_REQ-56 Image Archive Metadata

The Archive API shall deliver science archive metadata for multi-dimensional

data products that is, as a minimum, consistent with the proposed IVOA

Standard Image Data Model (ImageDM). The ImageDM is an ObsCoreDM

extension to describe multi-dimensional data, for handling data cubes.

SDP_REQ-57 Spectrum Archive Metadata

The Archive API shall deliver science archive metadata for TBD data

products, that is, as a minimum, consistent with the IVOA Standard Spectrum

Data Model (SpectrumDM). The SpectrumDM data model may be used to

represent spectra, time series data, segments of spectral energy distributions,

and other spectral or temporal associations.

SDP_REQ-58 Data Discovery

The SDP shall provide science archive data discovery for the purpose of

delivery.

SDP_REQ-59 TAP Discovery

Science archive data discovery service shall, at a minimum, be searchable by

the IVOA Standard Table Access Protocol (TAP). TAP defines a service

protocol for accessing general table metadata and data. ObsCoreDM defines

the general table metadata.

Page 94: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 94 of 128

SDP_REQ-60 SIA Discovery

The Archive API multi-dimensional image science archive data discovery

service shall, at a minimum, be searchable by the IVOA Standard Simple

Image Access (SIA) protocol?SIA-2.x. SIA provides capabilities for the

discovery of and access to detailed metadata for multi-dimensional image

datasets, including 2-D images as well as datacubes of three or more

dimensions.

SDP_REQ-62 Data Description

The SDP shall describe the science data archive metadata attributes and

relationships.

SDP_REQ-87 Archive Data File Formats

The Data Layer shall support the data visualisation by providing science data

products in TBD formats, such as CASA image, HDF5, and FITS file formats.

F.14.2.1 Visualise Query Results

SDP_REQ-73 Metadata Visualisation Client

The SDP Delivery Platform shall deliver science archive metadata for

web client visualisation.

SDP_REQ-74 HTTP Client Metadata Visualisation

The Delivery Platform shall deliver science archive metadata in the

IVOA Standard VOTable format for http client visualisation.The

VOTable format is an XML standard for the interchange of

astronomical data represented as a set of tables.

SDP_REQ-75 HTTP Client Previews

The SDP Delivery Platform shall provide previews (optimized sub-

sampling) of data for http client visualisation.

F.14.2.2 Select Data Products For Transfer

SDP_REQ-68 Delivery Client

The Delivery Platform Public Interface shall provide a client that

executes the Archive API DataLink and AccessData delivery facilities.

The client will execute externally to the SDP.

F.14.2.3 Query Authorised Data

SDP_REQ-66 DataLink Delivery

The Archive API shall deliver archive data products, VO data, and

public and outreach data as defined by the IVOA

Standard DataLink. The DataLink service supports linking of data

discovery metadata to detailed metadata, to the data itself, and to

standard and custom services that perform operations on the data

before delivery. The standard provides options to distinguish between

data products.

F.14.2.4 Filter By Authorisation

SDP_REQ-105 Proprietary data period

The Archive API shall enforce a TBD proprietary data period for

products from the science data archive and VO data, as observed for

one or many proposals.

F.14.2.5 Select Destination

SDP_REQ-107 Identify distribution destination

Page 95: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 95 of 128

The Archive API shall support the identification of a destination for

delivery of science data products.

F.14.2.6 Query Authorised Metadata

SDP_REQ-103 Proprietary Period

The Archive API shall enforce a proprietary period for science data

archive and VO data, as observed for one or many proposals.

SDP_REQ-90 Anonymous delivery

The Archive API shall implement anonymous delivery of TBD public

science archive metadata and data products.

F.14.2.6.1 Append Authorisation Parameters to Query

SDP_REQ-104 Proprietary metadata period

The Archive API shall enforce a TBD proprietary metadata

period for products from the science data archive and VO data,

as observed for one or many proposals.

F.14.2.6.2 Query Metadata (Client)

SDP_REQ-61 Client Data Discovery

The SDP Delivery Platform shall provide a client that executes

the Archive API TAP and SIA2.x discovery facilities. The

client will execute local to the user.

SDP_REQ-63 TAP Data Description

The SDP Delivery Platform shall provide a client that executes

the Archive API TAP descriptive facilities to retrieve, as a

minimum, the ObsCoreDM-compliant description of the

science data archive metadata attributes and relationships. The

client will execute local to the user.

SDP_REQ-64 SIA Data Description

The SDP Delivery Platform shall provide a client that executes

the Archive API SIA descriptive facilities to retrieve the

ObsCoreDM-compliant description of the science data archive

metadata attributes and relationships and the ImageDM-

compliant detailed metadata. The client will execute local to the

user.

SDP_REQ-77 VOEvent Data Description

The Data Delivery Platform shall provide a client that executes

the science archive VO Event Transport Protocol to retrieve, as

a minimum the Standard Sky Event Reporting Metadata model-

compliant description of the science data archive metadata

attributes and relationships, and the detailed metadata. The

client will execute local to the user.

F.14.2.6.3 Query Metadata (Service)

SDP_REQ-59 TAP Discovery

Science archive data discovery service shall, at a minimum, be

searchable by the IVOA Standard Table Access Protocol

(TAP). TAP defines a service protocol for accessing general

table metadata and data. ObsCoreDM defines the general table

metadata.

Page 96: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 96 of 128

SDP_REQ-60 SIA Discovery

The Archive API multi-dimensional image science archive data

discovery service shall, at a minimum, be searchable by the

IVOA Standard Simple Image Access (SIA) protocol?SIA-2.x.

SIA provides capabilities for the discovery of and access to

detailed metadata for multi-dimensional image datasets,

including 2-D images as well as datacubes of three or more

dimensions.

SDP_REQ-61 Client Data Discovery

The SDP Delivery Platform shall provide a client that executes

the Archive API TAP and SIA2.x discovery facilities. The

client will execute local to the user.

SDP_REQ-77 VOEvent Data Description

The Data Delivery Platform shall provide a client that executes

the science archive VO Event Transport Protocol to retrieve, as

a minimum the Standard Sky Event Reporting Metadata model-

compliant description of the science data archive metadata

attributes and relationships, and the detailed metadata. The

client will execute local to the user.

F.14.2.7 Condition metadata

SDP_REQ-55 ObsCore Archive Metadata

The Archive API shall deliver science archive metadata that is, as a

minimum, consistent with the IVOA Standard Observation Data Model

Core Components (ObsCoreDM). The ObsCoreDM defines the core

components of an Observation data model that are necessary to

perform data discovery.

SDP_REQ-56 Image Archive Metadata

The Archive API shall deliver science archive metadata for multi-

dimensional data products that is, as a minimum, consistent with the

proposed IVOA Standard Image Data Model (ImageDM). The

ImageDM is an ObsCoreDM extension to describe multi-dimensional

data, for handling data cubes.

SDP_REQ-57 Spectrum Archive Metadata

The Archive API shall deliver science archive metadata for TBD data

products, that is, as a minimum, consistent with the IVOA Standard

Spectrum Data Model (SpectrumDM). The SpectrumDM data model

may be used to represent spectra, time series data, segments of spectral

energy distributions, and other spectral or temporal associations.

SDP_REQ-72 Metadata Conditioning

The SDP data model shall support the Archive API by conditioning

science data product metadata with the named VO standards.

SDP_REQ-92 VOEvent Data Model

The Data Delivery Platform shall deliver science archive metadata for

VO Events that is, as a minimum, consistent with the IVOA Standard

Sky Event Reporting Metadata model. The VOEvent DM is used to

describe transient celestial events.

Page 97: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 97 of 128

F.14.3 Request Data Delivery

SDP_REQ-118 Delivery strategy

The Archive API shall schedule external data delivery.

F.14.4 Deliver Data to end user

SDP_REQ-65 Data Delivery

The Archive API shall deliver selected archive data products, VO data, and

public and outreach data according to specified standards to the end user.

F.14.4.1 Transfer Data to End User

SDP_REQ-273 Cut-outs

Support of cut-outs to deliver segments of Data Objects to end users.

SDP_REQ-67 AccessData Delivery

The Archive API shall deliver archive data products, VO data, and

public and outreach data as defined by the proposed IVOA Standard

AccessData in standard formats.

F.13.2.5 Log Receiving data

SDP_REQ-98 User access log consistency

A log of user behavior (e.g. access history) will be kept by the

Delivery Platform which will be synchronized across geographically

distributed locations.

F.14.5 Visualise data

SDP_REQ-131 Supported File Formats

The SDP Delivery Platform data visualization client shall visualize science

archive data in the following file formats:CASA images,HDF5 files, andFITS

files.

SDP_REQ-56 Image Archive Metadata

The Archive API shall deliver science archive metadata for multi-dimensional

data products that is, as a minimum, consistent with the proposed IVOA

Standard Image Data Model (ImageDM). The ImageDM is an ObsCoreDM

extension to describe multi-dimensional data, for handling data cubes.

SDP_REQ-76 Data Visualisation Client

The SDP Delivery Platform shall deliver science archive data for interactive

remote visualization, accessible through a standard web browser.

SDP_REQ-82 Maintain Visualization Session

The SDP DELIV PI data visualization client shall support the creation,

retrieval, modification, and deletion of visualization sessions.

F.14.5.1 Share Visualisation Session

SDP_REQ-81 Multi-User Viewing

The SDP Delivery Platform data visualization client shall allow

multiple users to interact with the same viewing session

simultaneously.

F.14.5.2 View Data with Core Functionality

SDP_REQ-78 Core viewing functionality

The SDP Delivery Platform data visualization client shall support, as a

minimum, the following viewing features: 1 pan; 2 zoom; 3 colormap

adjustments; 4 celestial coordinate system grid overlays; 5 multiple

Page 98: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 98 of 128

image overlays; 6 switching frames; blinking i.e. manual or automatic

switching rapidly between different images, regions or frames.

F.14.5.3 View Data with Core analysis

SDP_REQ-128 Community Analysis

The SDP Delivery Platform data visualization service plug-in system

shall have the ability to execute community-provided code.

SDP_REQ-129 View Large Datasets

The SDP Delivery Platform data visualization shall run at interactive

speeds for large images (e.g. 1 TB TBC).

SDP_REQ-79 Extensible Analysis

The SDP Delivery Platform data visualization client shall provide a

plug-in system that will support the execution of data analysis software

as part of visualization.

SDP_REQ-80 Core Analysis Visualization

The SDP Delivery Platform data visualization client shall display, as a

minimum, analysis plug-ins for: 1 region statistics; 2 histograms; 3

spectrum calculators; 4 moment generators; 5 1D and 2D gaussian

fitting

F.14.5.4 Annotate Archive Data

SDP_REQ-132 Annotations

The SDP Delivery Platform data visualization client shall provide the

ability to create, retrieve, update, and delete annotations on individual

archive data products.

F.14.5.5 Automate Science analysis

SDP_REQ-86 Analysis API

The SDP Delivery Platform data visualization shall provide an API

that supports automation of the generation of analysis plots from

archive data.

F.14.5.6 Produce Science Analysis Products

SDP_REQ-85 Viewer Plot Save

The SDP Delivery Platform data visualization client shall support the

storage and retrieval of plots as high-resolution files generated during a

visualization session.

F.14.5.7 Log Data Access

SDP_REQ-96 Data access logging

The Archive API shall log science data product access by credential.

F.14.5.8 Customise Visualisation Environment

SDP_REQ-572 Display customisations

Maintain display customizations for web visualisation of science

archive metadata and data.

F.14.5.8.1 Customise User Display Defaults

SDP_REQ-83 User Visualization Customization

The SDP Delivery Platform data visualization client shall

support the maintenance of the following information, as a

minimum, for a user: 1 default toolbars; 2 default celestial

Page 99: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 99 of 128

coordinate systems; toolbar customizations; plugin-specific

customizations; plot display attributes

F.14.5.8.2 Customise Visualisation Display

SDP_REQ-84 Viewer Customizable Plotting

The SDP Delivery Platform data visualization client shall

support customization options for plot display attributes.

F.15 SDP LMC

Provides local monitor and control functionality to the SDP as a whole. This involves

both the internal management of the SDP and the external interface to the Telescope

Manager.

F.15.1 Control

Provides for all aspects related to the control of the SDP, both externally from

TM and internally towards the SDP.

SDP_REQ-1 Mode handling

The SDP shall provide commands to the TM sufficient to support the various

telescope operating mode.

SDP_REQ-11 Frequency handling

The SDP shall support the transition from one frequency band of operation to

another within 30 seconds (TBD - need feedback on allocation of parent time

allowance).

SDP_REQ-2 Capability Handling

The SDP shall support the concept of capabilities via the LMC.

SDP_REQ-28 Precursor integration

The SDP LMC shall provide a uniform and singular point of control for the

SDP for all components of a particular telescope, including any precursor

infrastructure that may form part of the telescope.

SDP_REQ-285 Accessibility

The SDP shall make use of the central Authentication and Authorisation

facilities provided by the SKA to enable per user access to SDP resources.

SDP_REQ-29 Targets of Opportunity

The SDP shall provide a priority override mechanism to support scheduling

and execution of approved Target of Opportunity (ToO) events.

SDP_REQ-3 Observation Handling

The SDP shall support the concept of observations via the LMC.

SDP_REQ-33 Flagging control

The SDP shall allow the TM to control internal flagging, including the

definition of a pre-selected RFI mask, and other parameters as may be relevant

to particular flagging strategies.

SDP_REQ-50 Invalid input handling

The SDP shall be robust against input errors including invalid state, improper

authorisation, and malformed or malicious commands.

SDP_REQ-51 Engineering Support

The SDP shall provide engineering support functions to the relevant

Engineering Operations centres.

Page 100: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 100 of 128

SDP_REQ-52 Failsafe

The SDP shall actively ensure that internal failures do not result in a

hazardous situation to the systems and personnel with which it interfaces.

SDP_REQ-602 Invalid Input Handling - Master Controller

The Master Controller shall be robust against input errors including invalid

state, improper authorisation, and malformed or malicious commands.

SDP_REQ-604 MeerKAT integration

The Master Controller shall provide a uniform and singular point of control for

the SDP for all components of the MeerKAT telescope, including any

precursor infrastructure that may form part of the MeerKAT telescope.

SDP_REQ-605 ASKAP integration

The Master Controller shall provide a uniform and singular point of control for

the SDP for all components of the ASKAP telescope, including any precursor

infrastructure that may form part of the ASKAP telescope.

SDP_REQ-606 Receive observation request

The Master Controller shall receive requests for observations from the

Telescope Manager.

SDP_REQ-607 Flagging control - LMC

The Master Controller shall receive flagging parameters from the Telescope

Manager and instruct the Calibration Pipeline to apply these flagging

parameters.

SDP_REQ-608 Engineering Support - Master Controller

The Master Controller shall provide engineering support functions to the

relevant Engineering Operations centres.

SDP_REQ-7 Observation Control

The SDP shall provide commands to control a previously scheduled

observation.

SKA1-SYS_REQ-2126 Simultaneous operation of telescopes

Simultaneous operation of telescopes. All three telescopes shall be capable of

operating concurrently and independently.

SKA1-SYS_REQ-2128 Continuum and spectral line imaging mode.

Continuum and spectral line imaging mode. All three SKA1 telescopes shall

be capable of operating in a Continuum and Spectral-line imaging mode

concurrently.

SKA1-SYS_REQ-2129 Pulsar Search Mode.

Pulsar Search Mode . The SKA1_mid telescope shall be capable of operating

in a Pulsar search mode, concurrently with Continuum imaging mode.

SKA1-SYS_REQ-2130 Pulsar Timing Mode.

Pulsar Timing Mode. The SKA1_mid telescope shall be capable of operating

in a Pulsar timing mode, concurrently with continuum imaging mode.

SKA1-SYS_REQ-2133 Mode transition

Mode transition. The switching time between telescope operating modes shall

take less than 30 seconds (not including antenna slewing time)

SKA1-SYS_REQ-2173 MeerKAT array

Page 101: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 101 of 128

MeerKAT array. The monitor and control functions of MeerKAT shall be

made available to SKA1_Mid via a Foreign Telescope interface consisting of

a Local Monitor and Control system connected to the SKA1_Mid Telescope

Manager.

SKA1-SYS_REQ-2224 Frequency agility.

Frequency agility. The SKA1_Mid system shall, for each timing sub-array, be

able to change from observing in any frequency band, to observing in any

other frequency band in less than or equal to 30 seconds.

SKA1-SYS_REQ-2262 SKA1_Survey inclusion of ASKAP.

SKA1_Survey inclusion of ASKAP. The SKA1_Survey shall incorporate the

36 ASKAP antennas in both monitor and control and data collection functions.

SKA1-SYS_REQ-2263 SKA1_Survey single array operation.

SKA1_Survey single array operation . SKA1-Survey shall be capable of

operating ASKAP and SKA1 dishes as single array for frequency band 2.

SKA1-SYS_REQ-2266 SKA1_Survey PAF rotation.

SKA1_Survey derotation. SKA1_Survey shall provide PAF rotation capability

sufficient to orient Phased Array Feed beams on a sky coordinate frame

independent of parallactic angle.

SKA1-SYS_REQ-2282 Central location for data bases

Central location for data bases. External sources of information used by the

Elements shall be cached by Telescope Manager. No sources other than those

cached by TM shall be used.

SKA1-SYS_REQ-2283 Target of opportunity

Target of opportunity. TOO observing shall be via Scheduling Blocks.

SKA1-SYS_REQ-2285 Latency of TOO scheduling block initiation.

Latency of TOO scheduling block initiation . Scheduling intervention on TOO

triggers shall be initiated within 1s of receiving the trigger.

SKA1-SYS_REQ-2286 Discard previous scheduling block.

Discard previous scheduling block . At the launching of a TOO Scheduling

Block, the results from any active Scheduling Blocks shall be discarded.

SKA1-SYS_REQ-2312 Alarm latency.

Alarm latency. Latency from event to alarm shall be no more than 5 seconds.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the

pipeline processing log, and Quality Assessment log.

SKA1-SYS_REQ-2355 Data product provenance.

Data product provenance. An official data product shall have known,

documented provenance, and shall have been produced via SKA observations

and processing.

SKA1-SYS_REQ-2357 QA annotation.

QA annotation. The telescope shall facilitate the addition of QA annotations

by Users.

SKA1-SYS_REQ-2474 RFI masking

Page 102: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 102 of 128

RFI masking. The SKA1 Telescopes shall flag data according to a pre-selected

RFI Mask.

SKA1-SYS_REQ-2788 Non-propagation of failures

Non-propagation of failures . The equipment shall be designed such that

hardware failures and software errors should not create a hazardous situation

to interfacing systems.

SKA1-SYS_REQ-2833 SKA1_Mid inclusion of MeerKAT

SKA1_Mid inclusion of MeerKAT. The SKA1_Mid shall incorporate the 64

antennas in both monitor and control and data collection functions.

F.15.1.1 Manage LMC Instances

Services to manage and maintain parallel instances of various aspects

of the LMC sub-element, principally to enable sub-array capabilities.

Part of the master controller.

SDP_REQ-25 Independent Operations

LMC functions should be able to operate concurrently and with

performance which is independent of other LMC instances

SDP_REQ-26 Resource sharing

The Master Controller shall ensure that any shared resources between

SDP instances on different telescopes do not compromise the ability of

the instance to act concurrently and independently.

SKA1-SYS_REQ-2127 Sub-Arraying.

Sub-Arraying. All of the SKA1 telescopes shall be capable of

operating independently with one to sixteen sub-arrays (i.e. collecting

area is split and allocated to separate, concurrently observing

programmes).

SKA1-SYS_REQ-2230 Multiple timings.

Multiple timings. The SKA Phase 1 shall be capable of timing up to 16

pulsars simultaneously in total across all timing sub arrays .

SKA1-SYS_REQ-2264 SKA1_Survey sub-arraying.

SKA1_Survey sub-arraying. It shall be possible to split the

SKA1_Survey array into independent operable ASKAP and SKA1

dish sub-arrays.

F.15.1.2 Manage Data Flow Graphs

Manages the identification, creation and deployment of data flow

graphs.

SDP_REQ-624 Data Flow Graphs

The SDP shall be responsible for the indentifiction, creation and

dissemination of data flow graphs

F.15.1.2.1 Manage Data Flow Models

Curation and provision of the underlying data flow models

from the data flow model store to the data flow manager as

they are needed.

SDP_REQ-625 Data Flow Models

Page 103: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 103 of 128

The Master Controller shall provide updated data flow models

to the Data Flow Manager as/when they are needed.

F.15.1.2.2 Component Profiling

Tools to profile pipeline components to assist with decision

making in the graph building process.

SDP_REQ-626 Component Profiles

The SDP shall maintain profiles of pipeline components needed

for the construction of data flow graphs.

F.15.1.2.3 Hardware Resource Availability

Services to interrogate and report on the current availability of

hardware resources needed to construct a physical data flow

graph.

SDP_REQ-627 Hardware availability

The SDP shall determine the availablity of hardware resources

needed for the construction of data flow graphs.

F.15.1.2.4 Construct Physical Data Flow Graph

Build a physical data flow deployment graph based on the

chosen data flow model.

SDP_REQ-628 Create data flow graphs

The SDP shall build physical data flow deployment graphs

based on chosen data flow models.

F.15.1.3 Power Control

Controls all aspects of SDP power management, including bringup

from standby to unconfigured state.

SDP_REQ-629 Power Management

The Master Controller shall control all aspects of SDP power

management

F.15.1.3.1 Read Standby Configuration

Load the standby configuration into the power control system

to allow the transition to the unconfigured state.

SDP_REQ-630 Load standby configuration

The Master Controller shall load the standy configuratuon

scheme into the power control system to allow for the transition

to the unconfigured state.

F.15.1.3.2 Graceful Shutdown

Halt the entire SDP, apart from power on components, in a

graceful fashion. No time guarantee is given.

SDP_REQ-30 Graceful degradation

The SDP shall handle internal hardware and software failures

in a graceful fashion.

SDP_REQ-31 Graceful degradation - evaluation

Page 104: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 104 of 128

The Master Controller shall evaluate internal hardware and

software failures as they occur in order to identify possible next

steps, including continuance, degraded operation, and

termination.

SDP_REQ-32 Graceful degradation - reporting

The Master Controller shall report the outcomes of any

automated failure handling to the TM via the logging

mechanism specified in SKA-TEL.SDP.SE-TEL.TM.SE-ICD-

001.

SDP_REQ-620 Graceful Error Recovery

The SDP shall recover gracefully from internal failures in both

hardware and software. Priority is to be placed on preserving

partially processed or buffered data to allow processing to be

restarted if possible.

SDP_REQ-621 Preservation of Intermediate Data Products

The SDP, on entering an error state, shall preserve structurally

valid intermediate data products until commanded to discard

them.

SDP_REQ-622 Inform TM on Availability of Data Products

The SDP, on entering an error state, shall inform the TM on the

state and availability of intermediate data products.

F.15.1.3.3 Emergency Shutdown

Halt the SDP components as fast as is safely possible. No

regard is paid to data integrity (outside of the archive). A time

guarantee may be given.

SDP_REQ-623 Restart Processing after Error

The SDP shall allow the TM to request a restart of a particular

observation based on the availability of intermediate data

products.

SKA1-SYS_REQ-2786 Safety documentation file

Safety documentation file . Elements shall provide procedures

for maintainers to recover from an unplanned shut-down,

including safety checks to be conducted prior to start-up, as

specified in SKA PRODUCT ASSURANCE & SAFETY

PLAN SKA-OFF.PAQA-SKO-QP-001.

F.15.1.4 Sub-element Control

Controls sub-elements within the SDP. Principally these include the

Data Manager, Platform Manager and the Scheduler.

SDP_REQ-375 SDP platform management

The SDP shall provide a dedicated platform management function.

SDP_REQ-376 Platform management interface to LMC

The SDP compute system platform management function shall have an

interface to the SDP LMC system.

SDP_REQ-378 Deployment system

Page 105: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 105 of 128

The SDP compute system platform management function shall contain

a deployment service.

SDP_REQ-379 Scheduler

The SDP compute system platform management function shall provide

a scheduler for the compute system resources.

SDP_REQ-380 Scheduler Interface

The SDP compute system scheduler shall have an interface with the

LMC system, and with the pipelines.

SDP_REQ-382 Component system consistency

The SDP compute system deployment system shall ensure all

component systems are in a consistent, verifiable, documented, and

reproducible state at all time.

F.15.1.5 Observation Control

Services related to the setup and management of observations.

SDP_REQ-10 Observation control - status

The Master Controller shall provide a STATUS command which will

report on the status of the specified telescope operating mode.

SDP_REQ-13 Frequency control - switch

The Master Controller shall, on request from TM, switch the center

frequency in use for the current observation within 30 seconds (TBD).

SDP_REQ-17 Scheduling - Compute

The Master Controller shall be able to instruct the Scheduler to

schedule an observation to commence at a particular time with a

particular capability.

SDP_REQ-18 Scheduling - Data Layer

The Master Controller shall be able to instruct the Data Layer, via the

Data Flow Manager, to schedule on observation to commence at a

particular time with a particular capability.

SDP_REQ-19 Scheduling - Delivery

The Master Controller shall be able to instruct the Data Delivery

subsystem to schedule an observation to commence at a particular time

with a particular capability.

SDP_REQ-20 Scheduling - Feedback

The Master Controller shall aggregate scheduling responses from the

Scheduler, the Data Layer and the Data Delivery subsystem in order to

produce a detailed report on the success or failure of the scheduling

request.

SDP_REQ-21 Control - Compute

The Master Controller shall be able to instruct the Scheduler to start,

stop or provide status of a previously scheduled observation.

SDP_REQ-22 Control - Data Layer

The Master Controller shall be able to instruct the Data Layer, via the

Data Flow Manager, to start, stop or provide status of a previously

scheduled observation.

Page 106: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 106 of 128

SDP_REQ-23 Control - Delivery

The Master Controller shall be able to instruct the Data Delivery

subsystem to start, stop or provide status of a previously scheduled

observation.

SDP_REQ-24 Control - Feedback

The Master Controller shall aggregate control responses from the

Scheduler, Data Layer and Data Delivery subsystem in order to

produce a detailed report on the success or failure or status information

of a control request.

SDP_REQ-26 Resource sharing

The Master Controller shall ensure that any shared resources between

SDP instances on different telescopes do not compromise the ability of

the instance to act concurrently and independently.

SDP_REQ-27 Observation control - switching

The Master Controller shall be able to switch between previously

scheduled observations within 30 seconds (TBD - based on

performance allocations of SKA-2133).

SDP_REQ-5 Observation scheduling

The SDP shall allow TM to schedule a requested observation.

SDP_REQ-6 Observation scheduling feedback

The Master Controller shall provide an OK/FAIL response with

reasons when a schedule request is issued.

SDP_REQ-8 Observation control - start

The Master Controller shall provide a START command to allow a

scheduled mode of operation to commence.

SDP_REQ-9 Observation control - stop

The Master Controller shall provide a STOP command to allow a

currently executing mode of operation to be terminated permanently.

F.15.1.5.1 Observation Runtime Estimation

Used to estimate the wall clock runtime for a particular

observation. This is used by TM during the observation

planning phase.

SDP_REQ-381 Scheduler input

The SDP compute system scheduler shall get observation mode

input the LMC system and run-time estimates from the

pipelines to produce an estimate of observation processing

time.

F.15.1.5.2 Observation Resource Estimation

Used to estimate the resources required to execute a particular

observation. Used by TM in the observation planning phase.

SDP_REQ-12 Frequency availability

The Master Controller shall, on request from TM, provide a

response as to whether the requested frequency band is

available within 1 second.

Page 107: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 107 of 128

SDP_REQ-14 Availability - Compute

The Master Controller shall be able to query the Scheduler in

order to determine the availability of compute resources

(hardware and software) for a specific capability.

SDP_REQ-15 Availability - Data Layer

The Master Controller shall be able to query the Data Layer,

via the Data Flow Manager, in order to determine the

availability of data layer resources (transport, buffer and

archive) for a specific capability.

SDP_REQ-16 Availability - Delivery

The Master Controller shall be able to query the Data Delivery

subsystem in order to determine the availability of delivery

resources for a specific capability.

SDP_REQ-4 Capability availability

The SDP shall on request from the TM provide availability

information for the requested capability.

F.15.1.6 Observation Simulation

Allows simulation of an observation without the presence of the

Telescope Manager. Used in conjunction with the meta data simulator

and a CSP simulator (to be defined) to provide a complete

environment in which to carry out simulated operations.

SDP_REQ-631 Simulate observations

The Master Controller shall allow observations to be simulated

(without the Telescope Manager) in conjunction with a meta-data

simulator and CSP simulator.

F.15.1.7 Receive observation configuration

This is the component that actually receives observation configuration

from the TM.

SDP_REQ-38 Metadata input

The SDP shall query the Telescope Model for all static and dynamic

configuration data that is required prior to and during the execution of

a specific observation.

F.15.1.8 LMC Self Test

Provides self-testing services to allow internal and external users to

test the current state of the overall LMC function (and perhaps the

whole SDP as well).

SDP_REQ-34 Self testing

The SDP shall provide an automated self-test function that will

generate a report on the health of the SDP system as a whole, including

malfunction and out of tolerance operation.

F.15.2 Monitoring

Provides monitoring, logging, alarm, and event handling services for exposure

upwards to the Telescope Manager, and for internal use within the SDP.

SDP_REQ-450 SDP standard pipeline products

Page 108: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 108 of 128

The SDP shall include as data products the pipeline processing log, and

Quality Assessment log for all pipelines.

SKA1-SYS_REQ-2280 System status.

System status. The system shall extract information about the current

condition of the system from the science and calibration data streams, and log

this information along with other relevant system and environmental status

information. Based on this information, it shall be possible to monitor, save,

and analyse the technical performance of the system.

SKA1-SYS_REQ-2546 Continuous performance monitoring.

Continuous performance monitoring. Where possible, the system shall be

designed to provide continuous performance monitoring.

F.15.2.1 Monitoring Data Collection

Services to collect, aggregate and store monitoring data from SDP

sub-elements

SDP_REQ-592 Status Monitoring

The SDP shall query status of science and calibration data streams.

F.15.2.2 Central Logging

A central (but likely physically distributed) logging capability that

allows fine-grained control of logging at a variety of levels within each

SDP sub-element.

SDP_REQ-593 Status Logging

The SDP shall log received status information.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products

the pipeline processing log, and Quality Assessment log.

F.15.2.3 Event Handling

Handles events (and alarms as a special case). Includes collection,

aggregation and dissemination to other parties.

SDP_REQ-632 Event handler

The Master Controller shall initiate an event handler in response to

specific events and/or alarms.

F.15.2.3.1 Handle Alarms

Alarms are special cases of events and will need extra handling

procedures, particular on the notification front.

SDP_REQ-35 Alarms

The SDP shall support the generation of notification events, in

the form of alarms, to the TM based on predefined conditions.

SDP_REQ-36 Alarm timestamps

Alarm time stamps shall be accurate to TBD milliseconds and

with TBD milliseconds resolution.

SDP_REQ-37 Alarm latency

Latency from event to alarm shall be no more than 5 seconds.

SKA1-SYS_REQ-2312 Alarm latency.

Page 109: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 109 of 128

Alarm latency. Latency from event to alarm shall be no more

than 5 seconds.

F.15.2.3.2 Event Notification

Function to provide notification services for all event types.

SDP_REQ-594 Status Reporting

The SDP shall use received status information to report on

technical performance.

F.15.2.3.3 Event Aggregation

Function to handle aggregation and suppression of events

based on pre-defined rules.

SDP_REQ-633 Event aggregation

The Master Controller shall aggregate and suppresse events

based on pre-defined rules.

F.15.2.4 Health State

Produces health indications suitable for consumption by the Telescope

Manager. Based on information collected by the monitor, logger and

event frameworks.

SDP_REQ-377 System health monitoring

The SDP compute system platform management function shall collect

and expose system health information to be made available to the

LMC.

F.15.3 Quality Assurance

Provides collection and visualisation of metrics that relate to the quality and

integrity of the science payload at various stages of processing through the

SDP.

SDP_REQ-450 SDP standard pipeline products

The SDP shall include as data products the pipeline processing log, and

Quality Assessment log for all pipelines.

SKA1-SYS_REQ-2336 Standard pipeline products.

Standard pipeline products. All pipelines shall include as data products the

pipeline processing log, and Quality Assessment log.

SKA1-SYS_REQ-2742 Performance assessment

Performance assessment: Performance assessment shall be based on multi-

valued functions of an observed Image and optionally a template Image.

SKA1-SYS_REQ-2743 Performance goals

Performance Goals: Performance goals shall be based on multi-valued

functions of an observed Image and optionally a template Image.

SKA1-SYS_REQ-2744 Quality assessment

Quality assessment. Quality assessment shall be based on the comparison of a

Performance Assessment and a Performance Goal.

F.15.3.2 QA Visualisation

Visualisation of the various metric used in Quality Assurance.

Page 110: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 110 of 128

SDP_REQ-40 Quality assessment interface

The SDP shall provide an interface to allow the quality of the scientific

data to be assessed against a set of predefined criteria.

F.15.3.2.1 Client side rendering

Rendering function used when data is sent directly to the client

and rendered into a viewable graph.

SDP_REQ-41 Performance assessment

The User Interface shall allow the configuration and evaluation

of a performance assessment based on data provided by internal

SDP metrics.

F.15.3.2.2 Server side rendering

Renderer used when the viewable plot / image is produced on

the server side and sent in vector or bitmap form to the client

for direct display.

SDP_REQ-42 Performance goals

The User Interface shall allow the configuration of performance

goals that describe the desired outcome of a particular

performance assessment.

SDP_REQ-43 Quality assessment calculation

The User Interface shall allow the calculation of a quality

assessment based on a comparison of a particular performance

assessment and its associated performance goal.

F.15.3.3 QA Control

Specialist control of the QA visualisation and metric collection

process. For instance, the operator may select only a set of interesting

baselines on which to produce power spectrum plots.

SDP_REQ-595 QA annotations

The SDP shall provide the capability to attach QA-related data to data

output streams.

SKA1-SYS_REQ-2357 QA annotation.

QA annotation. The telescope shall facilitate the addition of QA

annotations by Users.

F.15.4 Local Telescope Model

Provides services to read and write data to the local telescope model.

SDP_REQ-49 Telescope Manager API

The SDP shall support the API specified in SKA-TEL.SDP.SE-TEL.TM.SE-

ICD-001 for all interaction with the TM.

SKA1-SYS_REQ-2645 Telescope Model

Telescope model. A dynamic computational model of the Telescope shall be

used to answer all queries about the state of the Telescope. The telescope

model shall consist of configuration information, numerical models, empirical

parameters, and conventions.

Page 111: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 111 of 128

F.15.4.1 Ingest Metadata

Receive metadata from external telescope elements. Typically this will

be a stream of meta-data from the Telescope Manager, but may also

involve reading static configuration entities.

SDP_REQ-38 Metadata input

The SDP shall query the Telescope Model for all static and dynamic

configuration data that is required prior to and during the execution of

a specific observation.

SDP_REQ-597 Component system state information

Component system state information of the SDP compute system shall

be made available as part of the observation meta data.

F.15.4.2 Maintain Telescope Model

Using available data sources, both internal and external, make sure

the local telescope model reflects the current state of the telescope.

SDP_REQ-288 Telescope Model

The SDP shall use a dynamic computational model of the Telescope to

answer all queries about the state of the Telescope. The telescope

model shall consist of configuration information, numerical models,

empirical parameters, and conventions.

F.15.4.2.1 Validate Telescope Model

Check to ascertain the validity of key parts of the model. Useful

in situations where certain metadata must be known prior to a

particular operation commencing.

SDP_REQ-634 Telescope Model-Validation

The Master Controller shall validate key elements of the

telescope model.

F.15.4.2.2 Update Telescope Model

Insert new values into the telescope model, checking for

consistency and validity.

SDP_REQ-635 Telescope Model-Update

The Master Controller shall update key elements of the

telescope model.

F.15.4.3 Serialise Model

Provide a serialised view of the current model, typically used to write

to disk as part of commissioning and set to work activities.

SDP_REQ-636 Telescope Model-Serialise

The Master Controller shall provide a serialised view of the current

telescope model.

F.15.4.4 Simulate Telescope Model

Allows the required meta-data for a simulation observation to be

directly produced within the local telescope model.

SDP_REQ-39 Metadata proxy

Page 112: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 112 of 128

The Master Controller shall act as the internal proxy for all SDP

components required telescope meta-data.

F.15.4.5 Handle Transactions

For high update rate use cases, such as the sky model, provide a

transaction capability to allow control of how changes propagate

through the model.

SDP_REQ-637 High update rate -transactions

The Master Controller shall provide a transaction capability for high

update rate use cases to allow control of how changes propogate

through the telescope model.

F.16 Commissioning

To do processing required for commissioning of the SKA system. Needs more

decomposition as the SKA commissioning plan is not yet available.

SDP_REQ-616 Restore visibility data from archive to buffer

The SDP shall be able to restore visibilities from the science data archive to the buffer

in order to process visibilities from previous observations.

SKA1-SYS_REQ-2657 Processing capability

Processing capability. SDP processing per telescope at Early Science shall support

processing rates 10% of that required for Full Observing (decimation being in any or

all of time, frequency, field of view )

F.18.1 Simulation

Page 113: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 113 of 128

3.2. SDP non-functional requirements

NF.1 Security

SDP Security requirements,

SDP_REQ-360 Security requirements

The SDP shall include the following list of Security requirements in the SDP

design:SKA1-SYS_REQ-2478 Equipment securitySKA1-SYS_REQ-2479 Archive

securitySKA1-SYS_REQ-2504 Facilities and Equipment Intrusion.SKA1-SYS_REQ-

2793 Personnel security trainingSKA1-SYS_REQ-2822 Information security risk

assessmentSKA1-SYS_REQ-2823 Information security management for inter-

organizational communications

SKA1-SYS_REQ-2478 Equipment security

Equipment security. The observatory shall provide a secure environment for

equipment. This shall include protection of generators, fuel, solar cells and inter-

station assets such as copper cables.

SKA1-SYS_REQ-2479 Archive security

Archive security. The observatory shall provide a secure environment for all its data

archives.

SKA1-SYS_REQ-2504 Facilities and Equipment Intrusion.

Facilities and Equipment Intrusion . Where appropriate, SKA1 equipment facilities

shall be adequately protected against intrusion by insect and "larger" wandering

animals.

SKA1-SYS_REQ-2793 Personnel security training

Personnel security training . All personnel shall receive the security training identified

in the Security Management System necessary for their location. Additional specialist

pre-deployment training shall be given prior to working in remote environments.

SKA1-SYS_REQ-2822 Information security risk assessment

Information security risk assessment . An information security risk assessment shall

be conducted for each element in accordance with ISO/IEC 27005.

SKA1-SYS_REQ-2823 Information security management for inter-

organizational communications

Information security management for inter-organizational communications.

Information transfer between organisations shall be controlled in accordance with

ISO/IEC 27010 as tailored by SKA Organisation Security Policy.

NF.2 Equipment & Component Specifications

SDP equipment and component requirements.

SDP_REQ-361 Equipment and Component requirements

The SDP shall include the following list of Equipment and Component requirements

in the SDP design:SKA1-SYS_REQ-2501 Storage and transport Humidity.SKA1-

SYS_REQ-2502 Condensation.SKA1-SYS_REQ-2503 Pressure.SKA1-SYS_REQ-

2505 Sand and Dust.SKA1-SYS_REQ-2506 Fungus.SKA1-SYS_REQ-2509 Scope of

workmanship standards.SKA1-SYS_REQ-2513 Critical-useful-life

components.SKA1-SYS_REQ-2515 Component selection.SKA1-SYS_REQ-2516

Matching components.SKA1-SYS_REQ-2521 Component derating.SKA1-

SYS_REQ-2525 Fail safe provisions.SKA1-SYS_REQ-2543 Direct fault

indicatorsSKA1-SYS_REQ-2552 Malfunction detection.SKA1-SYS_REQ-2554

Page 114: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 114 of 128

Ergonomics.SKA1-SYS_REQ-2572 Material environmental rule compliance.SKA1-

SYS_REQ-2573 Serial number.SKA1-SYS_REQ-2574 Drawing numbers.SKA1-

SYS_REQ-2575 Marking method.SKA1-SYS_REQ-2576 Electronically readable or

scannable IDSKA1-SYS_REQ-2577 Package part number marking.SKA1-

SYS_REQ-2578 Package serial number marking.SKA1-SYS_REQ-2579 Hazard

warning marking.SKA1-SYS_REQ-2580 LRU electrostatic warningsSKA1-

SYS_REQ-2581 Packaging electrostatic warnings.SKA1-SYS_REQ-2583 Cable

identification.SKA1-SYS_REQ-2584 Connector plates. All connector plates shall

carry identification labels for connectorsSKA1-SYS_REQ-2594 Modular

packaging.SKA1-SYS_REQ-2596 Discard at failure items.SKA1-SYS_REQ-2598

Module access.SKA1-SYS_REQ-2599 Component removal.SKA1-SYS_REQ-2600

Secure mounting of modules.SKA1-SYS_REQ-2601 Shock mounting

provision.SKA1-SYS_REQ-2602 Mounting preclusion.SKA1-SYS_REQ-2603

Mounting guides.SKA1-SYS_REQ-2604 Module labelling.SKA1-SYS_REQ-2605

Label robustness.SKA1-SYS_REQ-2606 Disposable item labelling.SKA1-

SYS_REQ-2733 Location of Emergency stop.SKA1-SYS_REQ-2798 Protection of

equipment in stationary use at non-weather protected locationsSKA1-SYS_REQ-2799

Protection of equipment in weather- protected locationsSKA1-SYS_REQ-2800

Transportation of equipmentSKA1-SYS_REQ-2801 Storage of equipment

SKA1-SYS_REQ-2501 Storage and transport Humidity.

Storage and transport Humidity . The storage and transport humidity shall be between

40% and 95%.

SKA1-SYS_REQ-2502 Condensation.

Condensation . Appropriate measures shall be taken to prevent the formation of

condensation on operating electronic components.

SKA1-SYS_REQ-2503 Pressure.

Pressure . Components shipped by air shall be capable of surviving pressures down to

11 kPa (equivalent altitude ~ 50,000 feet).

SKA1-SYS_REQ-2505 Sand and Dust.

Sand and Dust . SKA1 systems shall be adequately protected against sand and dust

ingress.

SKA1-SYS_REQ-2506 Fungus.

Fungus . Equipment shall be protected against fungus growth.

SKA1-SYS_REQ-2509 Scope of workmanship standards.

Scope of workmanship standards. SKA1 dedicated workmanship standards shall

cover all phases of production, assembly and integration, testing, handling, and

include clear requirements for acceptance/rejection criteria.

SKA1-SYS_REQ-2513 Critical-useful-life components.

Critical-useful-life components . Any critical-useful-life components shall be

identified.

SKA1-SYS_REQ-2515 Component selection.

Component selection . Parts and components shall be selected to meet reliability

requirements.

SKA1-SYS_REQ-2516 Matching components.

Matching components . Parts requiring select on test shall be eliminated by deign if

possible.

Page 115: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 115 of 128

SKA1-SYS_REQ-2521 Component derating.

Component derating . Safety factors and margins shall be applied in the selection of

modules and components

SKA1-SYS_REQ-2525 Fail safe provisions.

Fail safe provisions . Designs shall implement fail-safe provisions to prevent

secondary failures.

SKA1-SYS_REQ-2543 Direct fault indicators

Direct fault indicators Where possible, direct fault indicators shall be designed in to

equipment.

SKA1-SYS_REQ-2552 Malfunction detection.

Malfunction detection. All equipment malfunction shall be detected at the system

level.

SKA1-SYS_REQ-2554 Ergonomics.

Ergonomics . The ergonomic design shall be compliant with ISO 6385.

SKA1-SYS_REQ-2572 Material environmental rule compliance.

Material environmental rule compliance. All materials used in the SKA1 design shall

be fully compliant to all environmental rules applicable to the SKA1 core and remote

sites.

SKA1-SYS_REQ-2573 Serial number.

Serial number . Each part shall be marked with a unique serial number in an easily

visible location.

SKA1-SYS_REQ-2574 Drawing numbers.

Drawing numbers . Each LRU type shall be identified with a unique drawing number.

SKA1-SYS_REQ-2575 Marking method.

Marking method. Method of marking shall be compatible with the nature of the item,

its environment and its use.

SKA1-SYS_REQ-2576 Electronically readable or scannable ID

Electronically readable or scannable ID. Where possible line replaceable items shall

be marked with an Electronically readable or scannable ID.

SKA1-SYS_REQ-2577 Package part number marking.

Package part number marking . All packaging shall be marked with the part number

of the contents.

SKA1-SYS_REQ-2578 Package serial number marking.

Package serial number marking . All packaging shall be marked with the serial

number of the contents.

SKA1-SYS_REQ-2579 Hazard warning marking.

Hazard warning marking . All items that present a potential hazard shall be labelled in

accordance with BS EN ISO 7010.

SKA1-SYS_REQ-2580 LRU electrostatic warnings

LRU electrostatic warnings All LRUs with electrostatic sensitive components shall be

fitted with ESD warning labels.

SKA1-SYS_REQ-2581 Packaging electrostatic warnings.

Packaging electrostatic warnings. All packaging containing static sensitive contents

shall be marked with ESD warning labels.

Page 116: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 116 of 128

SKA1-SYS_REQ-2583 Cable identification.

Cable identification. All cables ends shall carry a unique identifier.

SKA1-SYS_REQ-2584 Connector plates. All connector plates shall carry

identification labels for connectors

Connector plates. All connector plates shall carry identification labels for connectors.

SKA1-SYS_REQ-2594 Modular packaging.

Modular packaging. The packaging of components shall be modular to limit

maintenance to the removal of one module.

SKA1-SYS_REQ-2596 Discard at failure items.

Discard at failure items. Discard at failure items shall be packed at low cost.

SKA1-SYS_REQ-2598 Module access.

Module access . Where applicable, access between modules shall be sufficient to

facilitate hand grasping.

SKA1-SYS_REQ-2599 Component removal.

Component removal . Modules and components shall be mounted such that removal

of any single item will not require the removal of other items (component stacking to

be avoided where possible)

SKA1-SYS_REQ-2600 Secure mounting of modules.

Secure mounting of modules . Modules shall be securely mounted (in compliance

with the shock and vibration requirements) with the minimum number of fasteners.

SKA1-SYS_REQ-2601 Shock mounting provision.

Shock mounting provision . Shock mounting provisions shall be made where

applicable.

SKA1-SYS_REQ-2602 Mounting preclusion.

Mounting preclusion . Provisions for the preclusion of mounting the wrong module

shall be provided (key coding of connectors etc.).

SKA1-SYS_REQ-2603 Mounting guides.

Mounting guides . Mounting guides and location pins shall be provided to facilitate

module mounting.

SKA1-SYS_REQ-2604 Module labelling.

Module labelling . Where possible, labelling of modules shall be on the top or

adjacent in plain sight.

SKA1-SYS_REQ-2605 Label robustness.

Label robustness . Labels shall be permanently affixed and unlikely to come off

during maintenance or as a result of the environment.

SKA1-SYS_REQ-2606 Disposable item labelling.

Disposable LRU labelling . Disposable line replaceable units should be labelled as

such.

SKA1-SYS_REQ-2733 Location of Emergency stop

Location of Emergency stop . Emergency stop switches shall be located in such a way

to minimize the risk of injury. (Verified by Analysis as 'minimisation' is unverifiable

any other way.)

SKA1-SYS_REQ-2798 Protection of equipment in stationary use at non-weather

protected locations

Page 117: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 117 of 128

Protection of equipment in stationary use at non-weather protected locations .

Equipment in stationary use at non-weather protected locations shall be protected

against environmental conditions 4K4H/ 4Z1/ 4Z5/ 4Z6/ 4B2/ 4C1/ 4S3/ 4M4 in

accordance with BS EN IEC 60721-3-4. NOTE: 4Z5 refers to the survival, non-

operational mode. The equipment shall be able to operate normally for air movement

up to 11 m/s

SKA1-SYS_REQ-2799 Protection of equipment in weather- protected locations

Protection of equipment in weather-protected locations. Equipment in stationary use

at weather protected locations shall be protected against environmental conditions

3K8H/ 3Z1/ 3Z11/ 3Z12/ 3B3/ 3C1R/ 3S3/ 3M4 in accordance with BS EN IEC

60721-3-3.

SKA1-SYS_REQ-2800 Transportation of equipment

Transportation of equipment . Equipment shall be designed to withstand

transportation from an engineering depot to a station exposed to environmental

conditions 2K5H/2B3/2C1/2S3/2M3 as detailed in BS EN IEC 60721-3-2. NOTE: It

may be assumed that the equipment will be transported in the original packaging that

it was delivered to the engineering depot.

SKA1-SYS_REQ-2801 Storage of equipment

Storage of equipment. Designs shall identify any requirements for equipment to be

stored in environmental conditions less severe than 1K11/1B3/1C1/1S3/1M3 as

specified inBS EN IEC 60721-3-1. Note: It may be assumed that equipment will be

stored in its original packaging.

NF.3 Production & Manufacturing Specifications

SDP production and manufacturing requirements.

SDP_REQ-363 Production and Manufacturing requirements

The SDP shall include the following list of Production and Manufacturing

requirements in the SDP design:SKA1-SYS_REQ-2559 Design for economic

production.SKA1-SYS_REQ-2560 Design definition.SKA1-SYS_REQ-2561

Manufacturing facilities.SKA1-SYS_REQ-2562 Standard manufacturing tools.SKA1-

SYS_REQ-2566 Materials list.SKA1-SYS_REQ-2567 Hazardous Materials

list.SKA1-SYS_REQ-2568 Parts list.SKA1-SYS_REQ-2569 Process list.SKA1-

SYS_REQ-2570 Parts availability.SKA1-SYS_REQ-2571 Long lead time items.

SKA1-SYS_REQ-2559 Design for economic production.

Design for economic production . All designs for the SKA shall be designed for

economic production. This is required to ensure that the SKA is buildable for a

reasonable cost (Con Ops Section 1.2)

SKA1-SYS_REQ-2560 Design definition.

Design definition . Design definition shall be in sufficient detail to allow one or more

manufacturers to produce the same item within identified tolerances.

SKA1-SYS_REQ-2561 Manufacturing facilities.

Manufacturing facilities . Where possible, currently existing facilities shall be used

for manufacturing.

SKA1-SYS_REQ-2562 Standard manufacturing tools.

Standard manufacturing tools . Where possible, standard manufacturing tools shall be

used.

Page 118: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 118 of 128

SKA1-SYS_REQ-2566 Materials list.

Materials list. Each sub-system supplier shall provide a Materials list for all items

intended for use within SKA1.

SKA1-SYS_REQ-2567 Hazardous Materials list.

Hazardous Materials list. Each Element supplier shall provide a list of hazardous

materials used for all items intended for use in the SKA1 detailing suggested handling

precautions, disposal instructions and contra-indications.

SKA1-SYS_REQ-2568 Parts list.

Parts list. Each Element supplier shall provide a parts list for all items intended for use

in the SKA1.

SKA1-SYS_REQ-2569 Process list.

P rocess list. Each element supplier shall provide a process list for all items intended

for use in the SKA1.

SKA1-SYS_REQ-2570 Parts availability.

Parts availability. The estimated availability of the parts shall be compatible with the

final system's life cycle.

SKA1-SYS_REQ-2571 Long lead time items.

Long lead time items . Long lead time items shall be identified to the project

management.

NF.4 Operations

SDP operational requirements.

SDP_REQ-241 SDP to INFRA interface

The interface between the SDP and INFRA shall be compliant with the

SKA.TEL.SDP.SE-SKA.TEL.INFRA.SE-ICD-001 Interface Control Document.

SDP_REQ-242 SaDT interface

The interface between SADT and SDP shall be compliant with the SKA-

TEL.SADT.SE-TEL.SDP.SE-ICD-001 Interface Control Document.

SDP_REQ-358 Operational requirements

The SDP shall include the following list of Operational requirements in the SDP

design: SKA1-SYS_REQ-2118 South African Science Processing Centre SKA1-

SYS_REQ-2123 Australian Science Processing Centre SKA1-SYS_REQ-2116 South

African Engineering Operations Centre SKA1-SYS_REQ-2121 Australian

Engineering Operations Centre SKA1-SYS_REQ-2425 SADT to SDP interface.

SKA1-SYS_REQ-2431 SDP to TM interface. SKA1-SYS_REQ-2432 SDP to INFRA

interface. SKA1-SYS_REQ-2433 Design for SKA2 Extensibility SKA1-SYS_REQ-

2650 Seismic resilience SKA1-SYS_REQ-2716 Telescope availability SKA1-

SYS_REQ-2827 System Availability SKA1-SYS_REQ-2834 SKA1_Mid-MeerKAT

infrastructure reuse SKA1-SYS_REQ-???? SDP Power Cap

SKA1-SYS_REQ-2116 South African Engineering Operations Centre

South African Engineering Operations Centre. The South African Engineering

Operations Centre shall be located at Klerefontein.

SKA1-SYS_REQ-2118 South African Science Processing Centre

South African Science Processing Centre. The South African Science Processing

centre shall be located in Cape Town

Page 119: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 119 of 128

SKA1-SYS_REQ-2121 Australian Engineering Operations Centre

Australian Engineering Operations Centre The Australian Engineering Operations

Centre shall be in in Geraldton.

SKA1-SYS_REQ-2123 Australian Science Processing Centre

Australian Science processing centre The Australian Science Processing Centre shall

make use of floor space, power, cooling, and other infrastructure at the Pawsey centre

in Perth.

SKA1-SYS_REQ-2425 SADT to SDP interface.

SADT to SDP interface . The interface between SADT and SDP shall be compliant

with the SKA-TEL.SADT.SE-TEL.SDP.SE-ICD-001 Interface Control Document.

SKA1-SYS_REQ-2431 SDP to TM interface.

SDP to TM interface . The interface between SDP and TM shall be compliant with the

SKA-TEL.SDP.SE-TEL.TM.SE-ICD-001 Interface Control Document.

SKA1-SYS_REQ-2432 SDP to INFRA interface.

SDP to INFRA interface . The interface between SDP and Infra shall be compliant

with the SKA.TEL.SDP.SE-TEL.INFRA.SE-ICD-001 Interface Control Document.

SKA1-SYS_REQ-2433 Design for SKA2 Extensibility

Design for Extensibility .Design trade studies for SKA1 shall include scenarios where

design features are included which will allow Increases in the number of receptors for

SKA2 over SKA1 by a factor of 10 whilst re-using more than 90% of SKA1 hardware

The introduction of AIP technologies at SKA2 scales whilst re-using more than 90%

of SKA1 hardware Such trade studies shall yield the incremental cost of such

scenarios over those which do not include such design features.

SKA1-SYS_REQ-2650 Seismic resilience

Seismic resilience. SKA1 structures and equipment shall survive and be fully

operational after a seismic event of magnitude up to Richter 3.8. Note: Seismic event

includes underground collapses in addition to earthquakes.

SKA1-SYS_REQ-2716 Telescope availability

Average annual availability. Each SKA1 telescope shall have an operational

availability of 95%

SKA1-SYS_REQ-2827 System Availability

System Availability . System designs shall meet the system availability allocations

specified in SKA-OFF.SE.ARC-SKAO-RAM-001.

SKA1-SYS_REQ-2834 SKA1_Mid-MeerKAT infrastructure reuse

SKA1_Mid-MeerKAT infrastructure reuse. Where economically practicable, the

existing MeerKAT infrastructure will be reused

SKA1-SYS_REQ-???? SDP Power Cap

Missing L1 requirement for SDP power cap.

NF.5 EMC & RFI

SDP EMC and RFI requirements.

SDP_REQ-359 EMC and RFI requirements

The SDP shall include the following list of EMC and RFI requirements in the SDP

design:SKA1-SYS_REQ-2462 Electromagnetic RadiationSKA1-SYS_REQ-2463

Self-induced RFISKA1-SYS_REQ-2464 Electromagnetic Compatibility

Page 120: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 120 of 128

StandardsSKA1-SYS_REQ-2465 Electricity network Electromagnetic

CompatibilitySKA1-SYS_REQ-2466 EMC compatibility marking.SKA1-SYS_REQ-

2467 Electromagnetic susceptibility.

SKA1-SYS_REQ-2462 Electromagnetic Radiation

Electromagnetic Radiation. Any component of the observatory shall not emit

electromagnetic radiation, in any of the stated frequency intervals for broad band and

narrow band cases, that exceeds the SKA RFI/EMI Threshold Levels[4]

SKA1-SYS_REQ-2463 Self-induced RFI

Self-induced RFI. The SKA1 Telescope shall generate less self-induced RFI, within

the Telescope's operating frequency bands, than the SKA RFI/EMI Protection Levels,

for both broad band and narrow band cases, as specified in the "RFI/EMI Protection

and Threshold Levels for the SKA" document. The SKA RFI/EMI Protection Levels

are defined at the respective receiver input, and measured at the respective Telescope

time series output.

SKA1-SYS_REQ-2464 Electromagnetic Compatibility Standards

Electromagnetic Compatibility Standards. The SKA1 Telescopes shall be compliant

with one or more of the following standards for emissions and one or more for

susceptibility/immunity:*BS EN 61000-6-2. Electromagnetic compatibility (EMC).

Generic standards. Immunity standard for industrial environments.*BS EN 61000-6-4

AMD2. Electromagnetic compatibility (EMC). Part 6-4. Generic standards. Emission

standard for industrial environments.*BS CISPR 14-1. Electromagnetic compatibility.

Requirements for household appliances, electric tools and similar apparatus. Part 1.

Emission.*MIL-STD-464C

SKA1-SYS_REQ-2465 Electricity network Electromagnetic Compatibility

Electricity network Electromagnetic Compatibility. The SKA1 telescopes shall follow

the TBD code of practice for the application of Electromagnetic Compatibility (EMC)

standards and guidelines in electricity utility networks.

SKA1-SYS_REQ-2466 EMC compatibility marking.

EMC compatibility marking. All "off-the-shelf" equipment shall possess as a

minimum the host country EMC marking.

SKA1-SYS_REQ-2467 Electromagnetic susceptibility.

Electromagnetic susceptibility. The observatory shall not be susceptible to terrestrial

electromagnetic radiation at any frequency that significantly interferes with its normal

operation.

NF.6 Health, Safety & Environment

SDP health, safety and environmental requirements.

SDP_REQ-357 Health, Safety and Environmental requirements

The SDP shall include the following list of Health, Safety and Environmental

requirements in the SDP design:SKA1-SYS_REQ-2435 Hazard analysis.SKA1-

SYS_REQ-2436 Safety incident recovery planSKA1-SYS_REQ-2437 Design for

hazard elimination.SKA1-SYS_REQ-2438 Fail safe design.SKA1-SYS_REQ-2439

Emergency stop.SKA1-SYS_REQ-2443 Protection from high voltages.SKA1-

SYS_REQ-2444 Safety grounding and bonding.SKA1-SYS_REQ-2445 Electrical

circuit interlocks.SKA1-SYS_REQ-2446 Electrical safetySKA1-SYS_REQ-2448

Stand-off and handles.SKA1-SYS_REQ-2447 Sharp metal edges.SKA1-SYS_REQ-

2449 Construction Safety Plan.SKA1-SYS_REQ-2450 Safety information for

Page 121: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 121 of 128

useSKA1-SYS_REQ-2451 Safety training.SKA1-SYS_REQ-2452 Protective

clothing.SKA1-SYS_REQ-2454 Fire fighting equipment.SKA1-SYS_REQ-2455

Noise level dosage.SKA1-SYS_REQ-2456 Transient noise level.SKA1-SYS_REQ-

2457 Illumination.SKA1-SYS_REQ-2458 Clean airSKA1-SYS_REQ-2460

Occupational health legislation and regulations.SKA1-SYS_REQ-2481 Emergency

communicationSKA1-SYS_REQ-2483 Environment protection plan.SKA1-

SYS_REQ-2484 Environmental legislation and regulations.SKA1-SYS_REQ-2491

Safety.SKA1-SYS_REQ-2500 Operating Humidity.SKA1-SYS_REQ-2790

Environmental Impact AssessmentSKA1-SYS_REQ-2795 Travel safetySKA1-

SYS_REQ-2818 Marking of machinery - safetySKA1-SYS_REQ-2819 Safety of

machinery risk assessmentSKA1-SYS_REQ-2820 Safety of equipment with rated

voltage not exceeding 600V

SKA1-SYS_REQ-2435 Hazard analysis.

Hazard analysis . A hazard analysis shall be performed at the system and element

level in accordance with BS IEC 61882 and, where applicable, shall include a FMEA

in accordance with EN 60812.

SKA1-SYS_REQ-2436 Safety incident recovery plan

Safety incident recovery plan. A safety incident recovery plan shall be produced in

accordance with SKA PRODUCT ASSURANCE & SAFETY PLAN SKA-

OFF.PAQA-SKO-QP-001.

SKA1-SYS_REQ-2437 Design for hazard elimination.

Design for hazard elimination. Designs shall demonstrate the elimination, or

mitigation to a risk level practically achievable, of all hazards by means of a

subsystem hazard analysis (SSHA) report as described in EN 14738 and tailored by

SKA Product Assurance and Safety Plan SKA-OFF.PAQA-SKO-QP-001.

SKA1-SYS_REQ-2438 Fail safe design.

Fail safe design. Components and Equipment shall be designed to be locally fail-safe

and not rely on external safety devices or measures to operate safely.

SKA1-SYS_REQ-2439 Emergency stop.

Emergency stop . The SKA1 Elements shall have emergency stop switches or brakes

for all electro-mechanical or mechanical systems that have been identified by safety

analyses (required under SKA1-SYS_REQ-2435) to pose a hazard.

SKA1-SYS_REQ-2443 Protection from high voltages.

Protection from high voltages. High voltage cages or enclosures shall be used to

protect personnel from inadvertent access to high voltages in accordance with

AS/NZS3000 (Australia) and SANS10142 (South Africa).

SKA1-SYS_REQ-2444 Safety grounding and bonding.

Safety grounding and bonding . External conductive parts shall be grounded in

compliance to:South Africa:National Building Regulations and Building Standards

Act, 1977Occupational Health and Safety act, 1993SANS 10313Australia:AS/NZ

3000,AS/NZ 1768

SKA1-SYS_REQ-2445 Electrical circuit interlocks.

Electrical circuit interlocks . Electrical circuit inter-locks shall be provided to prevent

personnel coming into contact with hazards that cannot otherwise be eliminated from

design.

SKA1-SYS_REQ-2446 Electrical safety

Page 122: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 122 of 128

Electrical safety . Electrical risks and hazards shall be controlled in accordance with

local, State and national legislation and Codes of Practice.NOTE: In South Africa,

SANS 10142-1 and SANS 10142-2 shall apply.NOTE: In Australia, in addition to

legislation, the following Codes of Practice shall be applied:AS/NZ 3000Safe Work

Australia 'Managing Electrical Risks at the Workplace';Western Australia Director of

Energy Safety 'Safe Low Voltage Work Practices by Electricians'

SKA1-SYS_REQ-2447 Sharp metal edges.

Sharp metal edges . If they cannot be eliminated from design, sharp edges, access

openings and corners shall be protected with covers or coatings where feasible.

SKA1-SYS_REQ-2448 Stand-off and handles.

Stand-off and handles . Stand-offs and handles shall be used to protect system

components from damage during shop maintenance.

SKA1-SYS_REQ-2449 Construction Safety Plan.

Construction and AIV Safety Plan. A comprehensive safety plan, tailored to

construction and AIV activities, shall be established and implemented before the

construction starts at the observatory site.

SKA1-SYS_REQ-2450 Safety information for use

Safety information for use. Where risks remain despite inherently safe design

measures, safeguarding and the adoption ofcomplementary protective measures, the

residual risks shall be identified in the information for use in accordance with BS EN

ISO 12100 (section 6).The information for use shall include, but not be limited to, the

following:⎯ operating procedures for the use of the machinery consistent with

the expected ability of personnel who use the machinery or other persons who can be

exposed to the hazards associated with the machinery;⎯ the recommended

safe working practices for the use of the machinery and the related training

requirements adequately described;⎯ sufficient information, including

warning of residual risks for the different phases of the life of the

machinery;⎯ the description of any recommended personal protective

equipment, including detail as to its need as well as to training needed for its

use.Information for use shall not be a substitute for the correct application of

inherently safe design measures, safeguarding or complementary protective measures.

SKA1-SYS_REQ-2451 Safety training.

S afety training . All personnel shall be provided with appropriate Health and Safety

training in compliance with local regulations.

SKA1-SYS_REQ-2452 Protective clothing.

Protective clothing. Protective Clothing for areas where environments detrimental to

human safety shall be worn.

SKA1-SYS_REQ-2454 Fire fighting equipment.

Fire fighting equipment . Fire fighting equipment shall be made available at all SKA

premises and facilities.

SKA1-SYS_REQ-2455 Noise level dosage.

Noise level dosage. Personnel shall not be exposed to noise level dosages exceeding

local health and safety guideline levels. The maximum noise levels shall not exceed

an 8-hour average exposure of 85 decibels as specified in the Australian National

Standard for Occupational Noise NOHSC: 1007(2000) and South African Noise-

Induce Hearing Loss Regulations (No R.307 2003) of the Occupational Health and

Page 123: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 123 of 128

Safety Act, 1993 (Act No 85 of 1993). The desirable maximum noise level is 75

decibels. Note: The National Code of Practice for Noise Management and Protection

of Hearing at Work [NOHSC:2009(2004)] provides practical guidance on how

NOHSC:1007(2000) can be achieved.

SKA1-SYS_REQ-2456 Transient noise level.

Transient noise level. Noise levels exceeding 85dB shall be controlled or mitigated in

accordance with NOHSC National Standard for Occupational Noise [NOHSC: 1007].

SKA1-SYS_REQ-2457 Illumination.

Illumination. Personnel shall be provided with a working illumination level which is

compliant with local and national regulations including the current issue of SANS

10114-1 in South Africa and the AS/NZS 1680 series in Australia.

SKA1-SYS_REQ-2458 Clean air

Clean air. Personnel shall be provided with air quality at least compliant with the

current issue of SANS 10400-O (South Africa - The application of National Building

SKA1-SYS_REQ-2460 Occupational health legislation and regulations.

Occupational health legislation and regulations. The observatory shall comply with all

applicable local, State and national occupational health regulations and standards in

force at the time. Regulations include, but are not limited to:South

Africa:Occupational Health and Safety Act, 1993, and all its

regulations.Australia:Commonwealth Occupational Health and Safety Act 1991;OHS

(Safety Arrangements) Regulations 1991;OHS (Safety Standards) Regulations

1994;OHS Codes of Practice 2008.Western Australia:Occupational Safety and Health

Act 1984;Harmonised OHS legislation (as enacted).

SKA1-SYS_REQ-2481 Emergency communication

Emergency communication. The observatory shall provide an independent system to

communicate with outside locations in emergencies.

SKA1-SYS_REQ-2483 Environment protection plan.

Environment protection plan . An Environmental protection plan shall be developed

and maintained. This shall include the management of Environmental Impact

Assessments (EIA) in accordance with SA NEMA, WA EPA and Commonwealth

EPBC.

SKA1-SYS_REQ-2484 Environmental legislation and regulations.

Environmental legislation and regulations. The observatory shall be compliant with

all local, State and national environmental protection legislation and

regulations.NOTE: Legislation takes precedence over project/contract documentation

and requirements. Omission of a law from this requirement does not affect its

enforceability. Legislation is also subject to amendment and so the Environmental

Laws identified during the Request for Information (copied below) may be modified

by the Hosting Agreements and subsequent Acts and Amendments.Legislation and

regulations identified during the response to Request for Information include:South

Africa:National Environmental Management Act, 1998 ("NEMA");National Water

Act, 1998;National Environmental Management: Air Quality Act, 2004;National

Environmental Management Waste Act, 2008;National Environment Management:

Biodiversity Act, 2004;National Heritage Resources Act, 1999.*Australia:The

Commonwealth Environment Protection and Biodiversity Conservation (EPBC) Act

1999.The Western Australian Environmental Protection Act 1986The Western

Australian Land Administration Act 1997In addition, approvals will be required under

Page 124: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 124 of 128

the Western Australia Mining Act 1978, Heritage of Western Australia Act 1990, the

Western Australian Aboriginal Heritage Act 1972 and the MRO Indigenous Land Use

Agreement 2009.* Other South African environmental statutes include the

Environment Conservation Act, 1989, various air pollution statutes, the National

Heritage Resources Act, 1999, the Hazardous Substances Act, 1973, the Health Act,

1977, the Nuclear Energy Act, 1999, the National Nuclear Regulatory Act, 1999, the

National Environmental Management: Protected Areas Act, 2003, the Fertilisers,

Farm Feeds, Agricultural Remedies and Stock Remedies Act, 1947, the Marine

Living Resources Act, 1998, and the National Environmental Management: Integrated

Coastal Management Act, 2008.

SKA1-SYS_REQ-2491 Safety.

Safety. SKA1 equipment and buildings shall be designed and built in compliance with

national and State regulations including AS 1170.4 (Importance level 3, design life 50

years) and SANS 10160-4 for earthquakes of magnitude up to Richter 3.8.

SKA1-SYS_REQ-2500 Operating Humidity.

Operating Humidity . The operating humidity shall be between 40% and 60%

SKA1-SYS_REQ-2790 Environmental Impact Assessment

Environmental Impact Assessment . The Observatory shall undertake an

Environmental Impact Assessment (EIA) in accordance with the local and national

environmental legislation. NOTE: the EIA shall be undertaken in accordance with:

South Africa - the National Environmental Management Act (NEMA); Australia -

Western Australian EPA and Commonwealth EPBC.

SKA1-SYS_REQ-2795 Travel safety

Travel safety. Personnel shall adhere to local safety procedures for travelling in

remote areas. NOTE: Safety procedures should include the training and equipment

required, such as driving instruction, vehicles appropriate for the environment and

radio equipment.

SKA1-SYS_REQ-2818 Marking of machinery - safety

Marking of machinery - safety. In accordance with ISO 61310_2, machinery shall

bear all markings which are necessary ? for its unambiguous identification; ? for its

safe use; and supplementary information shall be given, as appropriate: ? permanently

on the machinery; ? in accompanying documents such as instruction handbooks; ? on

the packaging

SKA1-SYS_REQ-2819 Safety of machinery risk assessment

Safety of machinery risk assessment . A risk assessment shall be conducted for each

item of machinery in accordance with BS EN ISO 12100.

SKA1-SYS_REQ-2820 Safety of equipment with rated voltage not exceeding

600V

Safety of equipment with rated voltage not exceeding 600V . Equipment shall comply

with the safety requirements of BS EN IEC 60950. NOTE: This includes electric

shock, energy related hazards, fire, heat related hazards, mechanical hazards, radiation

and chemical hazards.

NF.7 Maintenance, Test & Support

SDP maintenance, test and support requirements.

SDP_REQ-362 Maintenance, Test and Support requirements

Page 125: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 125 of 128

The SDP shall include the following list of Maintenance, Test and Support

requirements in the SDP design:SKA1-SYS_REQ-2512 Best practice.SKA1-

SYS_REQ-2517 Known failure rate parts.SKA1-SYS_REQ-2518 High failure rate

parts.SKA1-SYS_REQ-2519 Reliability testing.SKA1-SYS_REQ-2520 Spares and

repair parts testing.SKA1-SYS_REQ-2522 Shelf life and wear out

characteristics.SKA1-SYS_REQ-2523 Special procurement components.SKA1-

SYS_REQ-2526 Maintainability budgetsSKA1-SYS_REQ-2527 Test and Repair

InstructionsSKA1-SYS_REQ-2528 Level of maintenanceSKA1-SYS_REQ-2529

Maintenance test and support equipmentSKA1-SYS_REQ-2538 Test and support

equipmentSKA1-SYS_REQ-2539 Test and support equipment standardisationSKA1-

SYS_REQ-2540 Test and support equipment lifecycle costs.SKA1-SYS_REQ-2541

Test equipment reliabilitySKA1-SYS_REQ-2542 TrainingSKA1-SYS_REQ-2544

Self-test.SKA1-SYS_REQ-2552 Malfunction detection.SKA1-SYS_REQ-2556

Access tools.SKA1-SYS_REQ-2595 Maintenance provisions.SKA1-SYS_REQ-2597

Plug-in modules.SKA1-SYS_REQ-2711 Component obsolescence planSKA1-

SYS_REQ-2718 Availability budgetsSKA1-SYS_REQ-2722 Availability, reliability,

and maintenance plansSKA1-SYS_REQ-2802 Design for maintainabilitySKA1-

SYS_REQ-2806 Product AssuranceSKA1-SYS_REQ-2816 Design for testability

SKA1-SYS_REQ-2512 Best practice.

Best practice . Best available methods for reducing adverse effects of operational and

maintenance environments on critical components shall be adopted.

SKA1-SYS_REQ-2517 Known failure rate parts.

Known f ailure rate parts. The failure rate of parts shall be known (e.g. through

analysis or modelling) before inclusion in SKA design.

SKA1-SYS_REQ-2518 High failure rate parts.

High failure rate parts. Parts with excessive failure rates shall be identified.

SKA1-SYS_REQ-2519 Reliability testing.

Reliability testing . A testing and evaluation master plan shall be generated for high-

risk reliability components.

SKA1-SYS_REQ-2520 Spares and repair parts testing.

Spares and repair parts testing . Critical spare and repair line replaceable units shall be

tested before deployment.

SKA1-SYS_REQ-2522 Shelf life and wear out characteristics.

Shelf life and wear out characteristics . The shelf life and wear out characteristics of

all components and parts shall be known before inclusion in SKA designs.

SKA1-SYS_REQ-2523 Special procurement components.

Special procurement components . Critical parts requiring special procurement

methods, testing and handling provisions shall be identified.

SKA1-SYS_REQ-2526 Maintainability budgets

Maintainability budgets. Maintainability budgets shall be allocated at the system

decomposition level, and shall be consistent with the system level requirements for

reliability and maintainability of the system.

SKA1-SYS_REQ-2527 Test and Repair Instructions

Test and Repair Instructions. Where end user repair is applicable Test and Repair

Instructions shall be delivered with all equipment.

Page 126: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 126 of 128

SKA1-SYS_REQ-2528 Level of maintenance

Level of maintenance. The level of maintenance shall be identified for each repairable

item.

SKA1-SYS_REQ-2529 Maintenance test and support equipment

Maintenance test and support equipment. Equipment required for test and support

shall be identified for each repairable item.

SKA1-SYS_REQ-2538 Test and support equipment

Test and support equipment Test and support equipment shall be identified for each

level of maintenance.

SKA1-SYS_REQ-2539 Test and support equipment standardisation

Test and support equipment standardisation. Any test equipment not included in the

standard test equipment list required for the integration, commissioning and

maintenance of equipment shall be declared.

SKA1-SYS_REQ-2540 Test and support equipment lifecycle costs.

Test and support equipment lifecycle costs. Life cycle costs shall be generated for all

test and support equipment.

SKA1-SYS_REQ-2541 Test equipment reliability

Test equipment reliability Test equipment reliability shall be sufficient to meet the

maintainability requirements.

SKA1-SYS_REQ-2542 Training

T raining A plan detailing the training required for maintenance, calibration and repair

shall be generated.

SKA1-SYS_REQ-2544 Self-test.

Self-test . Self-Test capability such that all faults can be identified down to LRU level

shall be provided.

SKA1-SYS_REQ-2552 Malfunction detection.

Malfunction detection. All equipment malfunction shall be detected at the system

level.

SKA1-SYS_REQ-2556 Access tools.

Access tools . Access requiring tools shall be minimised.

SKA1-SYS_REQ-2595 Maintenance provisions.

Maintenance provisions. Repairable items shall be designed to include maintenance

provisions such as test points, accessibility, and plug-in components.

SKA1-SYS_REQ-2597 Plug-in modules.

Plug-in modules. The design shall implement plug-in modules to the maximum extent

possible.

SKA1-SYS_REQ-2711 Component obsolescence plan

Component obsolescence plan. There shall be a plan for the management of

component obsolescence.

SKA1-SYS_REQ-2718 Availability budgets

Availability budgets. Availability budgets shall be allocated at the system

decomposition level, and shall be consistent with the system level requirements for

reliability and maintainability of the system.

SKA1-SYS_REQ-2722 Availability, reliability, and maintenance plans

Page 127: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 127 of 128

Availability, reliability, and maintenance plans . There shall be an availability,

reliability and maintenance plan for each SKA1 telescope.

SKA1-SYS_REQ-2802 Design for maintainability

Design for maintainability . Designs shall incorporate maintainability studies and

analysis in accordance with BS EN IEC 60706-2 with emphasis on minimising the

need for maintainers on sites. This activity should incorporate best practice such as

described by B.S. Blanchard & W.J. Fabrycky 'Systems Engineering and Analysis',

Pearson 2011.

SKA1-SYS_REQ-2806 Product Assurance

Product Assurance . Product Assurance shall be managed following a process

modelled on the SKA Product Assurance & Safety Plan SKA-OFF.PAQA-SKO-QP-

001

SKA1-SYS_REQ-2816 Design for testability

Design for testability. Designs shall include an assessment of testability in accordance

with BS EN IEC 60706-5

NF.8 VLBI

SDP VLBI requirements. VLBI requirements are categorised as non-functional as

SDP is not involved in VLBI processing.

SKA1-SYS_REQ-2838 VLBI data sources

VLBI data sources. The SKA1_Mid and SKA1_Survey telescopes shall be data

sources for VLBI data acquisition system. The interface between the telescopes

SAK1_Mid and SkA1_Survey and the external VLBI data acquisition system shall be

compliant with the ICD SKA-TEL-SKO-0000116

SKA1-SYS_REQ-2838 Provision of equipment for recording

Provision of equipment for recording . Provision of equipment for recording or

capturing VLBI data is outside the scope of SKA1

SKA1-SYS_REQ-2840 VLBI equipment and eVLBI connectivity

VLBI equipment and eVLBI connectivity. VLBI equipment and eVLBI connectivity

beyond the interface boundary described in the ICD SKA-TEL-SKO-0000116 is

outside the scope of supply of the SKA1 project.

SKA1-SYS_REQ-2844 VLBI Processing

VLBI Processing . VLBI processing, with the exception of beam-forming and SKA1

imaging in support of VLBI. is outside the scope of the SKA1

SKA1-SYS_REQ-2847 SKA1_Mid VLBI store the time-dependent antenna

weights

SKA1_Mid VLBI store the time-dependent antenna weights. SKA1_Mid shall be able

to store the time-dependent antenna weights used for each tied-array beam sum

SKA1-SYS_REQ-2851 SKA1_Mid VLBI relative sensitivity and coherence losses

SKA1_Mid VLBI relative sensitivity and coherence losses. The SKA1_Mid

beamformer shall be able to weight the antenna inputs into the tied-array sums based

on relative sensitivity and coherence losses.

SKA1-SYS_REQ-2855 SKA1_Mid VLBI spectral resolution

SKA1_Mid VLBI spectral resolution. SKA1_Mid shall be able to generate VLBI

beams with a spectral resolutions different from the spectral resolution used for

imaging within the same VLBI sub-array

Page 128: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

Document no: SKA-TEL-SDP-0000033 Unrestricted Revision: 01 Author: F. Graser Release date: 2015-02-09 Page 128 of 128

SKA1-SYS_REQ-2857 SKA1_Mid VLBI imaging and beamforming

SKA1_Mid VLBI imaging and beamforming SKA1_Mid shall be able to

simultaneously generate imaging data using all antennas in a VLBI sub-array, as well

as generating the VLBI beams.

SKA1-SYS_REQ-2859 SKA1_Mid VLBI spectral line and time domain

observation

SKA1_Mid VLBI spectral line and time domain observation SKA1_Mid shall be able

to generate VLBI beams optimised for either spectral line observations (to mitigate

spectral leakage) or time domain observations (to mitigate time smearing)

SKA1-SYS_REQ-2862 SKA1_Survey VLBI store the time-dependent antenna

weight

SKA1_Survey VLBI store the time-dependent antenna weight. SKA1_Survey shall be

able to store the time-dependent antenna weights used for each tied-array beam sum.

SKA1-SYS_REQ-2863 SKA1_Survey VLBI timestamp accuracy

SKA1_Survey VLBI timestamp accuracy. SKA1_Survey shall be able to generate

data from the VLBI beams with samples traceable to a timestamp with an accuracy of

1 nsec or better.

SKA1-SYS_REQ-2866 SKA1_Survey VLBI relative sensitivity and coherence

SKA1_Survey VLBI relative sensitivity and coherence. The SKA1_Survey

beamformer shall be able to weight the antenna inputs into the tied-array sums based

on relative sensitivity and coherence losses.

SKA1-SYS_REQ-2870 SKA1_Survey VLBI spectral resolution

SKA1_Survey VLBI spectral resolution. SKA1_Survey shall be able to generate

VLBI beams with a spectral resolutions different from the spectral resolution used for

imaging within the same VLBI sub-array

SKA1-SYS_REQ-2872 SKA1_Survey VLBI imaging and beamforming

SKA1_Survey VLBI imaging and beamforming. SKA1_Survey shall be able to

simultaneously generate imaging data using all antennas in a VLBI sub-array, as well

as generating the VLBI beams.

SKA1-SYS_REQ-2873 SKA1_Survey VLBI spectral line and time domain

observation

SKA1_Survey VLBI spectral line and time domain observation. SKA1_Survey shall

be able to generate VLBI beams optimised for either spectral line observations (to

mitigate spectral leakage) or time domain observations (to mitigate time smearing).

Page 129: PDR.03 Requirements Analysis - ASTRONbroekema/papers/SDP-PDR/PDR03... · 2015. 7. 27. · Functions – requirements matrix (only functional requirements) Components – functions

PDR03EchoSign Document History February 09, 2015

Created: February 09, 2015

By: Verity Allan ([email protected])

Status: SIGNED

Transaction ID: XJEEYJP37E5NW7Z

“PDR03” HistoryDocument created by Verity Allan ([email protected])February 09, 2015 - 3:04 PM GMT - IP address: 131.111.185.15

Document emailed to Ferdl Graser ([email protected]) for signatureFebruary 09, 2015 - 3:05 PM GMT

Document viewed by Ferdl Graser ([email protected])February 09, 2015 - 3:06 PM GMT - IP address: 105.184.40.35

Document e-signed by Ferdl Graser ([email protected])Signature Date: February 09, 2015 - 3:06 PM GMT - Time Source: server - IP address: 105.184.40.35

Document emailed to Paul Alexander ([email protected]) for signatureFebruary 09, 2015 - 3:06 PM GMT

Document viewed by Paul Alexander ([email protected])February 09, 2015 - 6:44 PM GMT - IP address: 131.111.185.15

Document e-signed by Paul Alexander ([email protected])Signature Date: February 09, 2015 - 6:44 PM GMT - Time Source: server - IP address: 131.111.185.15

Signed document emailed to Ferdl Graser ([email protected]), Paul Alexander ([email protected])and Verity Allan ([email protected])February 09, 2015 - 6:44 PM GMT