Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

20
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar

Transcript of Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Page 1: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Update on Database Issues

Peter Chochula

DCS Workshop, June 21, 2004 Colmar

Page 2: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva2

This talk is an update of information presented during the previous DCS workshops

For more detailed overview of database activities in ALICE please see the talk presented by Latchezar Betev on Wednesday

Page 3: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva3

DCS Configuration Database

Page 4: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva4

Configuration Database – Reminder

Configuration data: System Static Configuration (e.g. which processes are

running, managers, drivers etc.) Device Static Configuration (device structure, addresses,

etc.) Device Dynamic Configuration – Recipe (device

settings, archiving, alarm limits etc.) Alice add-on: FERO configuration, which is in fact also

a device configuration – both dynamic and static

Page 5: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva5

ALICE FERO Configuration will be shared between DAQ, DCS and ECS

Configuration Database

System Static Configuration

Device Static Configuration

Device Dynamic Configuration

FERO Static Configuration

Configuration DB

PVSS-II & underlying software

Hardware

FERO Dynamic Configuration

Common Solution(FW devices only)

Alice Specific

Page 6: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva6

Present Status

FERO configuration developments are ongoing (Svetozar Kapusta) MySQL prototype, PhP Web access Presently porting the database to ORACLE

A private Oracle Server installed in DCS lab Framework configuration DB tools installed

We are evaluating the prototype version of framework configuration DB tools

We would like to encourage you to start using the tools and provide feedback (to us).

Page 7: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva7

FW PVSS Configuration Prototype Implementation

Database access based on ADO both on Windows and Linux ETM provides sets of libraries enabling “quasi” ADO functionality

on Linux

Underlying database system: Oracle The MySQL implementation is presently not available

(developments are frozen).

Configuration database tool is now a part of framework distribution and is available for download on framework pages (http://itcobe.web.cern.ch/itcobe/Projects/Framework/)

Page 8: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva8

FW Configuration DB Prototype

Configuration DB integrated with DEN

Configuration DB implemented for framework devices

Our test setup is based on CAEN power supply

Page 9: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva9

FW Configuration DB Prototype

Configuration prototype handles both device static configuration and recipes

Page 10: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva10

Example: Device configuration stored in ORACLE

Page 11: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva11

Example: Configuration Db tables in Oracle

Page 12: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva12

Performance and stability will be tested with large systems

Prototype setup is available to everyone wishing to perform tests ORACLE server maintained by DCS team Terminal service for developments of your own projects

(projects can be hosted on our server and remotely accessed from your working place. This is handy if you just want to test the software before you install it on your computers)

Page 13: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva13

Creating you own tables in ORACLE

At CERN there is central service available Users can register to obtain their tablespace on central

servers Development version installed in DCS Lab –

everyone is welcome to use it, please note that this is not a production version yet

For your developments you can download Windows and Unix versions (full) of Oracle 9i server directly from www.oracle.com This version is free for development purposes

Page 14: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva14

FERO Configuration

The FED should be treated as standard device JCOP framework tool will be modified to cover

also ALICE FED We need to develop a generic API for accessing the

FERO configuration as this is shared between DCS and DAQ

DCS team needs to know the structure of the configuration parameters for each FED Please provide feedback by the end of July We need also to know the mechanism for obtaining your

configuration data

Page 15: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva15

DCS Archive and Conditions Database

Page 16: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva16

Reminder - DCS Archives

Archive

PVSS

ArchiveArchive

ArchiveCondition DB

Present Model is based on PVSS –II archiving scheme

Condition DB is an extension of the standard archiving and provides a simplified access to sub-set of data

Page 17: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva17

Replacement of PVSS Archives with Oracle database

PVSS

Condition DBArchive

ORACLE Database

New archiving model will be introduced in PVSS-II v. 3 (but not in the comingrelease). PVSS-II archive will be implemented in ORACLE.

Page 18: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva18

DCS data logging

Present Status: Release of new archiving mechanism in PVSS is

scheduled for the end of August Condition DB developments are presently “frozen”

– waiting for performance tests of the new archiving

Heavy testing of performance will start in September

We need to develop generic API to DCS archive

Page 19: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva19

It is necessary to make an estimate of the final system size Information in URD’s is sometimes obsolete

Present estimate (based on URD’s) assumes some 300.000 parameters gathered from 30 000 channels to be written into the archive

This numbers are misleading as many detectors assume that FERO parameters will be monitored, which is probably (for mst parameters) not true

Please update your URD before the end of July and provide realistic estimate of monitored parameters.

This is a critical task and there is not much time left. Please, do not underestimate this problem

Page 20: Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.

Peter Chochula 9th ALICE DCS Workshop, March 15, 2004 Geneva20

Conclusions

Encouraging progress in FW Configuration database developments Prototype available for evaluation

Archiving database will be released soon, we need to prepare for testing

You information is essential, we need to know the number of monitored parameters and typical updating frequencies

Both configuration and archiving must be operational for the pre-installation in 2005 In December we need to release first stable version of both

configuration and archiving databases