15 February 2001 Tim Adye 1

New Kanga Export SchemeNew Kanga Export Scheme

Tim Adye

Rutherford Appleton Laboratory

BaBar Collaboration Meeting

Data Distribution Session

15th February 2001

15 February 2001 Tim Adye 2

• Summary of new system• Introduction at last meeting• More details in next talk (Alvise)

• Experience

• Deployment

15 February 2001 Tim Adye 3

Kanga export procedures

Kanga export controlled by skimData databaseDavid Kirkby, Alessandra Forti, Alvise Dorigo,TJA

• skimSqlMirror makes local copy of skimData db• skimSqlSelect selects data for import• skimImport copies the selected files• skimBackup backup/archive to tape• skimDelete remove files from local disk

Documentation available from• /BFROOT/www/Computing/Offline/DataDist/KDDIBT.html• BaBar -> Computing -> Data Dist -> skimData remote

15 February 2001 Tim Adye 4

ExperienceNew system has been used at

• RAL (TJA)• ~3 TB, many streams

• Manchester (Alessandra Forti)• 350 GB

• Rome (Alvise Dorego, Emanuele Leonardi)• All data, See next talk

• Bristol (Fergus Wilson)• ~75 GB, Stream14

• Colorado State (Jinlong Zhang)• ~140 GB, TauQEDallevents

• LBNL (Bob Jacobsen)• Just remote skimData

15 February 2001 Tim Adye 5

Experience at RAL

Now take the ‘OR’ of all UK requirementsFergus Wilson (Bristol)

Priority 1: Stream14Kanga (data+SP)

Phil Strother (QMW)

Priority 2: Stream6Kanga (data+SP)

Ulrik Egede (IC)

Priority 1: Stream4Kanga + Stream7Kanga + Stream13Kanga (all data+SP)

Priority 2: Stream14Kanga (data+SP) + SPKanga (signal only)

Priority 3: AllEventsKanga

Steve McMahon

Priority 1: JpsitollKanga

Gian Gopal (RAL)

Priority 2: AllEventsKanga

Stefania Xella (RAL)

Priority 1: Stream8Kanga (data+SP)

Akram Khan (Edinburgh)

Priority 1: Stream7Kanga + Stream11Kanga + Stream14Kanga (data+SP)

Paul Harrison (QMW)

Priority 1: Stream14Kanga (data+SP)

Others

Priority 1: Stream17Kanga + JpsitollKanga + TauQEDalleventsKanga (all data+SP)

Priority 2: DiLeptonKanga (data+SP)

Priority 3: Skim880c (express Sin2Beta) + BPC*Kanga (PID) streams

(See http://hepunx.rl.ac.uk/BaBar/kangaAtRal.html for details)

15 February 2001 Tim Adye 6

Experience at RAL On disk To Import (high) To Import (low) Not SelectedP Skim Release Stream Files GBytes Files GBytes Files GBytes Files GBytes= ============= ==================== ====== ====== ========= ====== ======== ====== ===== ======2 Skim880g AllEventsKanga 3671 940.4 Skim880g Stream1Kanga 2989 57.6 682 18.3 Skim880g Stream2Kanga 3434 25.8 237 4.7 Skim880g Stream3Kanga 2990 35.9 681 11.01 Skim880g Stream4Kanga 3671 48.1 Skim880g Stream5Kanga 2988 79.1 683 23.42 Skim880g Stream6Kanga 3333 267.9 338 36.01 Skim880g Stream7Kanga 3671 93.21 Skim880g Stream8Kanga 3671 47.3 Skim880g Stream9Kanga 2988 52.7 683 16.5 Skim880g Stream10Kanga 2989 28.2 682 8.71 Skim880g Stream11Kanga 3671 163.6 Skim880g Stream12Kanga 2990 122.2 681 38.61 Skim880g Stream13Kanga 3671 42.31 Skim880g Stream14Kanga 3671 46.8 Skim880g Stream15Kanga 2989 40.5 682 11.6 Skim880g Stream16Kanga 2988 17.6 683 5.61 Skim880g Stream17Kanga 3671 121.8 Skim880g Stream18Kanga 3131 23.0 540 14.51 Skim880g JpsitollKanga 341 2.52 Skim880g DiLeptonKanga 341 2.21 Skim880g TauQEDalleventsKanga 3671 109.72 K865aP1 SPKanga 42625 461.8 6955 92.2 Skim880gMC Stream1Kanga 1258 16.6 Skim880gMC Stream2Kanga 1258 0.0 Skim880gMC Stream3Kanga 1258 23.91 Skim880gMC Stream4Kanga 1257 27.9 1 0.0 Skim880gMC Stream5Kanga 1258 53.32 Skim880gMC Stream6Kanga 359 74.6 899 104.4 […] S8.6.[23]* DsToPhiPiKanga 1 0.0 S8.6.[23]* DstarAllKanga 1 0.0 ============= ==================== ====== ====== ========= ====== ======== ====== ===== ====== Totals 183735 3751.1 9 0.3 8864 237.7 17210 412.2

15 February 2001 Tim Adye 7

Deployment

Now ready for general use

(but, you can continue to use rsync if you prefer)