Downlink Segment Test Status (S12.0)

Russ Laher and Merhdad Moshir (1)S12.0 Test Readiness Review, March 8, 2005

Downlink Segment Test Status (S12.0)

Russ Laher and Mehrdad Moshir

March 8, 2005


Summary

D/L-group software changes implemented for S12.0 105 pipeline-related CRs 67 database-related CRs/AIs 31 ARs

D/L segment-testing to check specific CR/AR/AI changes Small cluster of 12 pipeline-drones (mini “ops-like” environment) SODB (fresh S11 database via EdJackson) Archiver run on pipeline results for end-2-end verification

ISTs doing science verification of pipeline products and testing of SPICE QA team verification of QA sub-system upgrades Test plan documents written by CogEs to help I&T


What’s New for S12.0

Functionality/infrastructure to process MIPS-24 SUR-mode TPM data Processing of MIPS-24 flatfield AORS through both flatfield and science pipelines New MIPS-24 automated “spot” and scan-mirror-dependent flatfield picking New MIPS-24 scan-leg pointing-refinement pipeline MIPS:Ge calibration products are now being archived! New IRAC and MIPS-24 sky median product Post-BCD IRAC position-refinement pipeline now generates warning, not error, when number of input

images < 5 Pipeline-picker upgrade to handle IRS PeakupImage data Improved and more flexible ensemble creation New database functionality

new vBest’ing machinery for telemetryFiles records getCalProducts now returns files with specified releaseLevel range 12 new QA diagnostics are now being populated in Qa_ptg-xfer table

Ingest now populates SCLK, Frametime, and exposuretime for IRAC in DCEs DB table, to be used for simplifying IRAC first-frame-correction DB query

Updated the following software modules: irs_tune, droopop, profile, basecal, ridge, extract, qaloader, darkest, slremov, snestimator

Various updates to wrappers, cal files, CDFs New off-line superboresight pipeline: refines original boresight pointing-history file by mapping the

IRAC pointing-refinement results back to the original pointing-history data; aim is to use for re-processing; more testing is needed before it can be used in operations

SPICE upgrades for picking version-dependent calibration files, selecting input files via HTTP, and using a remote server for processing

QA sub-system upgrades to SDAT, database functionality, and other web-based tools


Tests Under S12.0

IRS All Sci (BCD&BQD), DarkCal, DarkEns pipelines; used fallback cal; all data run through archiver Details in IRS S12 Test Plan Document

MIPS-Ge Sci (scanmap, photometry, sed, tpm), darks, flats; used fallback cal; all data run through

archiver Details in MIPS-Ge S12 Test Plan Document

MIPS‑24 SUR-mode sci scanmap (slow, med, fast cases); SUR- and RAW-mode photometry; SUR- and

RAW-mode TPM; flat-field cal w/ pointing transfer, non-linearity cal w/ pointing transfer; SUR & RAW dark cal w/ pointing transfer ; used fallback cal; all data run through archiver

Details in MIPS-24 S12 Test Plan Document IRAC

sub-, full-array science and cal pipelines for all exposure modes, frame times, and combinations of internal and external repeats; product records and file system contents checked for data run thru each pipeline; used metadata and fallback cal; all data run through archiver

Details in IRAC S12 Test Plan Document Post-BCD

FIFcreation; pointing refinement;single_frame_pnt_src_ext;multi-frame pnt-src_ext; mosaic pnt-src_ext; overlap correction; image_interp, outlier; image_reinterp; mosaic_coadd for IRAC, MIPS24, 70 &160; all data run through archiver

Details in PostBCD S12 Test Plan Document QA, SDAT

Loader run for all tested pipelines, SDAT tool run, qa pages and statistics pages brought up Details in QA/Infrastructure S12 Test Plan Document


S12.0 Functions/Test Data Flows


S12.0 Capabilities

Sub-system Capability

Ingest Supports DCEs, Pntng, ECSV, Rpt files, Mem Dmps. Sped up, SigEvents, FEIdelete, ReRun, Archiver naming, HK compression

Pipeline Exec real-time data reduction; reprocessing

Instrument pipelines All three instruments science and calibration

Calibration Transfer Fall-back rules (incl NIT) for all three instruments, three nearest in time rules for all three instruments, blessed status flag, asymmetric discriminant selection, interpolation rule

Instrument Performance Monitoring Create/Populate HK tables in the HK DB; web-based viewing and data retrieval; updated menus

Quality Assessment Creation and populating of QA tables; SDAT web-based QA inspection; analysis and display functions; support archive release

CDF Populating of version controlled CDF files on the pipeline drones; retrieve CDF in pipelines, version tracking in the SODB

Imaging post-BCD pipeline Point source extraction, pointing refinement (w/ & w/out 2MASS, USNO, UCAC, FIRST), tiling, overlap correction, outlier identification and mosaic coadding, bandmerging


S12.0 Success Criteria

Run, re-run requests that failed on OPS Interact with the SODB via perl & c-APIs Deposit raw data into the archive file system Create pipeline manifests & ensembles Run manifests through APES Run multiple jobbers on 12 pipeline drones Use CDF to get configuration files Use CalTransfer to get calibration data (NIT and/or fallbacks) Execute post-BCD pipelines including pointing refinemnet Put QA statistics into QA tables Put processing results in sandbox and set file pointers in DB Use SDAT to access and view results on segment test Get “better” BCDs & post-BCD prods IST sci verification of seg test data & buy off (incremental from IOC) Pass the running of archiver


Applicable SISs

Calibration SOSDL-SIS-CL-3000 : darkcal output FITS file, dark image SOSDL-SIS-CL-3001 : lincal output FITS file, linearity model cube SOSDL-SIS-CL-3002 : lincal output table file, pixel cal data SOSDL-SIS-CL-3003 : lincal output cmask image SOSDL-SIS-CL-3004 : darkcal output cmask image SOSDL-SIS-CL-3005 : pmask definitions SOSDL-SIS-CL-3006 : Electronic Nonlinearity Calibration File SOSDL-SIS-CL-3007 : MIPS-Ge stim_latent SOSDL-SIS-CL-3008 : function loadcalkeywords SOSDL-SIS-CL-3009 : IRAC-loadcalkeywords version-1 SODB Table SOSDL-SIS-CL-3010 : darkest cmask SOSDL-SIS-CL-3011 : CalTrans Rule List SOSDL-SIS-CL-3012 : IRS Umask SOSDL-SIS-CL-3013 : IRS Lmask SOSDL-SIS-CL-3014 : IRAC flatcal data cube SOSDL-SIS-CL-3015 : IRAC flatcal cmask SOSDL-SIS-CL-3016 : IRS flatcal cmask SOSDL-SIS-CL-3017 : IRS Omask SOSDL-SIS-CL-3018 : IRS Flux Conversion Table SOSDL-SIS-CL-3019 : IRS FOV PSF Table SOSDL-SIS-CL-3020 : IRS COADD2D AMASK SOSDL-SIS-CL-3021 : IRS COADD2D FMASK SOSDL-SIS-CL-3022 : IRS WAVSAMP TABLE SOSDL-SIS-CL-3023 : MIPS-Ge cmask

Data Tools SOSDL-SIS-DT-3004 : profile.tbl (IRS BQD) SOSDL-SIS-DT-3005 : ridge.tbl (IRS BQD) SOSDL-SIS-DT-3006 : extract.tbl (IRS BQD) SOSDL-SIS-DT-3007 : irs_tune.tbl (IRS BQD)

Executive SOSDL-SIS-EX-3000 : plinexyz.cdf SOSDL-SIS-EX-3001 : run time environment variables

Quality Assessment SOSDL-SIS-QA-3000 : QA file (*.qa) format

Products SOSDL-SIS-PD-3000 : cvti2r4 output FITS file, 32-bit real data SOSDL-SIS-PD-3001 : cvti2r4 output FITS file, dmask SOSDL-SIS-PD-3002 : muxbleedcorr output DCE FITS file SOSDL-SIS-PD-3003 : imfliprot output FITS file SOSDL-SIS-PD-3004 : MIPS Ge bmask SOSDL-SIS-PD-3005 : imagest output bmask SOSDL-SIS-PD-3006 : tranhead keyword-translate-only list SOSDL-SIS-PD-3007 : Tile/BCD association files SOSDL-SIS-PD-3008 : Mosaic-geometry interface SOSDL-SIS-PD-3009 : BCD delta file SOSDL-SIS-PD-3010 : PREDICTSAT s-mask SOSDL-SIS-PD-3011 : dldeltafile library SOSDL-SIS-PD-3012 : PRF/PSF map SOSDL-SIS-PD-3013 : Point source extraction table SOSDL-SIS-PD-3014 : Detection/Tile/BCD Association File SOSDL-SIS-PD-3015 : imagest output slope image SOSDL-SIS-PD-3016 : latimflag l-mask SOSDL-SIS-PD-3017 : fiducial frame definition parameters SOSDL-SIS-PD-3018 : mosaic_interpolation table SOSDL-SIS-PD-3019 : matched-point-source refined position table SOSDL-SIS-PD-3020 : fiducial frame input parameters SOSDL-SIS-PD-3021 : bandmerged point source output file SOSDL-SIS-PD-3022 : bandmerger pointer dump file SOSDL-SIS-PD-3023 : band-pair registration uncertainties SOSDL-SIS-PD-3024 : bandmerge statistics SOSDL-SIS-PD-3025 : MIPS24 bmask SOSDL-SIS-PD-3026 : FPGen Command Line Input SOSDL-SIS-PD-3027 : FPGen SODB Entries file (input) SOSDL-SIS-PD-3028 : FPGen Template Input file SOSDL-SIS-PD-3029 : Bandmerge (QA) spectral combination counts

Pointing Transfer SOSDL-SIS-PT-3000 : pixel-scale table file SOSDL-SIS-PT-3001 : Ptg Refinement Absolute Source List Input Fmt SOSDL-SIS-PT-3002 : MIPS Scan Mirror Parameters Table SOSDL-SIS-PT-3003 : Instrument FOV Table SOSDL-SIS-PT-3004 : Super Boresight Pointing History File SOSDL-SIS-PT-3005 : Refined DCE Position Table File


Pipeline-Related CRs (105)

PR Category Responsible Synopsis6473 downlink-mips-24 Masci_Frank Execute science/post-BCD threads following initial processing of dedicated flatfield data thru flat pipeline6471 downlink-pipeline-exec Laher_Russ Update ensemble creation rules for MIPS-Si ...6470 downlink-pipeline-exec Beck_Ron Update entries for initplscriptIds: 1031, 1033 in $SIRTF_OPS/thread_order* ...6469 downlink Laher_Russ Update ensemble rules for MIPS-Ge scan mode6461 downlink-pipeline-prod Masci_Frank Update detect_exec.cpp to write more significant figures to detection table output..6454 downlink-pipeline-exec Masci_Frank Update operator.csh to include pgplot specific environment variables..6453 downlink-analysis Laher_Russ Please add "./teplot" to ..../downlink/datools/Makefile, check into CVS and tag for S12.0...6451 downlink-pipeline-exec Laher_Russ Modify APES-static y-priorities for IRAC6450 downlink-pipeline-prod Fowler_John Basecal should optionally accept a umask and use it in the baseline averaging6449 downlink-pipeline-ptg Masci_Frank Abort gracefully in pointing history query s/w if input BPHF is truncated before nominal EndSclk.6447 downlink-mips-ge Pesenson_Meyer change mips flatfield module from flat_field to mipsflat6446 downlink-pipeline-exec Laher_Russ Update to ensemble creation rules for MIPS-24..6444 downlink-pipeline-prod Fowler_John New remask module6436 downlink Laher_Russ Just so we don't forget: please add "./superboresight" to .../downlink/pipeline/b-s/src/Makefile6430 downlink-irs Narron_Bob Use BASECAL module to improve Poisson noise estimates in IRS pipelines6425 downlink-pipeline-qa Laher_Russ changes on SDAT left frame display6423 downlink-pipeline-prod Laher_Russ Make tranhead sclk calculation based on telemetry only6415 downlink-pipeline-prod Fowler_John Make RSSing baseline uncertainty with DCE uncertainty optional, default no; add separate baseline uncertainty image to go with optional baseline image.6413 downlink-pipeline-ptg Masci_Frank Update pointing transfer to compute PTGDIFFX, PTGDIFFY for all IRS slits6406 downlink-pipeline-exec Makovoz_David in pipeline 35 downgrade the error to warning if there is not enough images to do overlap corrections6405 downlink-irs Fang_Fan slremov needs to not subtract pedestal6394 downlink-pipeline-qa Hesselroth_Ted SDAT: remove version ID from login page6383 downlink-pipeline-prod Masci_Frank Update latimflag module according to changes suggested in code walk-through...6382 downlink-pipeline-prod Laher_Russ Add command-line option to flatfield module to override EXPTIME consistency checking..6378 downlink-pipeline-ptg Masci_Frank Compute PTGDIFFX, PTGDIFFY in native pixel frame for insertion into product headers and QA_ptg_xfer table..6371 downlink-pipeline-ptg Masci_Frank Update pointing transfer thread to allow insertion of values into new "QA_ptg_Xfer" fields.6370 downlink-pipeline-ptg Jacobson_Jeff Update stored procedure "addQA_ptg_xfer" to add the additional fields as outlined in CR63676368 downlink-mips-24 Jacobson_Jeff Update database stored procedure which loads mips1fallback..6367 downlink-pipeline-ptg Jacobson_Jeff Update schema for "QA_ptg_xfer" table to allow additional fields as per this CR..6361 downlink-mips-ge Henderson_David insert namelist CVS version ID into fits keyword6358 downlink-pipeline-exec Laher_Russ Add new MakeMedianBCDstack() to W rapperUtils.pl6352 downlink-pipeline-prod Makovoz_David Add call to subroutine "MakeMedianBCDstack" in w_bqd_run_mopex.pl for MIPS-246351 downlink-pipeline-prod Laher_Russ Modify flatfield module to read EXPTIME as T_INT alternate keyword.6342 downlink-pipeline-prod Makovoz_David Make post-BCD bandmerger software package buildable by I&T for Solaris for release to community6330 downlink-irac Lee_Wen-Piao New AOT mode of multi-exposures6317 downlink-pipeline-qa Laher_Russ cvs remove setQaStatusForCampaignAndPid.cgi6316 downlink-irac Laher_Russ Modifications to tranhead for CR #62756309 downlink-pipeline-ptg Masci_Frank Update w_pointinghistory.pl to write WCS info. to full 128x128 array headers for peakup exposuretypes sp, pkc and pks..6308 downlink-pipeline-cal Lee_Wen-Piao Update calkeywords _library_ and "OFFSET" include files to support two new column fields in mips1fallback..6307 downlink-mips-24 Jacobson_Jeff Schema update for mips1fallback in ops and sodb_it databases6306 downlink-pipeline-qa Laher_Russ launch a new browser window for pointing angle page6300 downlink-pipeline-ptg Masci_Frank Update "getPH_online" to exercise SDM's new v-besting scheme for the telemetryfiles table...6299 downlink-mips-24 Masci_Frank Create an unnormalized median of all BCDs per science AOR as part of ensemble processing..6280 downlink-pipeline-exec Beck_Ron Please update "$SIRTF_OPS/thread_order" for mips24 (S12.0)...6275 downlink-pipeline-ing Laher_Russ modify INGEST to add ATIMEEND to database and compute new r_sclk6271 downlink-pipeline-prod Masci_Frank Update pointingrefinement module to propagate new information to output tables for use by MIPS superboresight ptgXfer...6270 downlink-pipeline-exec Laher_Russ Update createEnsembles.pl, supporting DB stored procedures and documentation to support new MIPS ptg refinement pipeline.6261 downlink-mips-ge Henderson_David Implement SED passband calibration file6260 downlink-mips-ge Pesenson_Meyer mipsflat qsort key-compare-routine upgrade6259 downlink-mips-ge Lee_Wen-Piao mipsdark qsort key-compare-routine upgrade


Pipeline-Related CRs (105)…

6258 downlink-pipeline-prod Henderson_David New qsort key-compare library6256 downlink-pipeline-qa Laher_Russ More S12.0 improvements to showDcesSodbInfo.cgi6254 downlink-irac Lee_W en-Piao Creation of imask, final product mask file6253 downlink-pipeline-qa Laher_Russ allow QA adminstrator to use the stand alone tool to set status6250 downlink Laher_Russ vBest'ing machinery for ensembleSets6248 downlink-pipeline-cal Laher_Russ Modify 'flatfield' module to add a new keyword 'FLANORM' to the headers of 2 output FITS files6245 downlink-irac Lee_W en-Piao Placing the median Skydark value in the BCD header6243 downlink Masci_Frank Update makefile macro "TOP.mk" under .../downlink/env to enable builds across different subnets..6242 downlink-pipeline-exec Laher_Russ New option for createEnsembles.pl6241 downlink-irs Narron_Bob qaloader change for S12.06240 downlink-pipeline-ing Laher_Russ ingest tweak for S126216 downlink-pipeline-qa Hesselroth_Ted fix "Frame" button in SDAT6215 downlink-pipeline-exec Laher_Russ Update APES workshop perl scripts to enable big-endian I/O on a little-endian machine.6214 downlink-pipeline-exec Laher_Russ Update jrdb.c to enable big-endian I/O on a little-endian machine.6193 downlink-pipeline-qa Laher_Russ change AOR status for a given request key6177 downlink-mips-ge Henderson_David update dmask, pmask, bmask bits for Ge pipelines6175 downlink-pipeline-prod Pesenson_Meyer MIPS:Ge flat_field upgrade6172 downlink-pipeline-exec Laher_Russ Modify updateCalProductStatus.pl to have unlock/lock options6168 downlink-mips-ge Pesenson_Meyer various changes to mips flat_field6167 downlink-mips-ge Lee_W en-Piao mipsdark to produce coverage map6166 downlink-mips-ge Henderson_David allow more than 6000 DCE's for hipass filter6161 downlink-mips-ge Henderson_David MIPS-Ge filtering6159 downlink-pipeline-exec Laher_Russ Add plScriptIds 1550 & 1650 to APES static tables6157 downlink-irs Khan_Iffat Update SPICE modules for LINUX6125 downlink-pipeline-prod Lee_W en-Piao ffcorr action items from code walk-through6123 downlink-pipeline-prod Jacobson_Jeff add plscriptId=1550 and 1650 with exptype=ffl6113 downlink-mips-ge Henderson_David Update interp module to ignore RADHITBCD6108 downlink-pipeline-prod Makovoz_David MIPS and IRAC mosaic coverage maps need correct value for BUNIT in header6102 downlink-mips-24 Masci_Frank Update mips24 science threads to (optionally) use automated scan-mirror dependent flatfield picking..6101 downlink-pipeline-ptg Masci_Frank Update existing getPH_online (get Pointing History) s/w to enable byte-order independent read capability6099 downlink-pipeline-ptg Masci_Frank W rite new pipeline thread to generate "super-boresight" pointing history files6098 downlink-pipeline-ptg Masci_Frank W rite new pipeline thread to perform refinement of MIPS scan-legs.6097 downlink-pipeline-ptg Masci_Frank Create module to transfer refinement corrections in mips24 scan-leg pointing to BCDs,6089 downlink-pipeline-prod Khan_Iffat new module to apply offsets for overlap corrections6087 downlink-pipeline-qa Laher_Russ add options for standard and free-form comments in setQaStatusForCampaignAndPid.cgi6085 downlink-pipeline-qa Laher_Russ add a button to display current statuses in setQaStatusForCampaignAndPid.cgi6083 downlink-pipeline-qa Laher_Russ S12.0 improvements to showDcesSodbInfo.cgi6071 downlink-mips-ge Henderson_David rearrange primary product/ancil product for MIPS Ge6070 downlink-mips-ge Henderson_David add new MIPS Ge exposure type - ffl for "fine flat"6061 downlink-mips-ge Makovoz_David Mask location of sources in rmask for two pass MIPS-Ge processing6060 downlink-mips-ge Henderson_David Update Ge pipelines to make sci bcds from cal pipelines6012 downlink-pipeline-cal Laher_Russ flatfield module NaN creation should be controlled by namelist5939 downlink-pipeline-prod Khan_Iffat in mosaic_outlier change the defaults for BOTTOM_THRESHOLD and TOP_THRESHOLD5938 downlink-pipeline-prod Makovoz_David modify mosaic_outlier to make median coadd5931 downlink-pipeline-prod Fowler_John update dmask definitions for MIPS-24 in the pick utility5930 downlink-pipeline-prod Fowler_John make basecal robust against radhits5913 downlink-pipeline-exec Laher_Russ Mod. to ensemble-creation ruleId=1105858 downlink-pipeline-exec Laher_Russ Faster job-manifest sorting5828 downlink-irs Narron_Bob Add error propagation to IRS_TUNE5706 downlink-pipeline-qa Laher_Russ SDAT should write error log file to logs directory5640 downlink-irac Lee_W en-Piao Load metadata with a "blessed" status value5614 downlink-pipeline-exec Jacobson_Jeff Database stored functions for unlocking vBest5506 downlink-pipeline-qa Laher_Russ SDAT: display PID on AOR page5497 downlink-mips-24 Laher_Russ *** "Please have R. Laher update the ensemble creation document with mips24 updates attached below"***5092 downlink-pipeline-qa Jacobson_Jeff schema update for QA_irsflatcalprep


Database-Related CRs/AIs (67)

AI #1469 - Change in product types table neededAI #1449 - Ensemble-creation rule changes for MIPS:SiAI #1421 - Change release level from 99 to 100 for a few archive PidsAI #1402 - Data content for new ensRules DB table (set make='f' for ruleId=350)AI #1388 - Add "bcd_median.fits" and "bcd_median_uncert.fits" to ProductTypesAI #1364 - Backfill externalName fields in S12.0 databaseAI #1363 - Data content changes to productTypes database table (S12.0 DB only)AI #1338 - Remove ruleId=226 from ensRules and ensplScripts DB tables, etc.AI #1212 - Backfill vBest in telemetryFiles database table AI #1219 - New data contents for calExposureTypes database tableAI #1215 - New operations-TFS fileType "calexposuretypes"AI #1212 - Backfill vBest in telemetryFiles database tableAI #1201 - Update DB productTypes table with commentsAI #1191 - Data content for new ensRules and ensPlScripts DB tables AI #1172 - update the product types table per CR 6073CR #6419 - getCalPRoducts SP needs two release levels min and maxCR #6374 - Update instrumentId in runPipelinePicker DB stored-functionsCR #6370 - dnlProc_CR6370.sql, addQA_ptg_xfer_CR6370.pmCR #6368 - dnlProc_CR6368.sql (loading mips1fallback)CR #6367 - QA_ptg_xfer_CR6367.sqlCR #6363 - Modify pipeline picker to handle new IrsPeakupImage modeCR #6360 - New overloaded updateDce DB stored procedure for IngestCR #6328 - New S12.0 database capabilities for QA subsystemCR #6327 - New database role qaSuperUserRoleCR #6325 - New database table QA_superUsersCR #6324 - New perl-API function getQaAnalystsAndSuperUsersCR #6323 - New DB stored-function getQaAnalystsAndSuperUsers()CR #6318 - New overloaded setDceTimeParameters DB stored procedure - REJECTEDCR #6307 - Schema update for mips1fallback in ops and sodb_it databasesCR #6284 - New Ingest C-API for populating Dces database table for IRAC CR #6283 - New Dces.atimeend field in database (integer) - REJECTEDCR #6282 - Update PlScripts.plscriptnum for plscriptid=1042CR #6281 - Make plScripts.comment more precise for plScriptId=33CR #6270 - Remove ruleId=226 and update ensemble-creation document.CR #6250 - vBest'ing machinery for ensembleSetsCR #6242 - Modify createEnsembles.pl to have -u optionCR #6223 - New database stored function getQaStatusForRequestCR #6224 - New database stored procedure setQaStatusForRequestCR #6225 - New perl-API function getQaStatusForRequest CR #6226 - New perl-API function setQaStatusForRequest CR #6212 - PlScripts-table data-content changes to undo AI #1183CR #6210 - New DB stored-function getBestTelemetryFilesForCampaignCR #6188 - New perl-API function getRefinedPointingFilesForCampaignCR #6187 - New DB stored-function getRefinedPointingFilesForCampaign

CR #6180 - Upgrade perl-API function lockEnsembleProductsVBestCR #6179 - Upgrade DB stored-function lockEnsembleProductsVBestCR #6173 - New perl-API function unlockEnsembleProductsVBestCR #6148 - Add vBest'ing machinery to DB SP registerTelemetryFileCR #6136 - Upgrade database stored-function getDceIdsForRequestCR #6123 - add plscriptId=1550 and 1650 with exptype=ffl CR #6120 - Upgraded perl-API function setQaStatusForCampaignAndPidCR #6106 - New perl-API function getQaStdCommentsCR #6105 - New database stored-function getQaStdCommentsCR #6104 - Upgrade stored-procedure setQaStatusForCampaignAndPidCR #6093 - New perl-API function getQaStatusForCampaignAndPidCR #6092 - New DB stored-function getQaStatusForCampaignAndPidCR #6077 - New perl API getLatestEnsembleProduct CR #6076 - New DB stored-function getLatestEnsembleProduct CR #5913 - Mod. to ensemble-creation ruleId=110CR #5827 - Overloaded addEnsemble and addEnsembleNTC DB stored functionsCR #5818 - New perl-API functions for ensemble creationCR #5816 - New DB stored procedures for ensemble creationCR #5815 - New database tables for ensemble creationCR #5738 - New "ruleId" field in Ensembles tablesCR #5614 - Stored functions for unlocking vBestCR #5092 - Schema update for QA_irsflatcalprep CR #1209 - Define and implement database procedures for ensemble processing


ARs (31)

PR Category Responsible Synopsis6466 downlink-mips-ge Henderson_David calproduct database table not made for cal products6458 downlink-pipeline-exec Makovoz_David in createFifTable.pl erroneous statement $crpix2 = $naxis1/2;6445 downlink-mips-ge Pesenson_Meyer mipsflat apparently hangs doing mips-70 AOR 120555526441 downlink-pipeline-qa Laher_Russ SDAT's qapage.pl doesn't handle IrsPeakupImage (reqMode=111)6440 downlink-pipeline-exec Laher_Russ APES single-side-shared-memory version with race condition fixed6418 downlink-irs Fang_Fan wrong entries in header of droopop_unc.fits files6417 downlink-pipeline-prod Fowler_John hdrupd8 module has memory access/allocation problems under Linux..6414 downlink-pipeline-prod Masci_Frank cropfits module has problems for non-square input images.6400 downlink-irs Fang_Fan Darkest module incorrectly updates Dmasks in inputlists6375 downlink-pipeline-qa Laher_Russ correction for RA difference calculation in QA tools6362 downlink Laher_Russ setup_manifest.auto creates strange MIPS Ge results for AOR 120732166353 downlink-mips-ge Henderson_David calibration product uncertainty files not copied to sandbox6347 downlink-irs Narron_Bob Log files not being archived6344 downlink-pipeline-exec Laher_Russ Benign uninitialized-variable error6338 downlink-pipeline-exec Laher_Russ jobdispatcher.c bugs6304 downlink-pipeline-qa Laher_Russ S11 qa2uplink.pl in ops net has an incorrect version6298 downlink-pipeline-ptg Masci_Frank BPHF paths incorrectly assigned by getPH_online when DCE straddles a "month" boundary...6263 downlink-mips-ge Lee_W en-Piao mipsdark code change for system qsort usage6255 downlink-pipeline-qa Laher_Russ qapage.pl bugs6222 downlink-mips-ge Pesenson_Meyer duplicate copies of mips_ge_bmask.h files with wrong values6221 downlink-mips-ge Pesenson_Meyer old bmask.h file definitions still around6165 downlink-irac Lee_W en-Piao SubArray Flat made from best FullArray flat instead of latest6152 downlink-mips-ge Pesenson_Meyer mips_flatfield sort compare routine compares floats6121 downlink-mips-ge Henderson_David MIPS GE filtering bug produces huge uncertainties6107 downlink-pipeline-prod Lee_W en-Piao flatap changes from code walk-through5966 downlink-irs Fang_Fan DROOPOP module issues warning that NAMELIST parameters Saturation_Bit and Saturation_Val are ignored5943 downlink-analysis Hesselroth_Ted SPICE Image display shows artifacts in Solaris5891 downlink-pipeline-prod Laher_Russ tranhead created SCLK_OBS of 0.5 seconds for MIPS-2 FID= 87626245708 downlink-mips-ge Henderson_David Archiving files from MIPS:Ge 1600- and 1800-series threads5526 downlink-pipeline-prod Makovoz_David IRAC BQD Bandmerge & Mosaic threads (32/34) fail for Ch4

5847 Archive Laher_Russ Archive system does not find fallback calibration files for MIPS-Ge


Issues to be tackled in S13

SDAT fully functioning under Apache proxy server Improvement of MOPEX documentation for March 22 Observers’ Support

Workshop and more extensive improvements over the next few months Port post-BCD tools to Max OS 10 (goal is by August Observers’ Support

Workshop Database Query of IRSPeakUpImage database table for Final Product

Generation – is this needed? Simplified time-delay calculations for IRAC first-frame correction MOPEX GUI development Bandmerge upgrade


Lines of code

Build Total Lines of Code (excludes comments)

S3.5 102,823

S4 140,991

S5 283,344

S5.5 294,439

S6.0 335,447

S6.1 368,048

S6.2 450,398

S6.3 510,561

S7.0 582,492

S8.0 585,944

S9.0 617,674

S9.5 627,809

S10.0 632,480

S11.0 688,129

S12.0 773,366


Lines of Code

0100000200000300000400000500000600000700000800000900000

DL LOC


S12.0 LOC breakdown

Language LOC

C 404,898

C-Shell 1,642

C++ 37,287

Fortran 25,977

IDL 2,966

Java 141,966

Makefile 23,203

Namelist 3,117

Perl 116,475

SQL 15,916


Sample of new tool for setting QA status


Sample of new ptg diff Q/A statistics

Downlink Segment Test Status (S12.0)

Documents

Transcript of Downlink Segment Test Status (S12.0)