Post on 31-Mar-2015
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
BGWG blank sky updates
Jenny Carter, University of Leicester
Andy Read, University of Leicester
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Current status, April 2008
• Completed Action Item:• BG_WG_04_05: Selection tool, web based.
Sketched out html/CGI script tool. Currently on hold, suggest disregard (depending on current use).
Now called BGSelector
• Other plans:• Datasets still to be added to increase file size• Will require new delivery system of files, user
tailored files, web based
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Query resolvedMichael Bauer/Miranda
• Skycast and blank sky files. If use attcalc more than once then on using task backscale, the backscale keyword is 0.
• Due to ‘backscale/arfgen’ using det. coordinates. Looks for RA_PNT, DEC_PNT, PA_PNT, REFX(Y)CRVL keywords – these are all set to zero.
- not able to resolve in blank sky files. Advise users to create spectra of required size using their file and backscale, write this backscale to the spectra created from the blank sky file. Or set REFXCRVL and REFYCRVL to user’s spectrum with FITS editor fv, or work in DETX, Y coordinates
- OUTSTANDING: Add this advice to website
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Blank sky web page
• Updates marked as before
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
New processing of Blank Sky files
• New archive at Leicester• Recreating the individual blank sky event and
associated files (component files)• With new philosophy of allowing a user to
request a file before it is created, can create bigger and more tailored files selecting from the old+new component observations
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Web based request form
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Creation of the larger blank sky files – at Leicester
• We select the relevant files for merge from the new database (epic1)
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Newly processed files so far, numbers• Up to revn. 1100, not necessarily clean/source free, but
these max. numbers to choose from so far (m1/m2/pn)
Thin Medium ThickFull-frame 764 / 797 / 691
(111 / 109 / 41)
1019 / 1199 / 715
(60 / 62 / 32)
151 / 146 / 105
(11 / 12 / 9)
Ext. full-frame 250 (62) 207 (27) 18 (3)
Large Window 87 / 83 / 91 100 / 90 / 64 27 / 35 / 34
Small Window? 71 / 102 120 / 164 51 / 54
Timing?
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Other things to consider
• To add: scaling of exposure maps to webpage• To add: work around for skycast issue with
reference keywords reset so backscale works correctly
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Extra slides and some files from last meeting…
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Other comments from UG
• How often are these files going to be updated.• previous work up to revn. 1037
• Inclusion of other modes, e.g. timing• look up to revn. 1207 (XMM-Newton at revn.
~1450)
• Refilled files – that have gone through ghosting procedure, issue with flagging of events
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Updates and rare modes – up to revn. 1207, all obs
Mode Total Obs.
EPN EMOS1 EMOS2
Full-frame 8622 2223 3172 3227
Ext. full-frame 730 730 N/A N/A
Large window 895 266 320 309
Large window – free running 11 N/A 5 6
Small window 1323 538 371 424
Small window – free running 22 N/A 11 11
Timing 199 199 N/A N/A
Fast Compressed 7 N/A 5 2
Fast Uncompressed 798 N/A 528 270
Burst 34 34 N/A N/A
Full-frame two modes 10 N/A 5 5
Refresh frame store 31 N/A 16 15
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Effects of ghosting/refilled files• Query from UG – how to filter out good events that are now, for example in the
wrong position spatially in the event file, or how to consider ‘bad’ events that have been ghosted into a ‘good’ area.
• How many extra bad-flagged events are seen in refilled event files
Unfilled NAXIS2
Refilled NAXIS2
NAXIS2 % diff
Unfilled next to
win/border
Refilled next to
win/borderUnfilled next to bad pixel
Refilled next to bad pixel
% diff. next to win
% diff. next to
bad
M1 K FF 449951 522167 16.05 1541 1657 14337 16423 7.53 14.55
M1 M FF 3961156 4505101 13.73 10874 10923 120003 134952 0.45 12.46
M1 T FF 5259638 5849204 11.21 15529 15228 156304 171546 -1.94 9.75
M2 K FF 529422 611002 15.41 2435 2513 11511 12621 3.20 9.64
M2 M FF 4153455 4706427 13.31 15929 16125 88357 95825 1.23 8.45
M2 T FF 5163550 5700938 10.41 19507 18847 109015 115098 -3.38 5.58
PN K EF 617534 671193 8.69 75290 73943 12217 12596 -1.79 3.10
PN M EF 10359282 11291277 9.00 896798 886323 141006 149500 -1.17 6.02
PN T EF 13732526 14967154 8.99 1391740 1369387 220664 232080 -1.61 5.17
PN K FF 2816945 3345998 18.78 274787 297379 37812 41028 8.22 8.51
PN M FF A 10646568 12661536 18.93 940321 1016135 138368 151668 8.06 9.61
PN M FF C 13612751 15717445 15.46 950145 977372 132112 140576 2.87 6.41
PN T FF A 10322523 11498689 11.39 847854 851535 114873 120515 0.43 4.91
PN T FF C 9964874 11060368 10.99 769109 772206 107380 111274 0.40 3.63
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Event selection
• MOS: • #XMMEA 1
• close to CCD border• #XMMEA 5, 6, 8, 9, 10
• close to onboard bad pixel, close to bright pixel, close to dead pixel, close to bad col, close to bad row
• PN:• #XMMEA_2
• close to CCD window• #XMMEA 5, 6, 8
• close to onboard bad pixel, close to bright pixel, close to dead pixel
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Images of files, events flag #XMMEA_1 – refilled files MOS
M1 T FF M1 M FF M1 K FF
M2 T FF M2 M FF M2 K FF
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Images of files, events flag #XMMEA_5, 6, 8, 9, 10 – refilled files MOS
M1 T FF M1 M FF M1 K FF
M2 T FF M2 M FF M2 K FF
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Images of files, events flag #XMMEA_2 – refilled files PN
PN T EF PN M EF PN K EF
PN T FF - A PN M FF - A
PN K FF
PN T FF - C PN M FF - C
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Images of files, events flag #XMMEA_5, 6, 8 – refilled files PN
PN T EF PN M EF PN K EF PN K FF
PN T FF - A PN M FF - APN T FF - C PN M FF - C
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Possible solutions to ghosting problem
• Masking chip gaps more stringently (good events in bad areas) – already the refilled files are conservatively cleaned
• Difficult to get bad events out of good areas
• Ideas? / a limitation to the refilled files and advise on the web page? New ghosting flag?
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
BGSelector• To replace SelectRADec tool, which selected events within a given
search area, on Blank Sky page
• Currently found at: http://www.star.le.ac.uk/~jac48/tools/
• Can now select on:
• coordinates, equatorial or galactic, within a search radius
• revolution numbers within a range
• exposure times within a range
• time within a range
• nH values within a range
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
XMMEPICMOS
Jenny Carter (jac48@star.le.ac.uk)7th EPIC BG WG Meeting
Mallorca, April 08
Individual queries outstanding• Jean Ballet
1. Offset between count maps and exposure maps, MOS.
• Michael Bauer• Skycast and blank sky files. If use attcalc
more than once then on using task backscale, the backscale keyword is 0.