Herschel Highly Processed Data Product Page
Introduction
This page compiles the plans and needs to prepare and serve Highly Processed Data Products (HPDPs) to the Scientific Communities. There are two main ways considered to fulfil this: a web page, similar to that used for User Provided Data Products (UPDP, see also
http://www.cosmos.esa.int/web/herschel/user-provided-data-products
), and the HSA User Interface (HUI). The following focusses mostly on the latter.
Meetings and action items
- 17-June-201HSC.5: Kick-off meeting with the ICS team and Eva Verdugo.
- Minutes of Meeting
- Viewgraphs used during the meeting
- The main action item resulting from the meeting is that each instrument representative shall come up with a list of use cases and requirement wish list applying to the HSC.HPDP they are supervising or acting as contact point for. These requirements will be compiled in the corresponding section below. Deadline: second half of September.
- Sept-201HSC.5: Follow-up meeting to review requirements and agree on a consolidated request to SAT to be conveyed by Eva Verdugo
HSC.HPDP plans per instruments
HPDPs have been identified by each instrument team, although it is likely that not all of them will be possible to prepared in certain cases.
We indicate hereafter the HPDPs currently contemplated by each instruments, with some common delivery categories that will be considered or not.
HSC.HIFI
HSC.HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
Expert Reduced Spectral Scans |
Baseline-cleaned deconvolved spectral scans |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
Expert Reduced Spectral Maps |
Baseline-cleaned regridded cubes l scans |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
Isolated OFF spectra |
OFF spectra as produced by the SPG, potentially cleaned further |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
Non-averaged level2 for point mode |
Level2 data as produced by modified version of SPG |
Yes - level2.5 equivalent FITS files (multiple spectra) |
No |
Yes - postcards |
Yes |
Uncertainty tables |
Uncertainty tables as produced by the SPG |
No |
Yes - TableDataset as FITS files |
No |
Yes |
Line list catalogue |
Identified Spectral Line catalogue |
No |
Yes - one file per obsid, and one concatenated file |
Yes - static (PNGs) and interactive (html) images |
Yes |
HSC.PACS-P
HSC.HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
HSC.PACS Point Source Catalogue |
Point source catalogue as extracted from the photometer data |
No |
Yes - typically one large csv file per photometer band, and/or a unique concatenated one |
No |
Yes - Global release note |
Improved level3 maps |
Further combination of fields with Unimap and JScanam |
Yes |
No |
?? |
?? |
Additional level 2.5 maps |
Combination of fields currently unconsidered in the list for level2.5 pipeline |
Yes |
No |
?? |
?? |
HSC.PACS-S
HSC.HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
Line list catalogue |
Spectral Feature catalogue |
No |
Yes - one file per obsid, and one concatenated file |
No |
?? |
Point-source calibrated data - case 1 |
SPG products processed through the dedicated point-source correction script for cases of centred point source |
Yes - level2.5 equivalent FITS files |
No |
?? |
?? |
Point-source calibrated data - case 2 |
SPG products processed through the dedicated point-source correction script for cases of non-centred point source |
Yes - level2.5 equivalent FITS files |
No |
?? |
?? |
Unchopped observations |
Baseline-subracted unchopped spectra |
Yes - level2.5 equivalent FITS files |
No |
?? |
Must-have |
Long range spectro flat-fielding |
Manual correction of the flat-fielding drift |
Yes - level2.5 equivalent FITS files |
No |
?? |
Must-have |
Red leak spectral range |
Run parallel pipeline that deals with red leak region (CalBlock+RSRF) and provide data stand-alone |
Yes - level2.5 equivalent FITS files |
No |
?? |
Must-have |
High flux source data |
?? |
?? |
No |
?? |
?? |
Repair of failed observations |
Re-run pipeline on observations set to failed |
Yes - level2.5 equivalent FITS files |
No |
?? |
?? |
Different wavelength regridding |
re-run SPG with different wavelength grid parameter for more rigourous noise computation |
Yes - level2.5 equivalent FITS files |
No |
?? |
?? |
HSC.SPIRE-P
HSC.SPIRE-S
HSC.HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
Semi-Extended calibration correction |
SECT correction for semi-compact sources |
Yes - level2 equivalent FITS files |
No |
Yes - postcards |
Yes |
Extended background correction |
Extended background correction for point sources |
Yes - level2 equivalent FITS files |
No |
Yes - postcards |
Yes |
Anomalous data correction |
Isolated cases of failed processing due to some on-board anomaly |
Yes - level2 equivalent FITS files |
No |
Yes - postcards |
Yes |
Line list catalogue |
Spectral Feature catalogue (see also this page ) |
No |
Yes - one file per obsid, and one concatenated file |
No |
?? |
HUI requirements
We provide here the HUI requirements needed to support the storage, queries and access to the various HPDPs.
TBD
--
DavidTeyssier - 17 Jun 201HSC.5