TWiki> Public Web>HPDPDefinitionPage (revision 5)EditAttach

Herschel Highly Processed Data Product Page

Introduction

This page compiles the plans and needs to prepare and serve Highly Processed Data Products (HPDPs) to the Scientific Communities. There are two main ways considered to fulfil this: a web page, similar to that used for User Provided Data Products (UPDP, see also http://www.cosmos.esa.int/web/herschel/user-provided-data-products), and the HSA User Interface (HUI). The following focusses mostly on the latter.

Meetings and action items

  • 17-June-201HSC.5: Kick-off meeting with the ICS team and Eva Verdugo.
    • Minutes of Meeting
    • Viewgraphs used during the meeting
    • The main action item resulting from the meeting is that each instrument representative shall come up with a list of use cases and requirement wish list applying to the HSC.HPDP they are supervising or acting as contact point for. These requirements will be compiled in the corresponding section below. Deadline: second half of September.
  • Sept-201HSC.5: Follow-up meeting to review requirements and agree on a consolidated request to SAT to be conveyed by Eva Verdugo

HSC.HPDP plans per instruments

HPDPs have been identified by each instrument team, although it is likely that not all of them will be possible to prepared in certain cases. We indicate hereafter the HPDPs currently contemplated by each instruments, with some common delivery categories that will be considered or not.

HSC.HIFI

HSC.HPDP name Description Data Catalogue (tables) Images (PNGs, etc) Documentation (Readme, QSummary, etc)
Expert Reduced Spectral Scans Baseline-cleaned deconvolved spectral scans Yes - level2.5 equivalent FITS files No Yes - postcards Yes
Expert Reduced Spectral Maps Baseline-cleaned regridded cubes l scans Yes - level2.5 equivalent FITS files No Yes - postcards Yes
Isolated OFF spectra OFF spectra as produced by the SPG, potentially cleaned further Yes - level2.5 equivalent FITS files No Yes - postcards Yes
Non-averaged level2 for point mode Level2 data as produced by modified version of SPG Yes - level2.5 equivalent FITS files (multiple spectra) No Yes - postcards Yes
Uncertainty tables Uncertainty tables as produced by the SPG No Yes - TableDataset as FITS files No Yes
Line list catalogue Identified Spectral Line catalogue No Yes - one file per obsid, and one concatenated file Yes - static (PNGs) and interactive (html) images Yes

HSC.PACS-P

HSC.HPDP name Description Data Catalogue (tables) Images (PNGs, etc) Documentation (Readme, QSummary, etc)
HSC.PACS Point Source Catalogue Point source catalogue as extracted from the photometer data No Yes - typically one large csv file per photometer band, and/or a unique concatenated one No Yes - Global release note
Improved level3 maps Further combination of fields with Unimap and JScanam Yes No ?? ??
Additional level 2.5 maps Combination of fields currently unconsidered in the list for level2.5 pipeline Yes No ?? ??

HSC.PACS-S

HSC.HPDP name Description Data Catalogue (tables) Images (PNGs, etc) Documentation (Readme, QSummary, etc)
Point-source calibrated data - case 1 SPG products processed through the dedicated point-source correction script for cases of centred point source Yes - level2.5 equivalent FITS files No ?? ??
Point-source calibrated data - case 2 SPG products processed through the dedicated point-source correction script for cases of non-centred point source Yes - level2.5 equivalent FITS files No ?? ??
Unchopped observations Baseline-subracted unchopped spectra Yes - level2.5 equivalent FITS files No ?? Must-have
Long range spectro flat-fielding Manual correction of the flat-fielding drift Yes - level2.5 equivalent FITS files No ?? Must-have
Red leak spectral range Run parallel pipeline that deals with red leak region (CalBlock+RSRF) and provide data stand-alone Yes - level2.5 equivalent FITS files No ?? Must-have
High flux source data ?? ?? No ?? ??
Repair of failed observations Re-run pipeline on observations set to failed Yes - level2.5 equivalent FITS files No ?? ??
Different wavelength regridding re-run SPG with different wavelength grid parameter for more rigourous noise computation Yes - level2.5 equivalent FITS files No ?? ??
Line list catalogue Spectral Feature catalogue No Yes - one file per obsid, and one concatenated file No ??

HSC.SPIRE-P

HSC.HPDP name Description DataSorted ascending Catalogue (tables) Images (PNGs, etc) Documentation (Readme, QSummary, etc)
HSC.SPIRE Point Source Catalogue Point source catalogue as extracted from the photometer data No Yes - typically one large csv file per photometer band, and/or a unique concatenated one No Yes - Global release note
HiRes maps Reprocessing of SPIRE-P maps with the HiRes algorithm Yes - level 2 or level 2.5 equivalent FITS files No ?? ??

HSC.SPIRE-S

HSC.HPDP name Description Data Catalogue (tables) Images (PNGs, etc) Documentation (Readme, QSummary, etc)
Semi-Extended calibration correction SECT correction for semi-compact sources Yes - level2 equivalent FITS files No Yes - postcards Yes
Extended background correction Extended background correction for point sources Yes - level2 equivalent FITS files No Yes - postcards Yes
Anomalous data correction Isolated cases of failed processing due to some on-board anomaly Yes - level2 equivalent FITS files No Yes - postcards Yes
Line list catalogue Spectral Feature catalogue (see also this page ) No Yes - one file per obsid, and one concatenated file No ??

HUI requirements

We provide here the HUI requirements needed to support the storage, queries and access to the various HPDPs.

TBD

-- DavidTeyssier - 17 Jun 201HSC.5

Edit | Attach | Watch | Print version | History: r74 | r7 < r6 < r5 < r4 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r5 - 2015-06-19 - DavidTeyssier
 
This site is powered by the TWiki collaboration platform Powered by Perl