This page compiles the plans and needs to prepare and serve Highly Processed Data Products (HPDPs) to the Scientific Communities. There are two main ways considered to fulfil this: a web page, similar to that used for User Provided Data Products (UPDP, see also
), and the HSA User Interface (HUI). The following focusses mostly on the latter.
HPDPs have been identified by each instrument team, although it is likely that not all of them will be possible to prepared in certain cases.
We indicate hereafter the HPDPs currently contemplated by each instruments, with some common delivery categories that will be considered or not.
| HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
Prototype delivery |
| Expert Reduced Spectral Scans |
Baseline-cleaned deconvolved spectral scans |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
|
| Expert Reduced Spectral Maps |
Baseline-cleaned regridded cubes l scans |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
|
| Isolated OFF spectra |
OFF spectra as produced by the SPG, potentially cleaned further |
Yes - level2.5 equivalent FITS files |
No |
Yes - postcards |
Yes |
|
| Non-averaged level2 for point mode |
Level2 data as produced by modified version of SPG |
Yes - level2.5 equivalent FITS files (multiple spectra) |
No |
Yes - postcards |
Yes |
|
| Uncertainty tables |
Uncertainty tables as produced by the SPG |
No |
Yes - TableDataset as FITS files |
No |
Yes |
|
| Line list catalogue |
Identified Spectral Line catalogue |
No |
Yes - one file per obsid, and one concatenated file |
Yes - static (PNGs) and interactive (html) images |
Yes |
|
| HPDP name |
Description |
Data |
Catalogue (tables) |
Images (PNGs, etc) |
Documentation (Readme, QSummary, etc) |
Notes |
Prototype delivery |
| Point-source calibrated data - case 1 |
SPG products processed through the dedicated point-source correction script for cases of centred point source |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Straightforward to do once the pipeline script has been fully validated and sources identified; validation is on-going |
|
| Point-source calibrated data - case 2 |
SPG products processed through the standard pipeline script for cases of centred point sources |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Aiming for SPG 14 in fact, so should be part of SPG rather than HPDP |
|
| Point-source calibrated data - case 3 |
SPG products processed through the standard pipeline script for cases of off-centred point sources |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
A possibility, difficult to identify, requires production of the uneven illumination correction task (which is on-going work) |
|
| Unchopped observations - case 1 |
Baseline-subtracted unchopped spectra |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Desirable, if case 2 is not possible this becomes Highly desirable |
|
| Unchopped observations - case 2 |
Improved transient correction and background subtraction |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Highly desirable, if it is possible to do this is preferred over case 1 |
|
| Long range spectro flat-fielding |
Manual correction of the flat-fielding drift |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Must-have, however the aim is to have this as part of the SPG, and only those that still have problems would require manual correction |
|
| Red leak spectral range |
Run the specific pipeline that deals with red leak region (CalBlock+RSRF) and provide data stand-alone |
Yes - level2 equivalent FITS files |
No |
Yes |
|
Must-have |
|
| High flux source data |
Very bright sources ought to be reduced with a difference pipeline script |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Some level of manual reduction may be necessary, but probably are not many such observations |
|
| Removing background contamination - case 1 chopNod mode |
Line (and continuum?) |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Nice to have, depends on how possible it will be to identify these, would be manual reduction |
|
| Removing background contamination - case 2 unchopped mode |
Line (and continuum?) |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Nice to have, easier to identify that for chopNod, but would here also be manual reduction |
|
| Repair of failed observations |
Re-run pipeline on observations set to failed |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Observations that are classed as failed but which will now run in SPG are easy to do and could become standard SPG, for others that require manual reduction they could also become the standard SPG, probably not difficult |
|
| Different wavelength regridding |
Re-run SPG with different wavelength grid parameter so the fluxes are no dependent and the noise characteristics not changed |
Yes - level2/2.5 equivalent FITS files |
No |
Yes |
|
Has not been discussed by ICC yet, so whether this replaces SPG or is provided as an HPDP or done at all, has not yet been discussed |
|
| Line list catalogue |
Spectral Feature catalogue |
No |
Yes - one file per obsid, and one concatenated file |
No |
|
dependent on available human resources |
|
We provide here the HUI requirements needed to support the storage, queries and access to the various HPDPs.
), and the HSA User Interface (HUI). The following focusses mostly on the latter.
pdf 
Public Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Public
