<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  • all the 25 beams were divided by the peak value of the central spaxel beam;
  • then, they are multiplied to match the Point Source Correction calibration file (pointSourceLoss FM_4).

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

Spectroscopy

• A new script has been provided to allow users to plot the telescope background spectrum model. The code and necessary files are provided on http://herschel.esac.esa.int/twiki/bin/view/Public/PacsCalibrationWeb?template=viewprint (PACS Spectrometer Calibration section).
• PacsCubes and PacsRebinnedCubes created by the pipeline will now display in HIPE cube viewers with a flip over the diagonal, as compared to previously (X: to the right, Y: upwards). This change allows the visualisation of PACS cubes into the PACS footprint orientation (note the axes display with X: downwards, Y: to the left). The displayed indices correspond to the PACS spaxel indices (see more in Sect. 6.3 of the DAG). The standard HIPE cube visualisation can be recovered in two steps, using the flip menu in the cube display control bar: no flip + vertical flip. When exporting the cube data outside HIPE, note that the data will still be organised according to standard cube indices.The new orientation makes it easier to compare the cubes in cube viewers (the Standard Cube Viewer or the Spectrum Explorer) to the display of the PacsSpectralFootprint viewer.

Product changes

• The error layer within Unimap Level 2.5 products is renamed as stdDev, being the standard deviation computed at every sky pixel with respect to the samples that are falling on it. It can be properly assumed as the error map only if associated to the Naïve map.

Spectroscopy

• Unchopped range scan observations in 14.2
  • For unchopped range scan observations, the on-source and off-source are separate obsids and each is reduced to Level2. Then the off-source data are subtracted from the on-source data and the "background subtracted" products added to Level 2.5. This has been the case for a long time. The difference now is that these products have a slightly different name: "BS" is appended to the product names as viewed in HIPE and to the FITS file names on disc.

• • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[BS][R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as SBPs.
  • Added in 14.2.0: the output spectrum "c9" from extractCentralSpectrum is also provided.
• Level 3 extracted spectra table in 14.0, 14.2

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

Highlights

Core

• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.
• New Auxiliary Observation Summary Product with information about the observation in a simple dataset.
• Quality flags have been reorganised.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• Spectroscopy calibration

• • 14.0: drizzled cubes have a dedicated calibration and pipeline, and produce correct fluxes (a vast improvement on previous releases).
  • 14.2: a new spatial calibration (spaxel sizes and layout) has been released. There are slight differences from the one used previously. The flux distribution in mosaic cubes (interpolated, projected, drizzled) will change as a result.
  • The calibration tree update released for 14.2 includes a new RSRFR1 calibration file that can be used with the interactive pipelines to produce data in the red leak (>190 micron) region.

• • 14.2: for all observations, data below 55 microns and above 190 microns are excluded.
• Photometer products
  • Level 2.5 maps of solar system objects have been created for 14.0 and 14.2.

• New in 14.1 Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.
• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• • 14.0: drizzled cubes have a dedicated calibration and pipeline, and produce correct fluxes (a vast improvement on previous releases).
  • 14.2: a new spatial calibration (spaxel sizes and layout) has been released. There are slight differences from the one used previously. The flux distribution in mosaic cubes (interpolated, projected, drizzled) will change as a result.
  • The calibration tree update released for 14.2 includes a new RSRFR1 calibration file that can be used with the interactive pipelines to produce data in the red leak (>190 micron) region.

• Spectroscopy products
  • 14.0: spectrum tables have been added to the higher levels and the standalone browse products.
  • 14.2: for unchopped range scans, the on-source and the background subtracted on-source products (i.e. on-off) both are provided in the standalone browse products.
  • 14.2: interpolated cubes have an error array.
  • 14.2: for all observations, data below 55 microns and above 190 microns are excluded.

• • Level 2.5 maps of solar system objects have been created for 14.0 and 14.2.
  • 14.2: Unimap mapper has been upgraded to the version 6.4.4.

• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.
• In HIPE 14.1, the SPIRE Spectrometer bright mode calibration was fixed.
• In HIPE 14.2.1, the mosaicked SPIRE Photometer Level-3 maps are correctly calculated.

• Many improvements to the descriptions and/or units of the header meta keywords.
• All keywords have now a corresponding 8 character FITS keyword, so that the headers are easier to read with other software.

Photometry

• The error layer within Unimap Level 2.5 products is renamed as stdDev, being the standard deviation computed at every sky pixel with respect to the samples that are falling on it. It can be properly assumed as the error map only if associated to the Naïve map.

Engineering Conversion

Common Pipeline

Photometer Pipeline

• The User Pipelines have been updated with an option to create not just the point source maps but also the absolute calibtated maps in MJy/sr by setting the makeExtendMaps option

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the user’s computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.
  • The Unimap interactive scripts (scanmap_Unimap_memory and scanmap_Unimap_memory_optimized) are updated in HIPE14.2 in order to be compatible with any Unimap release (up to 6.5.3).
  • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.

Spectroscopy

• Interactive pipeline scripts in 14.0, 14.2

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• Level 3 extracted spectra table in 14.0, 14.2
  • The new spectrum tables from Level 2 for the pointed, chopNod, full SED observations, are concatenated into a single table which is placed in Level 3. This table, HPSSPEC, contains the extracted spectra for all the observations that were taken to cover the full spectral range (the full SED) of PACS for that target (this will be usually two, sometimes three, separate observations). Moreover, the red and blue camera, and all slices, are included this single table. This table is also provided as a standalone browse product.
  • The list of obisds that are combined into a Level 3 can be found on the data products overview page (http://www.cosmos.esa.int/web/herschel/data-products-overview).

• Interpolated cubes in 14.0 and 14.2
  • These cubes now have a spaxel size of 3" rather than 4.7".
  • They are no longer provided for oversampled mapping observations.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  • all the 25 beams were divided by the peak value of the central spaxel beam;
  • then, they are multiplied to match the Point Source Correction calibration file (pointSourceLoss FM_4).

• • For unchopped range scan observations, the on-source and off-source are separate obsids and each is reduced to Level2. Then the off-source data are subtracted from the on-source data and the "background subtracted" products added to Level 2.5. This has been the case for a long time. The difference now is that these products have a slightly different name: "BS" is appended to the product names as viewed in HIPE and to the FITS file names on disc.
• Level 2/2.5 extracted spectra tables in 14.0, 14.2
  • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[BS][R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as SBPs.

• Level 3 extracted spectra table in 14.0, 14.2
  • The new spectrum tables from Level 2 for the pointed, chopNod, full SED observations, are concatenated into a single table which is placed in Level 3. This table, HPSSPEC, contains the extracted spectra for all the observations that were taken to cover the full spectral range (the full SED) of PACS for that target (this will be usually two, sometimes three, separate observations). Moreover, the red and blue camera, and all slices, are included this single table. This table is also provided as a standalone browse product.

• Interpolated cubes in 14.0 and 14.2
  • These cubes now have a spaxel size of 3" rather than 4.7".
  • They are no longer provided for oversampled mapping observations.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.
• In HIPE 14.1, the SPIRE Spectrometer bright mode calibration was fixed.

• Access to the Planck maps in both the User pipelines and Useful Scripts is now handled automatically (see the zero point correction script for details on initial set up)
• The serendipity data (when the telescope slews to a target) is now included all the way to Level 1 in the Observation. Note that the serendipity data is the final building block and is NOT destriped.
• The SPIRE Level 2.5 data products have been extended to include, not only parallel pairs, but also sets of 2,3,4+ observations that would benefit from merging at the Level 2.5 stage. See the SPIRE Data Reduction Guide for a list of these observations.

Spectrometer Pipeline

• A new task has been added to the point source pipeline that applies a correction to remove significant artefacts from SLW spectra of LR observations (and the LR part of H+LR observations)
• A new task has been added to all pipelines that applies the extended calibration correction in order to incorporate the far field feedhorn efficiency for extended source. As a consequence we get better agreement between FTS and Phototmeter for fully extended sources.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• • Reset of the Spacecraft Velocity Vector (SVV) that is used by the STR to compute the aberration correction of the coordinates of guide stars. For more information please refer to the the dedicated section in the Spacecraft and Observatory pages.
  • It has been found that the STR misalignment was not properly handled in early ODs (<= 113) and has been fixed. (see SPR HCSS-20990). However, some issues still exist for a small set of SPIRE parallel observations in OD 111 (investigation on-going).
• Now up to 18 stars are now included in the computation of the gyro-based attitude reconstruction, whenever available in TM (in the previous release, only up to 9 stars were included).

Numeric routines

Data fitting

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in version 14.x

• • Reset of the Spacecraft Velocity Vector (SVV) that is used by the STR to compute the aberration correction of the coordinates of guide stars. For more information please refer to the the dedicated section in the Spacecraft and Observatory pages.
  • It has been found that the STR misalignment was not properly handled in early ODs (<= 113) and has been fixed. (see SPR HCSS-20990). However, some issues still exist for a small set of SPIRE parallel observations in OD 111 (investigation on-going).
• Now up to 18 stars are now included in the computation of the gyro-based attitude reconstruction, whenever available in TM (in the previous release, only up to 9 stars were included).

Numeric routines

Data fitting

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.
• New Auxiliary Observation Summary Product with information about the observation in a simple dataset.
• Quality flags have been reorganised.

• Changes to the output of the Deconvolution task.

• Legacy quality documentation.

• Spectroscopy calibration

• • 14.0: drizzled cubes have a dedicated calibration and pipeline, and produce correct fluxes (a vast improvement on previous releases).

• Spectroscopy products
  • 14.0: spectrum tables have been added to the higher levels and the standalone browse products.

• Photometer

• New in 14.1 Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.
• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.

Core system

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• Spectroscopy calibration

• • 14.0: drizzled cubes have a dedicated calibration and pipeline, and produce correct fluxes (a vast improvement on previous releases).
  • 14.2: a new spatial calibration (spaxel sizes and layout) has been released. There are slight differences from that used previously. The flux distribution in mosaic cubes (interpolated, projected, drizzled) will change as a result.

• Spectroscopy products
  • 14.0: spectrum tables have been added to the higher levels and the standalone browse products.
  • 14.2: for unchopped range scans, the on-source and the background subtracted on-source products (i.e. on-off) both are provided in the standalone browse products.

• • all the 25 beams were divided by the peak value of the central spaxel beam;
  • then, they are multiplied to match the Point Source Correction calibration file (pointSourceLoss FM_4).
• A slightly updated telescope background model for use in the Pointing Offset Correction pipeline script for point sources has been developed. This update is to allow better consistency between the "POC" script and the default pipeline script "Telescope normaliation", for chopNod AOTs. The changes are at the percent level and largest in band B3A.

• New spatial calibration in 14.2. The footprint of the IFU of PACS (the spaxel sizes and distributions) has been recalibrated.
  • The main change is that the spaxel sizes are set at 9.4" in two of the the tasks that create mosaic cubes (specInterpolate, specProject), rather than being calculated uniquely for each observation: the sizes now are slightly larger that before. Drizzle already assumed a fixed spaxel size of 9.4". The spaxel themselves have not changed, only the way they are treated in these two mosaic tasks.
  • The layout of the spaxels has changed slightly, and this affects the spectra in all mosaic cubes (specInterpolate, specProject, and drizzle).

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• • 14.2: interpolated cubes have a error array.
  • 14.2: for all observations, data below 55 microns and above 190 microns are excluded.
• Photometer

• New in 14.1 Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.
• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.

• Interactive pipeline scripts:
  • The JScanam ipipe script scanmap_JScanam_multiplePairs is designed to process multiple pairs of obsIDs and it has been upgraded by introducing the scanamorphosAlignFrames Task. This task aligns the Frames signal levels, belonging to every observation, to a common offset level, by exploiting the overlapping sky regions. This new capability is particulary useful for recovering a common background level over observations that are partially or slightly overlapping.
  • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the user’s computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.

• • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.

Spectroscopy

• Interactive pipeline scripts in 14.0, 14.2

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• • FitBaseline has been upgraded to properly deal with channels holding negative fluxes in the masking, and to not honour the informative SPUR_WARNING flags
  • mkRms has been upgraded to not honour the informative SPUR_WARNING flags
  • The issues with the 14.0.1 products whereby the mean and median statistics products were erroneously set to 0 has been fixed.

• • Photometer: Maps of solar system objects have been created for this version.
  • Spectrometer: Tables of spectra in level 2.5 and 3, as mentioned above.
• Unimap mapper has been upgraded to the latest version.
• There are new scripts making use of JScanam. There is also a script to generate drizzled cubes.
• New in 14.1 New spectroscopy calibration for extended sources. New beam calibration and background model.
• New useful and analysis scripts to account for these calibration changes (beam and background related).

• New in 14.1 Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  • all the 25 beams were divided by the peak value of the central spaxel beam;
  • then, they are multiplied to match the Point Source Correction calibration file (pointSourceLoss FM_4).

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• SPG scripts in 14.0. 14.2
  • The range scan observations are now flatfielded: using the cubic spline fitting method for ranges longer than 5 microns, and using the line scan flatfielding for the shorter ranges. The decision as to which flatfielding method to use is based on the wavelength range of the prime camera, and the parallel camera data use the same task as the prime camera uses (regardless of its own wavelength range).
  • We exclude the spectral regions affected by leakage as the calibration is incorrect for those ranges. In 14.0 this applied to range scans only, but in 14.2 no observation will have data below 55 microns or above 190 microns.

Calibration

• Level 3 extracted spectra table in 14.0, 14.2
  • The new spectrum tables from Level 2 for the pointed, chopNod, full SED observations, are concatenated into a single table which is placed in Level 3. This table, HPSSPEC, contains the extracted spectra for all the observations that were taken to cover the full spectral range (the full SED) of PACS for that target (this will be usually two, sometimes three, separate observations). Moreover, the red and blue camera, and all slices, are included this single table. This table is also provided as a standalone browse product.
• Interpolated cubes in 14.0 and 14.2

• Standalone browse products (SBPs) in 14.0 and 14.2
  • We now provide the new extracted spectra tables, HPSSPEC[BS][R|B] and HPSSPEC (see above)
  • The background subtracted unchopped range ("BS") products have been added: so for unchopped range scans where the observer requested an off-source, the SBPs for the on-source obsids will include Level2 cubes and tables and the background subtracted ones ("BS")

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

Pipeline

Photometry

• Level2.5 products:

• • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the user’s computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.
  • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.
• Unimap : Unimap 6.2.0 is spawned by the Standard Product Generator (SPG) to create Level2.5 products. See the Photometer Data Reduction Guide and the offical Unimap webpages (http://infocom.uniroma1.it/unimap/) to know What's New about the 6.2.0 Unimap release.

Spectroscopy

• • The pipeline menu has been reworded, so that the names reflect better what the individual scripts do. The first script offered in each menu is also the preferred one, and that on which the SPG scripts are based.

• • There have been small, but potentially significant changes to some of the tasks in the 'Pointing offset correction' scripts (chopNod) and the '...with transients" scripts (unchopped). These are, respectively, to the tasks specDetermineChiSquare and specLongTermTransient. The improvements are "under the hood" so there is no change in the user scripts themselves.
  • The range scan flatfielding task now performs a cubic spline fitting to the continuum of the spectra. This produces the same results as previously with the polynomial fit for shorter ranges, but improved results for longer ranges (especially SEDs) and is more robust against curvature changes in the spectra.

• • The interpolation algorithm in specInterpolate produces now NaN values in case one of the input spaxels has a NaN value, instead of producing skewed values due to a missing flux value. This results in more NaN values in the interpolated cubes, but avoids non-reliable values instead.

Calibration

Spectroscopy

• • all the 25 beams were divided by the peak value of the central spaxel beam;
  • then, they are multiplied to match the Point Source Correction calibration file (pointSourceLoss FM_4).

Analysis tools

Spectroscopy

• A new script has been provided to allow users to plot the telescope background spectrum model. The code and necessary files are provided on http://herschel.esac.esa.int/twiki/bin/view/Public/PacsCalibrationWeb?template=viewprint (PACS Spectrometer Calibration section).

Product changes

• Many improvements to the descriptions and/or units of the header meta keywords.
• All keywords have now a corresponding 8 character FITS keyword, so that the headers are easier to read with other software.

• The error layer within Unimap Level 2.5 products is renamed as stdDev, being the standard deviation computed at every sky pixel with respect to the samples that are falling on it. It can be properly assumed as the error map only if associated to the Naïve map.

Spectroscopy

Documentation

SPIRE

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.
• New Auxiliary Observation Summary Product with information about the observation in a simple dataset.
• Quality flags have been reorganised.

• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)
• Changes to the output of the Deconvolution task.
• New parameters for the removal tasks and updated functionality for *identifyLines.

• • Spectrometer: Tables of spectra in level 2.5 and 3, as mentioned above.
• Unimap mapper has been upgraded to the latest version.
• There are new scripts making use of JScanam. There is also a script to generate drizzled cubes.

• New useful and analysis scripts to account for these calibration changes (beam and background related).
• A new task runPacsSpg has been introduced, with which users can run the full PACS SPG pipeline from within HIPE.

SPIRE

• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.
• In HIPE v14.1, the SPIRE Spectrometer bright mode calibration was fixed.

• Special corrections in pointing products to handle S/C operational events have been included in the auxiliary processors. Namely, the corrections are:
  • STR switch-overs, i.e. changes from the usually prime star-tracker (STR1) to the backup unit (STR2)
  • Reset of the Spacecraft Velocity Vector (SVV) that is used by the STR to compute the aberration correction of the coordinates of guide stars. For more information please refer to the the dedicated section in the Spacecraft and Observatory pages.

• Now up to 18 stars are now included in the computation of the gyro-based attitude reconstruction, whenever available in TM (in the previous release, only up to 9 stars were included).

Numeric routines

Documentation

Editors & Viewers

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.
• New Auxiliary Observation Summary Product with information about the observation in a simple dataset.
• Quality flags have been reorganised.

• Update of sideband ratio in bands 1 to 4 - note that this will imply changes in the intensities in all concerned bands

• Special corrections in pointing products to handle S/C operational events have been included in the auxiliary processors. Namely, the corrections are:
  • STR switch-overs, i.e. changes from the usually prime star-tracker (STR1) to the backup unit (STR2)
  • Reset of the Spacecraft Velocity Vector (SVV) that is used by the STR to compute the aberration correction of the coordinates of guide stars. For more information please refer to the the dedicated section in the Spacecraft and Observatory pages.

• Now up to 18 stars are now included in the computation of the gyro-based attitude reconstruction, whenever available in TM (in the previous release, only up to 9 stars were included).

Numeric routines

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.
• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.

Core system

• • A new calibration product SCalSpecLrCorr has been added, containing correction curves for point-source calibrated LR data.
  • A new calibration product SCalSpecExtCorr has been added, containing polynomial coefficients that are used to generate correction curves for extended source calibrated data.
  • A new calibration product SCalSpecOpdCorr has been added, it is currently neither used in the pipelines nor in user scripts.

• Photometer
  • Updates to the photometer beams: SCalPhotBeamProf and SCalPhotRadialCorrBeam affecting most colour correction parameters.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• Update of sideband ratio in bands 1 to 4 - note that this will imply changes in the intensities in all concerned bands
• Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget
• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)

• New parameters for the removal tasks and updated functionality for *identifyLines.
• Legacy quality documentation.
• From 14.1 onwards:

• • The issues with the 14.0.1 products whereby the mean and median statistics products were erroneously set to 0 has been fixed.
  • Some relevand meta-data that were missing in cubes generated with 14.0.1 have now been added to the product headers

• There are new scripts making use of JScanam. There is also a script to generate drizzled cubes.
• New spectroscopy calibration for extended sources. New beam calibration and background model.
• New useful and analysis scripts to account for these calibration changes (beam and background related).

• Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• Changes to the output of the Deconvolution task.
• New parameters for the removal tasks and updated functionality for *identifyLines.
• Legacy quality documentation.

• Updates to high level products: Photometry level 2.5 and the creation of the Spectroscopy levels 2.5 and 3 (not really products but tables of spectra).

• Flags are now applied to OFF spectra as well
• BrowseProduct: generation of a browse image for the reference spectra, when the option useReferenceSpectra is set to true
• The FITS header keywords have been revamped in order to provide proper nicknames to the parameters featured in those headers

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

• New parameter addMedianContinuum: allow the median continuum to be added back into the baseline fit flux [DEFAULT: False]

Baseline Removal

• New parameter addMedianContinuum: allow the median continuum to be added back into the baseline fit flux but only performs well for basemode='sub' and not basemode='div' [DEFAULT: False]

Deconvolution

• The output deconvolution product ssb is now called dataset (please note that scripts prior to this change will break)

Spectral Cube creation

• • New parameter snrType: the signal to noise ratio calculation algorithm (Intensity or Flux)
  • Implementation of the exportLines task

HiClass export tool

Documentation

For HCSS 14, many figures were refreshed in both manuals (HIFI Data Reduction Guide and HIFI Pipeline Specification).

• • Updates to the chapter How to add and remove flags, section Setting and Clearing Flags with command line tools: improved the definition of the parameter selection for Level 2.5 cubes
  • A new chapter called Understanding the uncertainty table information in your data has been added
  • Updates to the chapter The HIFI line identification tool, adding a section called The exportLines Task

• Updates to the HIFI Pipeline Specification manual
  • This manual has been restructured
  • Removal of the task mkSpur

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

Spectrometer Pipeline

• A new task has been added to the point source pipeline that applies a correction to remove significant artefacts from SLW spectra of LR observations (and the LR part of H+LR observations)
• A new task has been added to all pipelines that applies the extended calibration correction in order to incorporate the far field feedhorn efficiency for extended source. As a consequence we get better agreement between FTS and Phototmeter for fully extended sources.

Interactive Analysis and Tools

• There is a new useful script, Spectrometer Pointing Offset Corrector, for estimating and correcting pointing offset in sparse point observations. The scripts assesses the difference between the SLW and SSW spectra of the centre detectors, over the overlapping frequency range, uses this to estimate any pointing offset and corrects the data using SECT.

Documentation

What's new in HIPE 14

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<!-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• • Spectrometer: Tables of spectra in level 2.5 and 3, as mentioned above.
• Unimap mapper has been upgraded to the latest version.
• There are new scripts making use of JScanam. There is also a script to generate drizzled cubes.

• New useful and analysis scripts to account for these calibration changes (beam and background related).
• A new task runPacsSpg has been introduced, with which users can run the full PACS SPG pipeline from within HIPE.

• The extended-source calibrated rebinned cubes (level2) contain now a correction that accounts for the non-uniform illumination of the PACS IFU field-of-view. It stems from the fact that the 9.4"x9.4" spaxel edges are less responsive than their centres, translating into a spaxel active area of approximately 8"x8" where the response is flat. This effect is more severe at shorter wavelengths, and affects (very) extended emission, as well as off-centred point sources and any source that has a size between a point and a very extended. All Level 2/2.5 cubes for these types of sources will be affected, whether pointed or mapping.
  Hence, for centred point source extracted with the task extractCentralSpectrum, no change to the spectra are expected in this version of HIPE because of this effect. For very extended sources, we have developed a new Extended Source Correction calibration file (ExtendedSourceLoss, applied in the pipeline tasks specRespCal and specRespCalToTelescope), and this incorporates the necessary correction as part of the spatial flatfielding for the PACS spectrometer. For these sources, the fluxes of the spectra will differ to what was obtained in previous versions of HIPE. For intermediate sources, a more complex analysis is necessary to estimate the flux loss, and a task to do this will be provided in HIPE 15.
  The fluxes of the spaxels of all cubes will be increased by ~30% in the blue to ~5% in the red. The calibration file can be inspected to extract the curve:
  w = calTree.spectrometer.extendedSourceLoss["wavelength"].data
  f = calTree.spectrometer.extendedSourceLoss["fraction"].data
  p=PlotXY(w, 1./f)
  After such a correction, a source of flat surface brightness within the field of view of a single pointing will be well calibrated at the level of the rebinned cubes (i.e. level2).The flux loss between the detectors was already accounted for in the point-source calibration correction in the correspondent calibration file, therefore, point-source calibrated spectra of centred point sources are not affected. For this reason, in HIPE 14, the extractCentralSpectrum task checks and removes the extendedSourceLoss correction from the level2 cubes, in case it has been applied, before extracting the final point source corrected spectrum. However, if working with off-centred point sources and using the tasks extractSpaxelSpectrum and pointSourceLossCorrection, this correction is not taken out, and hence the results will be incorrect. An extra task/function is necessary: to get this, raise a helpdesk ticket.

• A slightly updated telescope background model for use in the Pointing Offset Correction pipeline script for point sources has been developed. This update is to allow better consistency between the "POC" script and the default pipeline script "Telescope normaliation", for chopNod AOTs. The changes are at the percent level and largest in band B3A.

Analysis tools

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<!-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• Now you can pass arguments to scripts in batch mode (former jylaunch).
• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.

• Quality flags have been reorganised.
• SVV resets and STR switch-overs handled by auxiliary processors in the generation of the pointing product.

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<!-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• SVV resets and STR switch-overs handled by auxiliary processors in the generation of the pointing product.

HIFI

• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)
• Changes to the output of the Deconvolution task.
• New parameters for the removal tasks and updated functionality for *identifyLines.

• A new task runPacsSpg has been introduced, with which users can run the full PACS SPG pipeline from within HIPE.

SPIRE

• Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
• The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.

What's new in HIPE 14

Highlights

• SVV resets and STR switch-overs handled by auxiliary processors in the generation of the pointing product.

HIFI

• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)
• Changes to the output of the Deconvolution task.
• New parameters for the removal tasks and updated functionality for *identifyLines.

• A new task runPacsSpg has been introduced, with which users can run the full PACS SPG pipeline from within HIPE.

SPIRE

Core system

bash> hipe myScript.py arg1 arg2

• • The JScanam ipipe script scanmap_JScanam_multiplePairs is designed to process multiple pairs of obsIDs and it has been upgraded by introducing the scanamorphosAlignFrames Task. This task aligns the Frames signal levels, belonging to every observation, to a common offset level, by exploiting the overlapping sky regions. This new capability is particulary useful for recovering a common background level over observations that are partially or slightly overlapping.
  • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the user’s computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.
  • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.

Spectroscopy

• Level 2/2.5 extracted spectra tables:
  • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as standalone browse products.

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  
  • In the spatial domain, they are normalised such that the sum of all spaxels is 1 when a point source of flux 1 is observed at the peak position of the central spaxel;

Calibration Products

• Spectrometer

• Photometer

Calibration Framework

Documentation

Editors & Viewers

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

• SVV resets and STR switch-overs handled by auxiliary processors in the generation of the pointing product.

HIFI

• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)
• Changes to the output of the Deconvolution task.
• New parameters for the removal tasks and updated functionality for *identifyLines.

What's new in HIPE 14

• New Quick Analysis perspective allows GUI download of products and processing all within HIPE.
• New product Auxiliary Observation Summary Product with information about the observation in a simple dataset.
• Quality flags have been reorganised.

• Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget

Dataset viewer

Astronomical utilities

• Special corrections in pointing products to handle S/C operational events have been included in the auxiliary processors. Namely, the corrections are:
  • STR switch-overs, i.e. changes from the usually prime star-tracker (STR1) to the backup unit (STR2)

Numeric routines

Data fitting

Documentation

Editors & Viewers

Dataset viewer

Astronomical utilities

Numeric routines

Data fitting

• The serendipity data (when the telescope slews to a target) is now included all the way to Level 1 in the Observation. Note that the serendipity data is the final building block and is NOT destriped.
• The SPIRE Level 2.5 data products have been extended to include, not only parallel pairs, but also sets of 2,3,4+ observations that would benefit from merging at the Level 2.5 stage. See the SPIRE Data Reduction Guide for a list of these observations.

Spectrometer Pipeline

• A new task has been added to all pipelines that applies the extended calibration correction in order to incorporate the far field feedhorn efficiency for extended source. As a consequence we get better agreement between FTS and Phototmeter for fully extended sources.

Interactive Analysis and Tools

HIFI Software Configuration and Properties

HIFI Calibration

• The sideband ratio updates will imply changes in intensity at all frequencies in bands 1 to 4. No changes are expected in bands 5 to 7.

HIFI Pipeline

hifiPipeline task

Level 2 Pipeline

• For DBS Raster maps, the Level 2 spectra are no longer averaged - this was already the case for OTF maps
• Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget

Level 2.5 Pipeline

• Changes to the output of the Deconvolution task: the single-sideband spectrum is now contained in a Spectrum1d called "dataset" (it was called "ssb" up to HIPE 13).

HIFI Products

• The serendipity data (when the telescope slews to a target) is now included all the way to Level 1 in the Observation. Note that the serendipity data is the final building block and is NOT destriped.
• The SPIRE Level 2.5 data products have been extended to include, not only parallel pairs, but also sets of 2,3,4+ observations that would benefit from merging at the Level 2.5 stage. See the SPIRE Data Reduction Guide for a list of these observations.

Spectrometer Pipeline

• A new task has been added to all pipelines that applies the extended calibration correction in order to incorporate the far field feedhorn efficiency for extended source. As a consequence we get better agreement between FTS and Phototmeter for fully extended sources.

Interactive Analysis and Tools

Command line

bash> hipe myImage.jpg cube.fits resultTable.csv

would open HIPE with three viewers: one for the image, a spectrum explorer for the cube, and a dataset viewer for the CSV table.

Note:

bash> hipe myScript.py arg1 arg2

would not open the HIPE window, but execute the script with the given arguments passed to it.

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  
  • In the spatial domain, they are normalised such that the sum of all spaxels is 1 when a point source of flux 1 is observed at the peak position of the central spaxel;

Calibration Products

• Spectrometer

Calibration Framework

Photometer Pipeline

• The User Pipelines have been updated with an option to create not just the point source maps but also the absolute calibtated maps in MJy/sr by setting the makeExtendMaps option

• The serendipity data (when the telescope slews to a target) is now included all the way to Level 1 in the Observation. Note that the serendipity data is the final building block and is NOT destriped.
• The SPIRE Level 2.5 data products have been extended to include, not only parallel pairs, but also sets of 2,3,4+ observations that would benefit from merging at the Level 2.5 stage. See the SPIRE Data Reduction Guide for a list of these observations.

Spectrometer Pipeline

Interactive Analysis and Tools

• There is a new useful script, Spectrometer Pointing Offset Corrector, for estimating and correcting pointing offset in sparse point observations. The scripts assesses the difference between the SLW and SSW spectra of the centre detectors, over the overlapping frequency range, uses this to estimate any pointing offset and corrects the data using SECT.

What's new in HIPE 14

Highlights

Command line

bash> hipe myImage.jpg cube.fits resultTable.csv

would open HIPE with three viewers: one for the image, a spectrum explorer for the cube, and a dataset viewer for the CSV table.

bash> hipe myScript.py arg1 arg2

would not open the HIPE window, but execute the script with the given arguments passed to it.

• • The JScanam ipipe script scanmap_JScanam_multiplePairs is designed to process multiple pairs of obsIDs and it has been upgraded by introducing the scanamorphosAlignFrames Task. This task aligns the Frames signal levels, belonging to every observation, to a common offset level, by exploiting the overlapping sky regions. This new capability is particulary useful for recovering a common background level over observations that are partially or slightly overlapping.
  • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the user’s computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.
  • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.

Spectroscopy

• Level 2/2.5 extracted spectra tables:
  • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as standalone browse products.

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  
  • In the spatial domain, they are normalised such that the sum of all spaxels is 1 when a point source of flux 1 is observed at the peak position of the central spaxel;

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<!-- END OF ANALYTICS CODE -->

What's new in HIPE 14

Spectroscopy

• New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
  
  • In the spatial domain, they are normalised such that the sum of all spaxels is 1 when a point source of flux 1 is observed at the peak position of the central spaxel;

What's new in HIPE 14

• Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget
• Update of sideband ratio in bands 1 to 4
• Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)

• Legacy quality documentation.

PACS

Baseline Removal

• New parameter addMedianContinuum: allow the median continuum to be added back into the baseline fit flux but only performs well for basemode='sub' and not basemode='div' [DEFAULT: False]

Deconvolution

Spectral Cube creation

flagTool

identifyLines

• • Changes on the Herschel Spectral Line List columns names
  • Implementation of the image band line identification for pointed and mapping observations
  • Fix to the rms computation

• • New parameter snrType: the signal to noise ratio calculation algorithm (Intensity or Flux)
  • Implementation of the exportLines task

HiClass export tool

• • Updates to the chapters Standing wave Removal and HIFI Baseline Removal : adding definition of the new parameter addMedianContinuum
  • Updates to the chapter Flags in HIFI data, section Quality Flags (this chapter is being revamped, please check regularly)
  • Updates to the chapter How to make a spectral cube: added a definition for parameters ignoreOffs, outputNames and extrapolate

• • Updates to the chapter Standing wave Removal, ESW correction in HEB bands section: update to the scripts in the demonstration subsection
  • Updates to the chapter How to add and remove flags, section Setting and Clearing Flags with command line tools: improved the definition of the parameter selection for Level 2.5 cubes
  • A new chapter called Understanding the uncertainty table information in your data has been added

Spectroscopy

• A slightly updated telescope background model for use in the Pointing Offset Correction pipeline script for point sources has been developed. This update is to allow better consistency between the "POC" script and the default pipeline script "Telescope normaliation", for chopNod AOTs. The changes are at the percent level and largest in band B3A.

Analysis tools

Documentation

Editors & Viewers

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's new in HIPE 14

• • The pipeline menu has been reworded, so that the names reflect better what the individual scripts do. The first script offered in each menu is also the preferred one, and that on which the SPG scripts are based.
  • A new pipeline script has been written to create drizzled cubes, based on (and almost hardly different to) the 'Telescope normalisation' pipeline script for chopNod line scans. With this script it is now possible to create drizzle cubes using this preferred pipeline method (in Track 13 it was not possible).
  • There have been small, but potentially significant changes to some of the tasks in the 'Pointing offset correction' scripts (chopNod) and the '...with transients" scripts (unchopped). These are, respectively, to the tasks specDetermineChiSquare and specLongTermTransient. The improvements are "under the hood" so there is no change in the user scripts themselves.

• SPG scripts:
  • The range scan observations are now flatfielded: using the spline fitting method for ranges longer than 5 microns, and using the line scan flatfielding for the shorter ranges

• • The interpolated cubes are no longer produced for oversample range scan mapping observations, and they also have a smaller spaxel size of 3" (rather than 4.7" before).
  • The interpolation algorithm in specInterpolate produces now NaN values in case one of the input spaxels has a NaN value, instead of producing skewed values due to a missing flux value. This results in more NaN values in the interpolated cubes, but avoids non-reliable values instead.

Spectroscopy

• A slightly updated telescope background model for use in the Pointing Offset Correction pipeline script for point sources has been developed. This update is to allow better consistency between the "POC" script and the default pipeline script "Telescope normaliation", for chopNod AOTs. The changes are at the percent level and largest in band B3A.

Analysis tools

Product changes

• Many improvements to the descriptions and/or units of the header meta keywords.
• All keywords have now a corresponding 8 character FITS keyword, so that the headers are easier to read with other software.

• Interpolated cubes: The way the task specInterpolate handles NaNs as it creates these cubes has changed. This will primarily affect cubes with saturated data. Saturated data are masked out and replaced with NaNs when rebinned cubes are built. Interpolated cubes are then created from the rebinned cubes. NaNs are now filtered out as the interpolation task does its work on the input cubes, and all affected and immediately surrounding spaxels of the output interpolated cube will also be NaN. Hence, at the affected wavelengths, the NaN area will be larger than before...but this is also more correct than before.
• Standalone browse products: we now provide the new extracted spectra tables, HPSSPEC[R|B] and HPSSPEC (see above), as SBPs.
• Drizzle cubes: in SPG 13 the drizzle cube fluxes were incorrect. In SPG 14 they are now correct.

Documentation

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

• A new task has been added to the point source pipeline that applies the LR correction.
• A new task has been added to all pipelines that applies the extended calibration correction in order to get better agreement between FTS and Phototmeter photometry.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

• Quality flags have been reorganised.

HIFI

• Changes to the output of the Deconvolution task.
• New parameters for the *removal tasks and updated functionality for identifyLines.
• Legacy quality documentation.

HIFI Software Configuration and Properties

HIFI Calibration

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Level 2.5 Pipeline

HIFI Products

• New quality flags information:
  • updates of a few QFs names/descriptions (which were obsolete), deleting a few obsolete flags

• • updates to the quality report, now including the text for public flags (impact and action)
• Flags are now applied to OFF spectra as well
• BrowseProduct: generation of a browse image for the reference spectra, when the option useReferenceSpectra is set to true

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

• • Parameters change: toleranceEmission and toleranceAbsorption has become toleranceFactorEmi and toleranceFactorAbs (may break scripts prior to this change)
  • New parameter snrType: the signal to noise ratio calculation algorithm (Intensity or Flux)
  • Implementation of the exportLines task

HiClass export tool

Documentation

For HCSS 14, many figures were refreshed in both manuals (HIFI Data Reduction Guide and HIFI Pipeline Specification).

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Level 2.5 Pipeline

HIFI Products

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

• • reorganisation of categories in the documentation (from class 1 to 3, by how severe the impact they may have on the science)
  • updates to the impact and action text following a legacy use
  • updates to the quality report, now including the text for public flags (impact and action)

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

HIFI Data Processing Tools

Standing Wave Removal

Baseline Removal

Deconvolution

• The output deconvolution product ssb is now called dataset (please note that scripts prior to this change will break)

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

Level 2.5 Pipeline

HIFI Products

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

• Level 2/2.5 extracted spectra tables:
  • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as standalone browse products.
• Level 3 extracted spectra table:

• Interactive pipeline scripts:
  • The pipeline menu has been reworded, so that the names reflect better what the individual scripts do. The first script offered in each menu is also the preferred one, and that on which the SPG scripts are based.
  • A new pipeline script has been written to create drizzled cubes, based on (and almost hardly different to) the 'Telescope normalisation' pipeline script for chopNod line scans. With this script it is now possible to create drizzle cubes using this preferred pipeline method (in Track 13 it was not possible).

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

• Updates to high level products: Photometry level 2.5 and the creation of the Spectroscopy levels 2.5 and 3 (not really products but tables of spectra).
  • Photometer: Maps of solar system objects have been created for this version.
  • Spectrometer: Tables of spectra in level 2.5 and 3, as mentioned above.

• New spectroscopy calibration for extended sources which also works for off-centre point sources. New beam calibration and background model.
• New useful and analysis scripts to account for these calibration changes (beam and background related).

• FTS

PACS

Pipeline

Photometry

• Level2.5 products:
  • Unimap and Jscanam maps are now generated for Solar System Objects, from combined scan and cross-scan observations.

• SPG scripts:
  • The range scan observations are now flatfielded: using the spline fitting method for ranges longer than 5 microns, and using the line scan flatfielding for the shorter ranges
  • The interpolated cubes are no longer produced for oversample range scan mapping observations, and they also have a smaller spaxel size of 3" (rather than 4.7" before).

Calibration

Photometry

Spectroscopy

• There is a new Extended Source Correction calibration file (ExtendedSourceLoss, used in the pipeline tasks specRespCal and specRespCalToTelescope) which produces a better spatial flatfield for the PACS spectrometer. The fluxes of the spaxels of all cubes will be increased by ~30% in the blue to a decrease of ~5% in the red. The calibration file can be inspected to extract the curve:

  w = calTree.spectrometer.extendedSourceLoss["wavelength"].data
  f = calTree.spectrometer.extendedSourceLoss["fraction"].data
  
  

• For point sources calibrated with extractCentralSpectrum, this extended source correction is taken out before the point source corrections are computed. However, if working with off-centred point sources and using the tasks extractSpaxelSpectrum and pointSourceLossCorrection, this correction is not taken out, and hence the results will be incorrect. An extra task/function is necessary: to get this, raise a helpdesk ticket.
• New Beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.

• A slightly updated telescope background model for use in the Pointing Offset Correction pipeline script for point sources has been developed. This update is to allow better consistency between the "POC" script and the default pipeline script "Telescope normaliation", for chopNod AOTs. The changes are at the percent level and largest in band B3A.

Analysis tools

Photometry

• The PhotometryConvolveResolution Kernel script was added within the PACS Useful Script section. This script convolves and regrids a map at a certain wavelength to the PSF of another map at longer wavelength, by using an appropriate kernel.

Spectroscopy

• A new script has been provided to allow users to plot the telescope background spectrum model. The code and necessary files are provided on http://herschel.esac.esa.int/twiki/bin/view/Public/PacsCalibrationWeb?template=viewprint (PACS Spectrometer Calibration section).

Product changes

Photometry

• The error layer within Unimap Level 2.5 products is renamed as stdDev, being the standard deviation computed at every sky pixel with respect to the samples that are falling on it. It can be properly assumed as the error map only if associated to the Naïve map.

Spectroscopy

• Interpolated cubes: Cubes produced by the task specInterpolate now have a spaxel size of 3".
• Interpolated cubes: Are no longer provided for oversampled mapping observations.

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

Display

• Added shortcuts to some of the task directly in the image viewer.

Analysis

<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->

<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 14

Documentation

Editors & Viewers

<-- ANALYTICS CODE - DO NOT EDIT -->