TWiki> Public Web>HipeWhatsNew>HipeWhatsNew13x (revision 14)EditAttach

What's coming up in HIPE 13

PDF Version Click here
Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.
See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.

Planned work


   * TBD


   * TBD


 * TBD


   * TBD



   * TBD


  * TBD


   * TBD


   * TBD

Core system


Batch mode

Status bar

From the _Preferences > Data Access > MyHSA > Advanced panel, the user can:

  • Show the MyHSA on-line/off-line checkbox in the status bar.
  • Hide the MyHSA on-line/off-line checkbox in the status bar.

This label provides a more prominent location reflecting the current connection status of MyHSA, irrespective of what view the user is currently using. It also offers the ability to update this status, the status is synced with that shown in the product browser and vice versa. (HCSS-18451)


Drag & Drop

Editors & Viewers



The following changes are made to the Display class:
  • Replaced setCutLevels() by calcCutLevels()
  • Removed setCutLevels(double,double)
  • Renamed setCutLevels(double) to setCutLevelsPercentage(double)



Astronomical utilities


Numeric routines

 Data fitting

 Data interpolation

Random numbers


 Trend analysis


Other functions

Source extraction







Data cubes



Herschel Science Archive

Calibration sources

Products and datasets

 Observation context

Product Access Layer 


  • Warning, important __list__ argument removed: if your task call still has it, remove it.

The GetObs Task now includes the possibility to retrieve observation using the spg version that created the Observation. See up to date Task definition with examples: (HCSS-19063)

The GetObs Task path and poolLocation parameters have been consolidated. See up to date Task definition with examples: (HCSS-19241)

The FitsReaderTask and ImportSpectralCubeTask now support reading and loading of ALMA/CASA cubes directly into HIPE and the Spectrum Explorer - HCSS-18110

Quality control

Systematic product generation

Data input-output

Virtual Observatory

The link to VOPlot in the External Tools sub-menu will be removed and substituted by Topcat.




HIFI Software Configuration and Properties

HIFI Calibration

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Level 2.5 Pipeline

  • Mapping mode: The cubes produced automatically by the pipeline (Level 2.5) (doGridding task), and consequently by hifiPipeline if you choose to run it again, will stitch the WBS subbands and create one final cube (with the index '_1'). You will not see individual cubes per subbands except for the HRS.
  • Mapping mode: Level 2 HTPs , stitched, are now part of the Level 2.5.

HIFI Products

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

  • The PolarPair class has been removed. Instead the polarPair task should be used. This should only affect scripts written prior to 2013.

HIFI Data Processing Tools

Standing Wave Removal

  • Updates to default band-dependent period characteristics in task fitHifiFringe :
    • Band 1 change nfringe 2->3, endPeriod 120->200
    • Band 3 change typicalPeriod 620->95
    • Band 4 change typicalPeriod 620->95
    • Band 6 change startPeriod 100->80, typicalPeriod 320->600
    • Band 7 change startPeriod 100->80, typicalPeriod 320->625
    • Band 2,5 no change
  • Will now handle the combined flags NOT_CALIBRATED and SATURATED.
  • swTable had wrong unit for amplitude (kHz instead of K). This is now fixed.
  • New output variable swTable was created to enable machine-readable output of fitted frequencies and amplitudes.
  • Output for fitHifiFringe now contains corrected data and summary table.
  • New input parameters "cal" and "saveInput" was created fitHifiFringe to extract user input parameters into the calTree for later use on demand.

Baseline Removal

  • In order to correct fitBaseline from crashing when 'useWbs' is set to 'True', especially when doGlue is also set to 'True', the task will automatically override doGlue to 'False'.

Electrical Standing Wave correction in HEB bands


  • New option called enforce_spur_rejection to help control the existing spur_rejection option.

Spectral Cube creation


  • Interactive (suitable for batch processing) and Expert modes now available.
  • maskTables: a new variable to manage Linemasks and Rowmasks files.


  • IdentifyLines is a new task that allows you to identify lines in your spectrum and then run a comparison of known lines with a Linelist.

HiClass export tool


  • Updates to the HIFI Data Reduction Guide:
    • A new chapter on The HIFI line identification tool (identifyLines task) is now available.
    • Updates to the chapter How to add and remove flags, section Setting flags interactively for many spectra (flagTool task).
    • Updates to the chapter Sideband deconvolution, section Basic strategy for running the deconvolution tool (doDeconvolution task).






Analysis tools



Product changes





Calibration Products


  • Detector non-linearity correction factors updated. Does not affect the majority of observations, but is very important for faint targets observed at the beginning of each FTS observing day (when detector temperatures were low).

Calibration Framework


Engineering Conversion

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

  • Update to the naming within the Observation Context to make it clearer which products are spectra/cubes and pointsource/extended calibrated.
  • Moved all of the final spectral products into the Level-2 context. Previously the extended calibrated spectra were in the Level-1 context, but now both point source and extended calibrated data are in the Level-2 context.
  • Introduced a new spectrum2d product for mapping observations to contain all of the spectra before they are gridded into a regular spectral cube. Previously these spectra were saved in individual products for each jiggle/raster position. The new product is added to the Level-2 context.
  • A new task is added to perform spectral apodization. This step was previously carried out with several tasks to take the inverse Fourier transform and apply the apodization on the interferogram. The new task works directly on the spectra.
  • Quality control parameters related to the unaveraged FTS scans are now written back into the interferogram products in the Level-1 context. Previously these metadata items were lost after averaging the spectra over all of the scans.
  • New metadata parameters to contain known pointing offsets from the commanded position have been added to the Level-2 spectra.
  • A limit has been placed on the spectral resolution allowed as input when a spectral mapping observation is gridded into a cube. This eliminates spectra that were clipped, and improves the quality of the maps.

Interactive Analysis and Tools






  • Minor updates, bug fixes, and improved documentation for the Semi-extended correction task
  • Updates to the task to take synthetic photometry of FTS spectra for comparison with the SPIRE photometer
  • New GUI interface for the script that determines the noise level in a spectrum
  • Small corrections to the useful scripts



Release Notes

   * Full list of tickets implemented: here.

blog comments powered by Disqus

-- AlvarGarcia - 15 Jan 2014

Edit | Attach | Watch | Print version | History: r68 | r16 < r15 < r14 < r13 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r14 - 2014-11-24 - SylvieFBeaulieu
This site is powered by the TWiki collaboration platform Powered by Perl