• Changes between HIPE 8.1 and 8.2

<--   * Changes between HIPE 8.1 and 8.2 -->

• Changes between HIPE 8.0.1 and 8.1

• Removed doInterpolation task parameter. The reason is that this parameter is of such limited use that it is best left as a parameter in the madMapper task.

• doGridding now uses AOT parameters in the meta data (such as beam size, map size, and - for observations after OD 835 - readout and line separations) to create cubes that reflect how the observation was carried out. In addition a box filter (previously a Gaussian) is automatically used for greater than Nyquist sampled DBS Raster maps.

• • Changes to values in the GUI form now only go in one direction, e.g. changing the PixelSize or the BeamSize results in an update of the Filter Parameters but not vice versa.

• Improved band 6 and 7 Spectral Scan data: Improvements in the level 1 pipeline give noticeably improved noise and baseline quality of Spectral Scan observations performed in bands 6 and 7.

• Substantial refactoring of CheckFrequencyGrid to correct assumptions made about the sequence of on-, off- and hc-datasets. This primarily affected HEB band data and resulted in unnecessary Quality Flags being raised. This correction produces a noticeable improvement in the noise and baseline quality of observations performed in bands 6 and 7.

• doGridding now uses AOT parameters in the meta data (such as beam size, map size, and - for observations after OD 835 - readout and line separations) to create cubes that reflect how the observation was carried out. In addition a box filter (previously a Guassian) is automatically used for greater than Nyquist sampled DBS Raster maps.

• User pool names (pool ID) restrictions: Allowed characters in name: alphanumeric, dash ("-") and underscore ("_"). The pool ID is case-sensitive, must be with less than 255 characters, and "urn" is not allowed as pool ID, and finally the pool ID cannot start with a dash ("-"). Old pools with names that violate those restrictions need to be renamed (at OS level) in order to be used in HIPE.

• Astrometry: new astrometry correction module. Given a reference image, it will correct the whole observation conext (level 1 and level 2)

• SPIRE Spectroscopy of bright sources: Big improvements in the processing of bright source mode observations with the SPIRE Spectrometer.
• Calibration files: Improvements in a number of Spectrometer calibration file

• SPIRE Photometry of extended emission: improved destriper; new module and calibration file to correct for relative gains correction for extended emission

• Reprocess PACS photometry with HIPE 8: Only if you have a very bright target of which you want to do the photometry with the non-linearity correction and the crosstalk artifacts removal.

• A tool specBaselineEstimator has been made available especially for long-range spectrum baseline removal. The wavelet-based multiresolution engine can also provide automatic line identification, line mask and continuum noise products.

• Changes between HIPE 8.0 and 8.0.1

Highlights

HIFI

• Improved spectral cubes: Spectral cubes from mapping observations after OD 835 gridded using actual scan line and readout used in observation, earlier maps use a better approximation.
• Improved band 6 and 7 data: Improvements in the level 1 pipeline give noticeably improved noise and baseline quality of all observations performed in bands 6 and 7.
• Standing waves: For strong continuum sources an optional pipeline step, doFilterLoads, can reduce or eliminate standing waves from the hot and cold loads
• Calibration version: The calibration version used by the pipeline is now included in the metadata of all calibrated products. You can also select the calibration version to be used by the pipeline (command line only).

PACS

• PACS Spectroscopy: Several new or improved tasks: flux calibration now includes the calibration block; errors are calculated at the cube level; better transients correction for unchopped observations; improved the flatfielding tasks (line scan and range scan separately).
• New pipeline scripts: To combine or bulk processes data, to compare off-source (sky) spectra to the on-source spectra, and to experiment with an alternative spectral response method.
• PACS Photometry: Second-level deglitching more efficient; a companion task to photProject, which is much faster; new cross-talk correction task; updated calibration file for non-linearity.
• Reprocess with HIPE 8: Only if you have a very bright target of which you want to do the photometry with the non-linearity correction and the crosstalk artifacts removal.

SPIRE

• Bright sources: Big improvements in the processing of bright source mode observations with the SPIRE Spectrometer.
• Calibration files: Improvements in a number of Spectrometer calibration files.
• FTS spectra: The representation of FTS spectra is now in terms of Frequency in GHz and not in wavenumbers in cm^-1.

sdi = phaseCorrection(sdi=sdi, avgSdi=avgSdi, spectralUnit= GHz | cm-1) 

sdi = phaseCorrection(sdi=sdi, avgSdi=avgSdi, spectralUnit= GHz | cm) 

sdi = phaseCorrection(sdi=sdi, avgSdi=avgSdi, spectralUnit= 

sdi = phaseCorrection(sdi=sdi, avgSdi=avgSdi, spectralUnit= =GHz= | =cm<sup>-1</sup>=)

• doGridding now uses AOT parameters in the meta data (such as beam size, map size, and - for observations after OD 835 - readout and line separations) to create cubes that reflect how the observation was carried out.

Note that for the needed meta data to be present, the observation must be pipelined with HIPE 8 after the level 0 pipeline step doUplink has been run on the HTP.

Maps older than OD 835 will not have the readout and line spacings in the the meta data (this will happen with HIPE 9) instead doGridding calculates an approximate pixel size based on other meta data.

• • a box filter is automatically used for greater than Nyquist sampled DBS Raster maps

• Updates to the examples in the HIFI Pipeline Specification Document.

• Substantial refactoring of CheckFrequencyGrid to correct assumptions made about the sequence of on-, off- and hc-datasets. This primarily affected HEB band data and resulted in unnecessary Quality Flags being raised. This correction produces a noticeable improvement in the noise and baseline quality of all observations performed in bands 6 and 7.

• doGridding now uses AOT parameters in the meta data (such as beam size, map size, and - for observations after OD 835) to create cubes that reflect how the observation was carried out. In the past gridding was done based only on a linear approximation of the beam size and for half beam or Nyquist spacing.

Other changes include:

• • the GUI now modifies filter parameters in connection with changes to pixel size entered in the GUI
  • introduction of a flyAngle parameter to allow the easy creation of rotated maps

• Numeric values in metadata, array datasets or table datasets can be displayed in decimal or hexadecimal format, and dates can be shown in either UTC or TAI. These options are available in the table's contextual menu.

What's new in HIPE 8

• The HIPE menu Pipeline --> PACS has been reorganised and new interactive pipe scripts added.
• Automatic pipeline scripts save the products at the end in the Observation Context. That mean the scripts can be executed in a sequence without interaction.

• PACS Data Reduction Guide. Chapter 1 is now a collection of Launch Pads: on getting Data into HIPE, doing your PACS Spectroscopy and doing your PACS Photometry. These are quick-start guides to work with your PACS observations. Chapter 2 tells you how to load your data, your pipeline script, and your calibration tree into HIPE, for photometry and spectroscopy. An appendix describes the PACS products in detail and some PACS product viewers.
• Spectroscopy: the pipeline chapters have been re-organised to follow the new pipeline scripts.
• Photometry: the pipeline chapters have been re-organised to follow the new pipeline scripts.

Deprecations

As of HCSS 9 we will remove those deprecated functions:

• • The "point-source" calibration in SCalSpecBeamParam has been updated, Bright Source mode factors added and units updated to GHz. The internal structure of the product has been updated to allow the point-source conversion factors for other off-axis detectors to be added in future, and the "beam area" column has been removed (as this was misleading, and the beam area is better calculated from the diameter, assuming a Gaussian shape).

• The Flag applyExtendedEmissionGains needs to be set to True.

• The Flag includeTurnaround needs to be set to True.

• inverseFourierTransform has been created to transform SDS objects into SDI objects by applying the inverse Fourier transform:

• inverseFourierTransform is not the inverse of the fourierTransform task because it does not remove zeropadding from the output interferograms. The already existing makeSameOpds can be used to remove zero-padding.

• Naive projection (cf. SPIRE photometer).
• Nearest neighbour projection.
• Gridding projection (cf. HIFI OTF gridding).

• Both Tod and TodBuffer are acceptable input for the tod parameter.
• The input parameter array now is MANDATORY.
• Pixel size can be changed through setting pixelSize parameter.
• The brightSource parameter is changed to boolean.
• The boolean fitWithWeight parameter was introduced.
• Interruption is added so that the destriper can be terminated at your request.
• Tod files stored in temporary directory are available until HIPE is terminated.
• The destriper speed increased by 30%.
• The input parameter name Level1 was changed to level1.
• The input parameter name Tod was changed to tod.
• The input parameter name L2DeglitchRepeat was changed to l2DeglitchRepeat.

• New roi (region of interest) parameter for baselineRemoval* tasks, specifying the region of the sky to be used in estimating the baseline.
• Removed doInterpolation task parameter.
• Minor changes and bug fixes (for example, the tasks now do ignore masked data samples when a TodBuffer is used internally).

• Takes a SSO observation and corrects the map to be in the moving object frame.
• For example, target is no longer a streak on a stable background.

• Takes a reference SPIRE map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former.
• Takes a reference SPIRE map and a list of SPIRE maps to be corrected and aligns the astrometry of the latter to the former.
• Takes a reference ancillary map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former .
• Takes a reference source list (as a SourceListProduct) and a SPIRE map to be corrected and aligns the astrometry of the latter to the former.
• In all cases both the Level 2 map astrometry and Level 1 timelines are corrected.

• • using the daily dark observation.
  • using off-axis detectors.

• Allows simultaneous fitting of lines and continuum in the central detectors using the HIPE SpectrumFitter.
• CO lines are fitted with a polynomial baseline and results are printed for each line, including the error estimate for the line flux.

• Added ability to plot errors as a shaded region on the spectrum.

• New SPIRE Launch Pads to give you an overview of the SPIRE processing, what's available, and quick link jumps into the documentation.

• SPIRE Data Reduction Guide restructured to be "recipe" orientated.
• Includes description of new scripts accessed from the Scripts menu in HIPE.
• SPIRE Data Reduction Guide includes the manual for mapmaking with the SPIRE Photometer Interactive Analysis (SPIA) plug-in.

• • The spectral limits used for phase correction (used for the polynomial fit method) in SCalSpecPhaseCorrLim have been converted to GHz.

• InverseFourierTransformTask is not the inverse of the FourierTransformTask because it does not remove zeropadding from the output interferograms. The already existing makeSameOpds can be used to remove zero-padding.

• Naive projection (cf. SPIRE photometer)

• Gridding projection (cf. HIFI OTF gridding)

• CO lines are fitted with a polynomial baseline and results are printed for each line, including the error estimate for the line flux

• Added contextual menu entry Show contents to show the contents of a variable in the console.
• Added contextual menu entry Send To --> Text File to save the contents of table datasets to files.

• Products can be saved directly from the tree with the Send To entry of the popup menu, without creating an intermediate variable.

• Scripts and text files coming with the installation or with plug-ins are now safe to edit without losing the original version.

• If you get temporary (or permanent) freezes in the HIPE GUI, or you have created a custom task dialogue or view in HIPE, you can debug it by enabling the corresponding preference in Edit --> Preferences --> General --> Debug. Any problem found with this debugging can be reported like previously, with the HSC Helpdesk or Give Feedback options of the Help menu.

• Planck class moved from spire_ia_pipeline_spec_util to ia_toolbox_astro. If you are doing an explicit import (it is not needed) you have to change it to (preferred) import herschel.ia.toolbox.astro.Planck or from herschel.ia.toolbox.astro import Planck
• New task astrometryFix: adjusts the absolute pointing of map data to give the best possible agreement in overall astrometry with some ancillary data. This is done either by cross correlation of the map(s) with ancillary map data, or by stacking the map(s) at a list of known source positions (e.g., from radio observations).

• Continuous Wavelet Transform synthesis operation now adds low frequencies for a reliable reconstruction.
• Continuous Wavelet Transform is now able to deal with Complex1d signal.

• Improvements to handling of pixel coordinates and region of interest in sourceExtractor tasks:
  • Output source list now contains pixel coordinates of source (x, y) = (column, row).
  • Added getWcs and setWcs methods to the SourceListProduct/Dataset.
  • Added roi parameter (region of interest) to tasks.
  • Removed corner* and returnPixelCoordinates parameters from tasks.
• Non-standard columns are now accepted in a SourceListDataset, e.g., when converting from a TableDataset (an exception will be thrown if there are no standard columns at all).
• Removed subtractMedianBackground parameter from sourceExtractorSussextractor (it did not do anything).
• Minor bug fixes and performance improvements.

• The methods addCircle, addEllipse and addRectangle ae no longer dependent on the zoom factor of the image.

• The SpectrumFitter now recognizes a CUBE such that you can give the x,y position of the spectrum. The script as written by the SpectrumFitterGUI also takes the correct spectrum.

• The avg task now warns if wavescales are not sufficiently aligned to get a good result.

• Various changes when applying toolbox tasks to cubes, in particular avg, select and extract now allow you to work on several pixels/spaxels within the cube rather than only the entire cube.

• The resampling task now allows alternative ways to specify the grid for resampling.

• HIPE can now store username and password in encrypted form outside of property files. It is recommended to remove HSA username and password from all property files.

• Removed the legacy diff methods from Product and Dataset interfaces. All functionality moved to the ProductDiff class in the utility toolbox (herschel.ia.toolbox.util)

• A Cache entry has been added to the HIPE Preferences, with an overview of all existing caches on the system. You can clear these caches from this panel.
• Product Browser: A simplified Observations tab has been added, that allows you to list all observations on local disk, just by pressing the Run button. The data source selector has also been redesigned to be more flexible and intuitive.

• Added some new user-friendly parameter editors (see For Task developers only below)

• • Parameter name tooltips now show the parameter name (for long names).
  • Big modifiers can occupy a full row.
  • You can move through groups (tabs) with the mouse wheel.
  • Parameters can be reset individually via contextual menu on parameter names (in addition to resetting all parameters with the Clear button)
  • Parameters can list the variables they accept via contextual menu on parameter names, so you can check if you have the proper data to use in a parameter.

• • Task registration will issue warnings if the task was already registered or the taskname was already used.

Miscellaneous tasks

• OpenTask parameter names have changed capitalisation to comply with naming conventions.

• Improved entries in the User's Reference Manual.

• Task simpleAsciiTableReader extended to support all options of asciiTableReader via the Advanced tab.

• Improved documentation and information provided by getObservation.
• saveObservation now reports the progress in the status bar and can be interrupted.
• Added contextual menu option to the Variables view to save tables with asciiTableWriter. Also added a validator to the task that will restrict its applicability to table datasets that can be fit into an ASCII table.

• • Spur table (7b).
  • FPU HK Thresholds (5a) (Prevents unnecessary Quality Flags).
  • Units added to columns (Prevents unnecessary Quality Flags).
  • Wbs Bad Pixel (saturated regions) (Causes necessary Quality Flags).
  • QC flags for bad LOU currents (Causes necessary Quality Flags).
  • Uplink auxiliary product parameter filtering (First steps in ensuring information about the way the observation was carried out is put in the metadata).

• Can now select calibration version to reprocess data with (command line only).

• By default the pipeline now runs without saving products. Previously it always wrote output to .hcss/lstore/pipeline-out, which in theory allowed you to access processed observations from that location. This was rarely used and could cause disk space problems.

• Improvements to tooltips in the Pipeline GUI.

• DoUplink now uses the new uplink auxiliary product to set some observation parameters in the metadata, such as mapReadoutSep and mapLineStep.

• New (optional) pipeline step allowing smooth band pass to eliminate standing waves: doFilterLoads. This is an alternative calibration scheme for strong continuum sources.

• Substantial refactoring of CheckFrequencyGrid to correct assumptions made about the sequence of on-, off- and hc-datasets. This primarily affected HEB band data and resulted in unnecessary Quality Flags being raised.

• Sideband gains coefficients added to metadata.

• Introduced the flagTool task, which allows you go through every subband of a spectrum dataset and interactively flag spurs, lines, bright lines, and data to ignore. Input data can be an Observation context, a HifiTimelineProduct, or a SpectrumDataset.

• PolarPair is now a task and can be applied to spectrum datasets.

• Introduced avermask option in FitHifiFringe. It allows a line mask to be calculated using the average of all scans. Makes fringe removal from maps much more efficient.

• Variable result_sds should no longer be created if FitHifiFringe is run from the GUI with obs_or_htp input.

• FitBaseline divide option now handles negative signals robustly.

• Some output from doDeconvolution is now written to the console as it runs - helpful to know HIPE has not frozen!

• doDeconvolution now picks up the applied sideband gains from the meta data and "undoes" their effect on the incoming DSB data. Then you can apply gains on or gains off. The pipeline supplied gains can in this way offer an optional starting point for the gain iteration inside the deconvolution.

• SSB spectrum now has y-axis labels Antenna Temperature (K), x-axis label changed to Frequency (GHz).

• When diagnostic mode is turned on, doDeconvolution now produces an interim product in addition to the pop-up plots.

• The min chi squared and the number of iterations are now included in the meta data of the SSB solution.

• Bug fix: In doDeconvolution an algorithmic error in binning the input data has been corrected. The fix has stopped the occurrence of two problems: Some band-edge channels had fluxes set to zero and some very narrow lines had their peaks shifted by as much 1/2 MHz.

• BeamSize is now taken from the calibration tree if hpbw is in the metadata.
  • If hpbw is not in the metadata, the beam size is calculated in the same way as in convertK2Jy using the rfreq in the metadata.

• • Picks up information from metadata to provide better default input parameters.

• The HIFI User's Manual changed name to HIFI Data Reduction Guide, chapters rearranged into more logical order, addition of a changelog.
  • Addition of introductory chapter, HIFI Launch Pad.
  • Addition of a DBS Point Mode cookbook.
  • Addition of chapter, How to flag and remove flags from your data.
  • Addition of chapter, Unit Conversion.
  • Updates to chapters on Pipeline, Deconvolution, Creating Spectral Cubes, What was done to my data (clarifying units at each stage of the pipeline).
• Updates the examples in the HIFI Pipeline Specification Document.
• HIFI User Reference Manual (URM) improvements.
  • All HIFI tasks in URM now have a category and show up in the categorised view of commands.
  • The categorised view of commands now is grouped into headers that should be meaningful to astronomers.
  • Many URM entries have been improved so that descriptions are clear and examples are useful.

• The less memory intensive task mapDeglitch is now used for deglitching instead of IIndLevelDeglitch
• The second level glitch mask is now stored in level 1.
• The new task filterOnScanSpeed now used to select frames at constant speed instead of the BBID selection.
• The new task photMaskCrosstalk, masking the column 0 of all matrices, is now used in the pipeline too. This is a bit of brute force to avoid negative or positive cross-talk artifact in the level 2 maps, at the expense of getting rid of 1/16th of the data.

• Interactive reduction scripts for all observing modes are now available.
• Flatfielding is available in the interactive pipeline scripts.
• Error propagation (and error bars) is implemented in the PACS rebinned cubes (STDDEV dataset).
• SPG pipeline: the wavelength switching pipeline is merged with the unchopped pipeline and removed.
• Improved documentation and user friendliness of the pipeline tasks within HIPE.
• The spectrometer level-2 tasks now produce the specialized sliced products SlicedPacsCube and SlicedPacsRebinnedCube, which offer the same functionality as the SlicedFrames product.

• The calibration sets that are installed on your local system can now be inspected with a 'Calibration Sets Viewer'. The viewer is located in Window --> Show View --> Workbench --> Calibration Sets. Select a version from the available buttons, then you can inspect the release note for that version or the product list with the versions of the individual calibration products.

• A new calibration file is available for non linearity correction required by the task photNonLinearityCorrection.

• Major improvements of the flux calibration:
  • Implementation of the background normalization method for chop/nod observations.
  • It is now based on observations of astronomical standards and the calibration block attached to each observation. The pipeline task specDiffCs computes the detector response of the current observation.
  • Implementation of a correction of transients for unchopped observations.

• The spectral (pixel) dependency of the spatial calibration is now available for each pixel.

• The Preferences windo now contain a Logging panel under the general tab which allows you to increase or decrease the number of logging messages sent to the terminal.

• MapMonitor got an improved interface and allows to flip north up-or downwards.
• The PhotProject task got a companion task miProject (MapIndex-Project). If you have a full MapIndex, you may use miProject instead of photProject. It needs frames and the MapIndex as parameters and speeds up projection time by a factor of at least 20. Use as follows: map = miProject(frames, mapindex)
• A new task has been developed. It deglitches without MapIndex and runs with significantly less memory abuse than the IIndLevelDeglitch task. The name and package is herschel.pacs.spg.phot.deglitching.map.MapDeglitchTask. The HIPE alias is mapDeglitch. It is documented as javadoc, URM and on the online deglitching documentation page.
• A new task has been implemented which removes crosstalk effects by masking (CrossTalkMask) the first rows of detector arrays: frames = photMaskCrosstalk(frames)
• The HIPE menu Pipeline --> PACS has been reorganised and ipipe scripts added.
  
• Automatic pipeline scripts save the products at the end in the Observation Context also in IA sessions. That mean the scripts can be executed in a sequence without interaction.
  
• Pacs products (for example Frames, Ramps, PacsCube) got a method to rename a Mask: renameMask(String oldname, String newname). Up to now, a mask had to be removed and recreated, if the name had to be changed.
• photProject, miProject, IIndLevelDeglitching and some other tasks now report their progress in the HIPE progress bar instead of the terminal output.
  
• The effects of 2-bit rounding on second level deglitching have been reduced in the pipeline for blue parallel maps.
  
• The Pacs MaskViewer has been relocated to a new package: herschel.pacs.gui.maskviewer.MaskViewer. If you manually imported the old location (from herschel.pacs.signal import MaskViewer), the import will fail. Please remove the import, since everything should work automatically. If nevertheless there is a problem, please import the new location: from herschel.pacs.gui.maskviewer import MaskViewer
• A new task maskFromCatalogue is available, very convenient to mask a list of point sources for high-pass filtering in deep fields.

• There is a new GUI for viewing the footprint of the spectrometer upon an image with WCS: the tool pacsSpectralFootprint. It can be accessed through the Applicable tasks list in the Tasks view.

• Implementation of user friendly viewer for the PACS specific part of the ObservationContext:
  • Each spectrometer slice now shows after the slice number a short description of its contents.

• A new level 2.5 product is available combining photProject scan and cross-scan maps.

• Browse products and browse image products are now available in SPG.

• PACS Data Reduction Guide. Chapter 1 is now a collection of Launch Pads: on getting Data into HIPE, doing your PACS Spectroscopy and doing your PACS Photometry. These are quick-start guides to work with your PACS observations. Chapter 2 tells you how to load your data, your pipeline script, and your calibration tree into HIPE, for photometry and spectroscopy.
• Spectroscopy: the pipeline chapters are being re-organised to follow the new pipeline scripts, and so for this 8.0 version of the PDRG only the LineScan Chop-Nod pipeline is described.
• Photometry: the pipeline chapters are being re-organised to follow the new pipeline scripts, and so for this 8.0 version of the PDRG only the ScanMap pipeline scripts are described.

History

A new task historyExtract is available to facilitate retrieving the value of a certain parameter from the product history. E.g. one can use the following command line to find out which calibration file was used in a given task of the PACS spectrometer pipeline:

value = historyExtract(product=frames, task='convertSignal2StandardCap', parameter='effectiveCapacitance')

The GUI of this task guides you through the available tasks and parameters: The option lists of the 'task' and 'parameter' parameters only show what is available in the history of the specified product:

• The spectrometer level-2 tasks now produce the specialized sliced products SlicedPacsCube and SlicedPacsRebinnedCube, which offer the same functionality as the SlicedFrames product.

• There is a new GUI for viewing the footprint of the spectrometer upon an image with WCS: the tool pacsSpectralFootprint. It can be accessed through the applicable tasks list in the Tasks View.
• The Spectrum Explorer GUI has a new panel for editing PACS masks.

• Photometer:
  • SCalPhotChanRelGain is a new product to improve extended emission calibration.
  • The SCalPhotChanNoise product has been updated to improve the flux calibration for MadMap (this is only used for MadMap).
• Spectrometer:
  • The "extended" calibration in SCalSpecTeleRsrf is now derived from a mean of many observations, reducing the noise level in the RSRF. In addition, RSRFs have been added for the Bright Source mode, and the units have been updated to be in GHz.
  • The "point-source" calibration in _SCalSpecBeamParam! has been updated, Bright Source mode factors added and units updated to GHz. The internal structure of the product has been updated to allow the point-source conversion factors for other off-axis detectors to be added in future, and the "beam area" column has been removed (as this was misleading, and the beam area is better calculated from the diameter, assuming a Gaussian shape).
  • The Instrument RSRF in SCalSpecInstRsrf has been updated, Bright Source mode RSRFs added and units updated to GHz
  • The OPD limits in SCalSpecOpdLimits have been changed such that the interferograms for calibration observations (resolution CR) are cut to have the same limits as high resolution science observations (HR).
  • The spectral band edges in SCalSpecBandEdges have been made slightly narrower to avoid spikes at the edges. They have also been converted to GHz.
  • The spectral limits used for phase correction (used for the polynomial fit method) in !SCalSpecPhaseCorrLim have been converted to GHz.
  • Three new calibration products have been added to allow processing of Bright Source mode data:
    • SCalSpecNomPcal contains the weighted mean and standard deviation PCAL level separation for dark sky in Nominal Mode - this is used to compare with the PCAL level separation in Bright Source mode in order to calculate a bright mode gain factor for each detector.
    • SCalSpecBrightGain contains a frequency dependent correction to the PCAL gain factor (the gradient and intercept of a straight line). It is applied in the spectral domain to correct the spectral shape of Bright Mode observations.
    • SCalSpecBolPhase contains the optimum bolometer phases for each detector. These are used in the engineering conversion to correct the voltages for Bright Source mode, where the bolometers are dephased to reduce their responsivity.

Spectral Unit and Unit-Flexibility

Averaging Spectra

Spectrum Flux Calibration

• The Bright Mode Gain module computes and then applies a frequency-dependent gain factor.

Improved pre-processed cube product

Useful Scripts

Photometer Destriper

Photometer Baseline Removal

Photometer Moving Object Correction Script

Photometer SPIRE Astrometry Alignment

Spectrometer Array Footprint Plot

• Plots the locations of the detectors on top of an image of the source.

Spectrometer Background Subtraction

• Provides two methods to subtract residual background from the final spectrum:
  • using the daily dark observation
  • using off-axis detectors

Spectrometer Line Fitting

• Allows simultaneous fitting of lines and continuum in the central detectors using the HIPE SpectrumFitter
• CO lines are fitted with a polynomial baseline and results are printed for each line

Spectrometer Thumbnail Mosaic Plot

• Gives several examples of plotting the spectra from each detector as a thumbnail arranged as the detectors appear in the array.

SDI/SDS Explorer

• Ability to plot errors as a shaded region on the spectrum added
• Right click options added for each detector in the array footprint, including Open With, Send To and Create Variable.
• Zooming is now permitted in the thumbnail view.

• New SPIRE Launch Pads to give Users an overview of the SPIRE processing, whats available, and quick link jumps into the documentation.

• Includes description of new Useful Scripts accessed from the Scripts menu in HIPE

• avermask option in FitHifiFringe introduced.
  • Allows a line mask to be calculated using the average of all scans. Makes fringe removal from maps much more efficient.

• Variable result_sds should no longer created if FitHifiFringe is run from the GUI with obs_or_htp input

• FitBaseline now operates by default in interactive mode.

• The back-end(s) to be processed can now be selected by clicking in a list.

• SPIRE Data Reduction Guide includes the manual for mapmaking with the SPIRE Photometer Interactive Analysis (SPIA) plug-in