Difference: HipeWhatsNew12x (1 vs. 56)

Revision 562015-01-07 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 344 to 344
 

Spectrometer

Added:
>
>
spire_cal_12_2
 
  • Point source calibration for off-axis detectors corrected to account for the pointing of Uranus in the calibration measurements. Only affects the off-axis detectors. Centre detector point source calibration changes by less than 0.15%.
  • Unused Spatial Correction Coefficient product removed (was designed for use with the semi-extended correction tool, but never actually used).
Added:
>
>
spire_cal_12_3
  • The spectrometer bands are increased slightly in the overlap region and at the high frequency end of SSW:
    • Old bands: SLW: 446.7-989.4 GHz; SSW: 959.3-1544.0 GHz
    • New bands: SLW: 446.7-1018.0 GHz; SSW: 944.0-1568.0 GHz
  • The extended calibration is not changed from spire_cal_12_2 (apart from wider bands).
  • The Low resolution point-source calibration is changed by <5% (before OD1000) and <2.7% (after OD1000) to bring it into line with the High resolution calibration. This was achieved by correcting for the pointing offset of Uranus during the calibration observations. The effect is to reduce the flux density of the final spectra. Changes are greatest for SSWD4 at high frequency, and smallest for SLWC3 (~1% for SLW).
  • The High resolution point-source calibration has also been adjusted using improved corrections for the pointing offset of Uranus in the calibration observations. The effect for SSWD4 is ~2.5% before OD1000, and 0.8% after OD 1000. For SLWC3, the effect is <0.8% before OD1000 and <0.1% after OD1000. The effect is to increase the flux density in the final spectra.
  • A small correction has been made to the point-source calibration for off-axis detectors for observations made before OD1000.
  • The frequency grid for the beam profile shape been updated to match exactly that used in Makiwa et al. (2013, Applied Optics, 42, 3864) - this gives slightly better coverage at the edges of the new bands. The shapes themselves do not change.
 

Calibration Framework

  • New SPIRE Calibration Automatic Updater introduced: it runs during HIPE startup and notifies the user if a new calibration tree is available. The tool allows also the installation of the new calibration tree.

Revision 552014-12-01 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 49 to 49
  To execute scripts in batch mode, run hipe with file path arguments.
Changed:
<
<
note: the script file shall have .PY extension
>
>
Warning, important Note: the script file shall have .py extension
 

Status bar

Revision 542014-06-27 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 285 to 286
 

Photometry

  • A correction is applied on level 1 frames to correct for influences of the evaporator temperature.
Deleted:
<
<
 
  • A correction is applied on level 1 frames of the chopped photometry data to correct for differences in the responsivity as compared to scan maps.
Changed:
<
<
  • JScanam maps will be available in level 2.5

>
>
  • JScanam maps will be available in level 2.5 and 3.
 
  • MADmap maps will be corrected for the flux scale due to the fact that optical distortion was not applied so far.
Changed:
<
<
>
>
  • All maps now have now the same pixel size in the SPG, so that they can be compared more easily.
 

Calibration

Line: 309 to 306
 

Product changes

  • Improved the browse product structure (numbers changed to meaningful names).
Added:
>
>
  • Browse images have been improved significantly (postcards in the HSA).
 
  • Added a new observation summary dataset to the browse products. The obsSummary task shows the contents of this dataset and it can be viewed also in the Observation Context Viewer. Note that in order to update this summary to reflect changes in the observation context you have to run this task with forceUpdate=True.
  • Improved the names of many FITS keywords, which makes the headers of PACS products easier to read outside HIPE.
  • Added new meta keyword sliceNumber to slices. This number also appears in the FITS filenames in the pools, which makes them more readable.
  • Fixed some problems with copying products.
Added:
>
>
  • The structure of the level 2.5/3 contexts in the photometer observation contexts have been improved. All the slots in these contexts have now consistent names for each type of map:
    • HPPJSMAP[R|B|G] for red, blue or green JScanamorphous maps.
    • HPPNAVMAP[R|B|G] for red, blue or green naive maps.
    • HPPCORMAP[R|B|G] for red, blue or green corrected maps.
    • HPPMADMAP[R|B|G] for red, blue or green MadMap maps.
    • HPPHPFMAP[R|B|G] for red, blue or green High Pass Filter maps.
  • Fixed duplication of FITS file names when observations are exported from the HSA into a tar file.
  • Made sure that the ra and dec in level 2 photometer maps correspond to the center of the map.

 

Spectroscopy

Revision 532014-05-15 - ScigeLiu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 49 to 49
  To execute scripts in batch mode, run hipe with file path arguments.
Added:
>
>
note: the script file shall have .PY extension
 

Status bar

Any code can echo messages in the status bar. For example, from a Jython task:

Revision 522014-03-18 - ElenaPuga

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 277 to 277
 
  • The extractCentralSpectrum task has been improved to return both the central and central 3x3 spectra, and to handle the masks better. Also the syntax has been changed, since it returns now a list of spectra (central, SUM(central_3x3) and a scaled version of the central spaxel computed so that its continuum matches that of the Sum(central_3x3)). See the URM and section 7.6 of the PACS Spectrometer Data Reduction Guide for details.
  • Improved the long-term transient correction for the unchopped line spectroscopy pipeline.
  • One of the spectrometer's interactive reduction pipeline scripts is now offered in a simplified version (ChopNodLineScan.py). The processing itself is not affected, but the number of helper-plots ("verbose plots") has been reduced and the comments have been abridged. Saving intermediate or final results is also made easier (without necessarily editing the script). In absence of negative feedback, the same approach will be followed for all other scripts from hipe 13.0 on.
Added:
>
>
  • plotCubesStddev: a new parameter wranges allows the user to select the continuum windows of his/her choice.
 

SPG Pipeline

Photometry

Revision 512014-03-18 - PierreRoyer

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 276 to 276
 
  • We provide a new task (specExtendedToPointCorrection) for computing the correction factor for slightly extended sources relative to the point source correction, based on a model of the source flux distribution. This tool is described extensively in section 7.8 of the PACS Spectrometer Data Reduction Guide.
  • The extractCentralSpectrum task has been improved to return both the central and central 3x3 spectra, and to handle the masks better. Also the syntax has been changed, since it returns now a list of spectra (central, SUM(central_3x3) and a scaled version of the central spaxel computed so that its continuum matches that of the Sum(central_3x3)). See the URM and section 7.6 of the PACS Spectrometer Data Reduction Guide for details.
  • Improved the long-term transient correction for the unchopped line spectroscopy pipeline.
Added:
>
>
  • One of the spectrometer's interactive reduction pipeline scripts is now offered in a simplified version (ChopNodLineScan.py). The processing itself is not affected, but the number of helper-plots ("verbose plots") has been reduced and the comments have been abridged. Saving intermediate or final results is also made easier (without necessarily editing the script). In absence of negative feedback, the same approach will be followed for all other scripts from hipe 13.0 on.
 

SPG Pipeline

Photometry

Revision 502014-03-18 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 273 to 273
  accurate pointing product is available for an observation.
    • specDeterminePreCalculatedPointing: it calculates the pointing offset using the ra/dec/rollAngle information of the Frames.
    • specDeterminePointingOffsetFromPreCalculatedPointing: it determines the flux correction factors by using the pointing offset determined by specDeterminePreCalculatedPointing.
Changed:
<
<
>
>
  • We provide a new task (specExtendedToPointCorrection) for computing the correction factor for slightly extended sources relative to the point source correction, based on a model of the source flux distribution. This tool is described extensively in section 7.8 of the PACS Spectrometer Data Reduction Guide.
  • The extractCentralSpectrum task has been improved to return both the central and central 3x3 spectra, and to handle the masks better. Also the syntax has been changed, since it returns now a list of spectra (central, SUM(central_3x3) and a scaled version of the central spaxel computed so that its continuum matches that of the Sum(central_3x3)). See the URM and section 7.6 of the PACS Spectrometer Data Reduction Guide for details.
  • Improved the long-term transient correction for the unchopped line spectroscopy pipeline.
 

SPG Pipeline

Photometry

Line: 316 to 318
 
    • inLeak: Can be 'yes', 'no' or 'partial', depending on whether a slice is fully, not or partially in the leak region.
    • repetition: the repetition number of a slice.
    • gratingStep: the grating step size within a slice.
Changed:
<
<
  • Added more flags to the rebinned cubes: We now propagate besides the saturation masks also all other inactive masks into the Flag dataset of the rebinned cubes.
>
>
  • Added more flags to the rebinned cubes produced by the specWaveRebin task: We now propagate besides the saturation masks also all other inactive masks into the Flag dataset of the rebinned cubes.
 

Documentation

Revision 492014-03-18 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 89 to 89
 
  • Minimized views are remembered as part of the persisted layout of perspectives.
  • HIPE now asks to restart upon changes that require a new session in order to be applied.
Deleted:
<
<

Plotting

TablePlotter

OverPlotter

 

Astronomical utilities

  • Sso: Added a variant that uses internal Horizons.
  • radialV and RadialV.getProjection(...) : if Ephem is null the system will use its own if needed.
Deleted:
<
<

Numeric routines

Data fitting

Data interpolation

Random numbers

Statistics

Trend analysis

Mapping

Other functions

Source extraction

 

Images

  • SimpleCube.copy() and SimpleImage.copy() create accurate copies now.
Line: 155 to 140
 
  • Fixed a bug in integrateSpectralMap when using a cube with regular wavelength grid (in WCS).
  • All cube tasks now propagate the description of the cubes, the instrument name and the units to the result.
Deleted:
<
<

Herschel Science Archive

Calibration sources

Products and datasets

Observation context

Product Access Layer

 

Tasks

  • Task GUIs: You can now drag and drop from the Navigator into 'file' arguments.
Deleted:
<
<

Quality control

Systematic product generation

 

Data input-output

  • Table reading:
Line: 201 to 172
 
  • help : Also provides access to Python help.
  • openTask : you can now open a task attaching variables to any parameters.
Deleted:
<
<

Virtual Observatory

 

Installer

  • The installer now bundles one specific version of the Java Runtime Environment (JRE) for Mac OS as it is already done with Linux and Windows. This will help isolate HIPE from the JRE installed at operating system level, but has the inevitable consequence of adding about 50 MB to the installer size.
Line: 211 to 180
 
  • The internal name for the Scripting Guide was renamed from um to sg. Now when searching the documentation the results within this manual appear below the sg name.

HIFI

Deleted:
<
<

HIFI Software Configuration and Properties

 

HIFI Calibration

  • Updates to CleanDF tables (Level 0). These tables allow the pipeline to omit corrupted data frames.
Line: 220 to 187
 
  • Calibration tables for Electrical Standing Wave task hebCorrection: WBS-Splines (6aH, 6aV, 6bH, 6bV, 7aH, 7aV, 7bH, 7bV)

HIFI Pipeline

Deleted:
<
<

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

 

Level 2.5 Pipeline

  • Level 2.5 pipeline can be run in parallel (command line only)
Line: 235 to 196
 
  • In the case of mapping observations, the level 2.5 products containing up until now only the cubes now also contain a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
  • Information available in metadata has been generally improved with the intention that they can (eventually) be used when querying the HSA
Deleted:
<
<

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

 

HIFI Data Processing Tools

Standing Wave Removal

  • fitHifiFringe
Line: 342 to 299
 

Spectroscopy

  • For point source pointing offset flux calibration a time dependent correction to the current telescope background model is implemented. The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground.
Deleted:
<
<

Analysis tools

Photometry

Spectroscopy

 

Product changes

Line: 355 to 308
 
  • Added new meta keyword sliceNumber to slices. This number also appears in the FITS filenames in the pools, which makes them more readable.
  • Fixed some problems with copying products.
Deleted:
<
<

Photometry

 

Spectroscopy

  • Improved the meta keywords which describe the slices. The following keywords were added:
Line: 388 to 339
 
  • New SPIRE Calibration View introduced: this is a new HIPE view callable from HIPE view menu. The view shows all the available SPIRE calibration trees with their release notes, and allows installation/removal of each tree. Different colours are used to distinguish default/installed/not installed trees.
  • New SPIRE Calibration Preferences panel added to the HIPE preferences: the preferences panel allows some configurations for the SPIRE Calibration View and the SPIRE Calibration Automatic Updater.
Deleted:
<
<

Preprocessing

Engineering Conversion

Common Pipeline

 

Photometer Pipeline

  • TemperatureDriftCorrectionTask now reacts to the "coolerBurpDetect" parameter defined in the timeline.

Revision 482014-03-17 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 135 to 135
 

Analysis

Added:
>
>
SpectrumFitterGUI
  • Update to export panel to make more intuitive to use
  • Generated scripts have been updated
  • A ParameterCube can now be exported
  • All implemented models now have their own GUI (previously an "abstract GUI" was used for all but the most common models)
  • Can set lower and upper bounds limits in model GUIs
 

Spectral Cubes

Display

Line: 207 to 214
 

HIFI Software Configuration and Properties

HIFI Calibration

Added:
>
>
 
  • Updates to CleanDF tables (Level 0). These tables allow the pipeline to omit corrupted data frames.
Changed:
<
<
  • Nonsense LO settings in spectral scan (Level 0)
>
>
  • Nonsense LO settings in found spectral scan data are corrected at Level 0 using a calibration table storing the correct values. This impacts only one observation: 342194735 (PSP2_HEXOS-oribar-hifiss-b6a-main)
 
  • Calibration tables for Electrical Standing Wave task hebCorrection: WBS-Splines (6aH, 6aV, 6bH, 6bV, 7aH, 7aV, 7bH, 7bV)

HIFI Pipeline

Line: 220 to 228
 

Level 2 Pipeline

Level 2.5 Pipeline

Changed:
<
<
In the case of mapping observations, the level 2.5 products containing up until now only the cubes now also contain a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
>
>
  • Level 2.5 pipeline can be run in parallel (command line only)
  • More tasks, for example doDeconvolution and PolarPair, are better integrated into the pipeline.
 

HIFI Products

Added:
>
>
  • In the case of mapping observations, the level 2.5 products containing up until now only the cubes now also contain a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
  • Information available in metadata has been generally improved with the intention that they can (eventually) be used when querying the HSA
 

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Line: 251 to 262
 

Deconvolution

Added:
>
>
  • Channel weights are now calculated for the SSB output (calculated as 1/rms^2)
  • Minor bug fixes
  • Major bug in gain fitting discovered. Feature should not be used.
 

Spectral Cube creation

  • DoGridding uses a new command line syntax. This is a result of the general change in behaviour of Tasks with multiple outputs.
Added:
>
>
  • A new task MergeHtpsTask is available in order to merge (not average) HTPs of H and V polarisation. This allows spectral cubes to be created using all of the pointing information in the observation
  • DoGridding is adapted to use a 2d model
 

flagTool

  • New GUI figure to reflect the addition of an input parameter for htp

Revision 472014-03-17 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 17 to 17
  HIPE
Deleted:
<
<
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks (due to the changes in how output parameters are handled, see below).
 
Added:
>
>
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks (due to the changes in how output parameters are handled, see below).
 
    • Tasks with multiple outputs now return a list (__list__ argument deprecated) to save memory.
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it.
Changed:
<
<
    • An automatic tool in HIPE will detect scripts with multiple outputs tasks: In case you open such a script then a dialog box pops up showing which lines need to be changed and asking your permission to convert it. See Task parameters if this fix did not work.
>
>
    • An automatic tool in HIPE will detect scripts with multiple outputs tasks: In case you open such a script then a dialog box pops up showing which lines need to be changed and asking your permission to convert it. Its current limitations are described in the Known Issues for HIPE 12 page. See Task parameters if your script contains any of the syntax features that are not currently implemented or if after running the conversion there are still errors that could be related to output parameters.
 
  • Improved contents and documentation in the headers of FITS files generated with HCSS or HIPE.

HIFI

Line: 80 to 80
 
  • The reduced browse image at the top-right corner of the Observation viewer has much better quality, so details can be distinguished even without having to enlarge it. The same applies for observations shown in the Outline.
  • Map and List viewers have been improved. It is possible to open their elements in separate viewers, or to create variables for them.
Changed:
<
<
  • If the Data section of the Observation, Product and Dataset viewers is collapsed (by clicking on its header), the available space is given to the Meta Data section.
>
>
  • If the Data section of the Observation, Product or Dataset viewers is collapsed (by clicking on its header), the available space is given to the Meta Data section.
 
  • A preference to restart Jython scripts when finished has been added. It is disabled by default, but can be enabled in the Editors & Viewers > Text Editor > Jython Editor preference panel.
  • When autosave of text editors is on, a backup file is generated only when the original file is modified.
Line: 109 to 109
 

Source extraction

Images

Changed:
<
<
>
>
  • SimpleCube.copy() and SimpleImage.copy() create accurate copies now.
 
  • WCS 3rd axis does follow FITS convention for reference pixel now.
  • The WCS metadata is copied to all planes from images (spectra).

Display

  • Display ignore flags when the description is prefixed with 'INFO:'.
  • Colour table drawn in the axes is corrected.
Changed:
<
<
  • Display does also work when image contains a TableDataset.
>
>
  • Display does also work when image contains a TableDataset.
 
  • Zoom does work also on RGB images.

Analysis

Changed:
<
<
>
>
  • SkyAperturePhotometry tasks can now be opened and filled from the command line. An example :
 
openTask("annularSkyAperturePhotometry",inputName="image,radiusArcsec,centerX,centerY,innerArcsec,outerArcsec",variableName="myImage,myRadiusArcsec,xCenter,yCenter,innerRadius,outerRadius")
Changed:
<
<
  • ImageCeil, imageFloor and imageRound tasks allow the user to decide which decimal is to be rounded.
  • ImageDivide also works with images without a unit.
  • The output of the MosaicTask now has the metadata of the first image of the mosaic.
  • Fixes in the gui of SkyAperturePhotometry tasks.
>
>
  • ImageCeil, imageFloor and imageRound tasks allow the user to decide which decimal is to be rounded.
  • ImageDivide also works with images without a unit.
  • The output of the MosaicTask now has the metadata of the first image of the mosaic.
  • Fixes in the GUI of SkyAperturePhotometry tasks.
 

Spectra

Display

Line: 190 to 190
 
  • Export View : simplified GUI.
  • getObservation:
    • improved GUI.
Changed:
<
<
    • If an observation is not found locally (and the main MyHSA is connected to the archive) the Archive will be tried.
>
>
    • If an observation is not found locally (and the main MyHSA is connected to the archive) the Archive will be tried.
 
  • help : Also provides access to Python help.
  • openTask : you can now open a task attaching variables to any parameters.
Line: 220 to 220
 

Level 2 Pipeline

Level 2.5 Pipeline

Changed:
<
<
In the case of mapping observations, the level 2.5 products containing so far the cubes now also contains a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
>
>
In the case of mapping observations, the level 2.5 products containing up until now only the cubes now also contain a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
 

HIFI Products

Line: 230 to 230
 

HIFI Data Processing Tools

Standing Wave Removal

Changed:
<
<
  • FitHifiFringe
>
>
  • fitHifiFringe
 
    • Input parameter data replaces the multiple inputs such as "obs_or_htp", "simple_spectrum", "sds", and "cube".
    • For the last (or single) spectrum, the move to next option has been removed from the pop-up dialogue window. The task exits more elegantly and leaves the two plot windows open (for the default plot=2 option).

Baseline Removal

Changed:
<
<
  • FitBaseline
>
>
  • fitBaseline
 
    • Input parameter data replaces the multiple inputs such as "obs", "htp", "sds", and "simpleSpectrum".
    • now works from within SpectrumExplorer to create and manipulate line mask windows and to allow plot scaling with the right mouse button.
Changed:
<
<
    • works on a simpleSpectrum
>
>
    • works on a simpleSpectrum .
 
    • skips a spectrum if "empty".
  • Bug Fixes:
    • The backends option now works correctly - only the ones selected are processed. This is true for obs, htp, and sds.
    • If data cannot be fitted fitBaseline will move onto the next dataframe. Previously it hung.

Electrical Standing Wave correction in HEB bands

Changed:
<
<
  • hebCorrection
>
>
  • hebCorrection
 
    • A new task is now available to help correct the Electronic Standing Waves in bands 6 and 7. See instructions for use in the HIFI Data Reduction Guide
Line: 271 to 271
 
    • Update to chapter 10: "Standing Wave Removal, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
    • Update to chapter 10: "Standing Wave Removal, specifically to the section "Electrical Standing Wave correction in HEB bands".
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
Changed:
<
<
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
>
>
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
 
    • Updates to chapter 12: Sideband Deconvolution.
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size". Introducing new syntax (for tasks with multiple results) to create cubes.
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI. Improved method to export results of deconvolution to Class.
Line: 287 to 287
 
  • A new task was introduced convertToFixedPixelSize() that performs the optical distortion correction. It is now applied in MADmap ipipe and will be used in the SPG12 processing, correcting for a 6% flux scale overestimate in the red channel and 2% underestimate in the blue channel.
Changed:
<
<
  • JScanam: We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.
>
>
  • JScanam: We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous HIPE 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.
 
  • A new task photTevCorrection() is available and used for SPG, see section on calibration.

  • There is a new task for chopped observations photCalPsToScan() that accounts for the difference in responsivity as compared to the scan map flux calibration scheme. When applying this task, the photometry of pint sources observed with the chopped photometry mode are in line with the results from scan map observations. For details of the method see the publication in Experimental Astronomy.

Spectroscopy

Changed:
<
<
  • the pointing offset correction ipipe scripts for line (ChopNodPointingCorrectionLineScan.py) and range scans (ChopNodPointingCorrection.py) of point sources are made available in the hipe pipeline menu inclusive detailed documentation on the pointing offset correction algorithms
  • for the point source pointing offset correction pipeline 2 new tasks were developed to determine the pointing offset correction in case the
>
>
  • The pointing offset correction ipipe scripts for line (ChopNodPointingCorrectionLineScan.py) and range scans (ChopNodPointingCorrection.py) of point sources are made available in the hipe pipeline menu inclusive detailed documentation on the pointing offset correction algorithms.
  • For the point source pointing offset correction pipeline 2 new tasks were developed to determine the pointing offset correction in case the
  accurate pointing product is available for an observation.
Changed:
<
<
    • specDeterminePreCalculatedPointing: it calculates the pointing offset using the ra/dec/rollAngle information of the Frames.
    • specDeterminePointingOffsetFromPreCalculatedPointing: it determines the flux correction factors by using the pointing offset determined by specDeterminePreCalculatedPointing
>
>
    • specDeterminePreCalculatedPointing: it calculates the pointing offset using the ra/dec/rollAngle information of the Frames.
    • specDeterminePointingOffsetFromPreCalculatedPointing: it determines the flux correction factors by using the pointing offset determined by specDeterminePreCalculatedPointing.
 

SPG Pipeline

Line: 318 to 318
 

Photometry

Changed:
<
<
  • A new task photTevCorrection() and related calibration file is available to correct for the dependence of the responsitivity to the evaporate temperature. The correction is typically below 1%. Only 1.2% of the observation will have a larger correction.
>
>
  • A new task photTevCorrection() and related calibration file is available to correct for the dependence of the responsitivity to the evaporate temperature. The correction is typically below 1%. Only 1.2% of the observation will have a larger correction.
 
  • There is a new task for chopped observations photCalPsToScan() that accounts for the difference in responsivity as compared to the scan map flux calibration scheme. When applying this task, the photometry of pint sources observed with the chopped photometry mode are in line with the results from scan map observations. For details of the method see the publication in Experimental Astronomy.

Spectroscopy

  • For point source pointing offset flux calibration a time dependent correction to the current telescope background model is implemented.
Changed:
<
<
The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground
>
>
The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground.
 

Analysis tools

Photometry

Line: 332 to 332
 

Product changes

Changed:
<
<
  • Improved the browse product structure (numbers changed to meaningful names)
  • Added a new observation summary dataset to the browse products. The obsSummary task shows the contents of this dataset and it can be viewed also in the Observation Context Viewer. Note that in order to update this summary to reflect changes in the observation context you have to run this task with 'forceUpdate=True'.
>
>
  • Improved the browse product structure (numbers changed to meaningful names).
  • Added a new observation summary dataset to the browse products. The obsSummary task shows the contents of this dataset and it can be viewed also in the Observation Context Viewer. Note that in order to update this summary to reflect changes in the observation context you have to run this task with forceUpdate=True.
 
  • Improved the names of many FITS keywords, which makes the headers of PACS products easier to read outside HIPE.
Changed:
<
<
  • Added new meta keyword sliceNumber to slices. This number also appears in the FITS filenames in the pools, which makes them better readable.
>
>
  • Added new meta keyword sliceNumber to slices. This number also appears in the FITS filenames in the pools, which makes them more readable.
 
  • Fixed some problems with copying products.

Photometry

Line: 384 to 384
 

Spectrometer Pipeline

Changed:
<
<
  • All spectra and spectral cubes are now corrected to the Local Standard of Rest. The frequency grid is interpolated back to the original scale so that all observations still have a consistent frequency grid. A metadata keyword, freqFrame (or SPECSYS in FITS), tells you whether the LSR correction has been applied or not.
>
>
  • All spectra and spectral cubes are now corrected to the Local Standard of Rest. The frequency grid is interpolated back to the original scale so that all observations still have a consistent frequency grid. A metadata keyword, freqFrame (or SPECSYS in FITS), tells you whether the LSR correction has been applied or not.
 
  • Vignetted detectors are now included in spectral maps by default. The calibration of the vignetted outer ring of detectors was found to be reasonably consistent with the other detectors. This increases the area covered by the maps.
  • The frequency axis for spectral cubes is now contained in the 3rd axis of the WCS (to match HIFI cubes), rather than in a separate dataset called ImageIndex.
  • SpireWcsCreator has been renamed SpecWcsCreator to distinguish it from the photometer WCS task.
Line: 401 to 401
 
    • Identify a suspect pixel by image visualisation.
    • Plot the timeline data contributing to a selected pixel.
    • Identify glitches by clicking on the plots.
Changed:
<
<
    • Remake the image with the identified glitched masked out.
>
>
    • Remake the image with the identified glitches masked out.
 
    • Undockable tabs to allow side-by-side comparisons.
    • Save the modified masks back to the Level-1 and Level-0.5 timelines.
  • SPIA (SPIRE Photometric Interactive Analysis), previously available as a plugin, is now integrated into HIPE.

Spectrometer

Changed:
<
<
  • A new SPIA task has been added to carry out background subtraction, called "spiaFtsBackgroundRemoval"
>
>
  • A new SPIA task has been added to carry out background subtraction, called "spiaFtsBackgroundRemoval".
 
  • The Semi-extended Correction Tool has been updated:
Changed:
<
<
    • Sersic profile added
    • The ability to select a Gaussian reference beam has been added
    • A threshold parameter to exclude off-axis detectors from the output when they do not overlap with the source
>
>
    • Sersic profile added.
    • The ability to select a Gaussian reference beam has been added.
    • A threshold parameter to exclude off-axis detectors from the output when they do not overlap with the source.
 
  • A new tool is available to calculate FTS synthetic photometry called "specMatchPhot".
  • Small additions/corrections to the FTS useful scripts.
  • SpecWcsCreator allows a WCS to be calculated in instrument coordinates.
Line: 420 to 420
 

Documentation

Changed:
<
<
  • Substantial updates to both the SPIRE Data Reduction Guide and SPIRE Pipeline Specification Manual
>
>
  • Substantial updates to both the SPIRE Data Reduction Guide and SPIRE Pipeline Specification Manual.
 

Revision 462014-03-17 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 17 to 17
  HIPE
Changed:
<
<
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks.
>
>
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks (due to the changes in how output parameters are handled, see below).
 
  • Tasks with multiple outputs now return a list (__list__ argument deprecated) to save memory.
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it.

Revision 452014-03-17 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 207 to 207
 

HIFI Software Configuration and Properties

HIFI Calibration

Changed:
<
<
  • Updates to CleanDF tables (Level 0)
  • Non-sense LO settings in spectral scan (Level 0)
  • Calibration tables for Electrical Standing Wave task *hebCorrection*: WBS-Splines (6aH, 6aV, 6bH, 6bV, 7aH, 7aV, 7bH, 7bV)
>
>
  • Updates to CleanDF tables (Level 0). These tables allow the pipeline to omit corrupted data frames.
  • Nonsense LO settings in spectral scan (Level 0)
  • Calibration tables for Electrical Standing Wave task hebCorrection: WBS-Splines (6aH, 6aV, 6bH, 6bV, 7aH, 7aV, 7bH, 7bV)
 

HIFI Pipeline

hifiPipeline task

Line: 230 to 230
 

HIFI Data Processing Tools

Standing Wave Removal

Changed:
<
<
  • FitHifiFringe
    • Input parameter *data* replaces the multiple inputs such as "obs_or_htp", "simple_spectrum", "sds", and "cube". (New GUI figure to reflect the change)
    • For the last (or single) spectrum, the *move to next* option has been removed from the pop-up dialog window. The task exit more elegantly and leaves the two plot windows open (for the default plot=2 option).
>
>
  • FitHifiFringe
    • Input parameter data replaces the multiple inputs such as "obs_or_htp", "simple_spectrum", "sds", and "cube".
    • For the last (or single) spectrum, the move to next option has been removed from the pop-up dialogue window. The task exits more elegantly and leaves the two plot windows open (for the default plot=2 option).
 

Baseline Removal

Changed:
<
<
  • FitBaseline
    • Input parameter *data* replaces the multiple inputs such as "obs", "htp", "sds", and "simpleSpectrum". (New GUI figure to reflect the change)
    • FitBaseline should now work from within SpectrumExplorer in handling line mask windows, draw 'curtains' and allow plot scaling with right mouse button.
    • FitBaseline should now work on a simpleSpectrum (a.k.a Spectrum1d).
    • FitBaseline will skip spectrum if "empty".
>
>
  • FitBaseline
    • Input parameter data replaces the multiple inputs such as "obs", "htp", "sds", and "simpleSpectrum".
    • now works from within SpectrumExplorer to create and manipulate line mask windows and to allow plot scaling with the right mouse button.
    • works on a simpleSpectrum
    • skips a spectrum if "empty".
 
  • Bug Fixes:
Changed:
<
<
    • The backends option now works correctly - only the ones selected are processed. This is true for obs, htp, and sds.
    • If the task cannot fit the data, it no longer enters into a loop but the task nicely moves on to the next data-frame.
>
>
    • The backends option now works correctly - only the ones selected are processed. This is true for obs, htp, and sds.
    • If data cannot be fitted fitBaseline will move onto the next dataframe. Previously it hung.
 

Electrical Standing Wave correction in HEB bands

Changed:
<
<
  • hebCorrection
    • A new task is now available to help correct the ESWs in bands 6 and 7. Details can be found in Chapter 10, section 10.4 (see documentation update section below)
>
>
  • hebCorrection
    • A new task is now available to help correct the Electronic Standing Waves in bands 6 and 7. See instructions for use in the HIFI Data Reduction Guide
 

Deconvolution

Spectral Cube creation

Changed:
<
<
  • DoGridding task: new command line syntax in line with the general behavior of Tasks with multi output (see documentation update).
>
>
  • DoGridding uses a new command line syntax. This is a result of the general change in behaviour of Tasks with multiple outputs.
 

flagTool

Changed:
<
<
  • New GUI figure to reflect the addition of an input parameter for htp
>
>
  • New GUI figure to reflect the addition of an input parameter for htp
 

HiClass export tool

Changed:
<
<
  • It is now possible to open the hiClass task (to export in FITS) by using a right-click on a variable (Sent to / CLASS FITS file)
>
>
  • It is now possible to open the hiClass task (to export in FITS) by using a right-click on a variable (Send to / CLASS FITS file)
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
Line: 266 to 267
 
    • Update to section 4.2 "What was done to my data" / "Level 0".
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product".
    • Regular updates to chapter 8: "Flags in HIFI data", specifically to the Quality Flags Table.
Changed:
<
<
    • Update to chapter 9, flagTool GUI figure (possible input parameters are now "obs" and "htp"). Adjusted text accordingly.
    • Update to chapter 10: "Standing Wave Removal, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
>
>
    • Update to chapter 9, flagTool GUI figure (possible input parameters are now "obs" and "htp"). Adjusted text accordingly.
    • Update to chapter 10: "Standing Wave Removal, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
 
    • Update to chapter 10: "Standing Wave Removal, specifically to the section "Electrical Standing Wave correction in HEB bands".
Changed:
<
<
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
>
>
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
 
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
    • Updates to chapter 12: Sideband Deconvolution.
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size". Introducing new syntax (for tasks with multiple results) to create cubes.
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI. Improved method to export results of deconvolution to Class.
  • Updates to the HIFI Pipeline Specification manual
Changed:
<
<
    • Added tasks doMainBeamTemp, polarPair, doFold, and mkRms in General Pipeline, Level 2.5 Pipeline section
>
>
    • Added tasks doMainBeamTemp, polarPair, doFold, and mkRms in General Pipeline, Level 2.5 Pipeline section
 

PACS

Revision 442014-03-17 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 21 to 21
 
  • Tasks with multiple outputs now return a list (__list__ argument deprecated) to save memory.
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it.
Changed:
<
<
    • An automatic script in HIPE will detect scripts with multiple outputs tasks and will try to correct their syntax. See Task parameters if this fix did not work.
>
>
    • An automatic tool in HIPE will detect scripts with multiple outputs tasks: In case you open such a script then a dialog box pops up showing which lines need to be changed and asking your permission to convert it. See Task parameters if this fix did not work.
 
  • Improved contents and documentation in the headers of FITS files generated with HCSS or HIPE.

HIFI

Line: 132 to 132
 
  • The raster panel allows to show coordinates in either sexagesimal or decimal format.
  • Text of some popup menu options improved.
Added:
>
>

Analysis

Spectral Cubes

Display

 
  • Improved the display of cubes in the Spectrum Explorer and added the panner with compass to the display panel.
  • Improved loading large cubes.
Line: 140 to 146
 
  • The cropCube task now also accepts ranges in wavelength units.
  • The moment algorithm of computeVelocityMap has been significantly improved. Especially the error on the dispersion is now much smaller.
  • Fixed a bug in integrateSpectralMap when using a cube with regular wavelength grid (in WCS).
Changed:
<
<
  • All cube tasks now propagate the description of the cubes to the result.
>
>
  • All cube tasks now propagate the description of the cubes, the instrument name and the units to the result.
 
Deleted:
<
<

Data cubes

Display

Analysis

 

Herschel Science Archive

Revision 432014-03-17 - BrunoMerin

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 19 to 19
 
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks.
Changed:
<
<
  • Tasks with multiple outputs return a list (__list__ argument deprecated). (This information is to be expanded by Pat Morris)
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it. See Task parameters
>
>
  • Tasks with multiple outputs now return a list (__list__ argument deprecated) to save memory.
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it.
    • An automatic script in HIPE will detect scripts with multiple outputs tasks and will try to correct their syntax. See Task parameters if this fix did not work.
 
  • Improved contents and documentation in the headers of FITS files generated with HCSS or HIPE.

HIFI

Revision 422014-03-17 - DavidTeyssier

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 26 to 26
 HIFI

  • Special task to mitigate electronic standing waves in HIFI HEB bands.
Changed:
<
<
  • There is no strong reason to reprocess HIFI data for bands other than the HEB bands with this version.
>
>
  • There is no strong reason to reprocess HIFI data with this release. However for data taken in bands 6 and 7 (HEB bands) it is recommended to try and remove the electrical standing waves with the new dedicated task.
  PACS
Line: 216 to 216
 

Level 2 Pipeline

Level 2.5 Pipeline

Added:
>
>
In the case of mapping observations, the level 2.5 products containing so far the cubes now also contains a copy of the level 2 individual spectra complemented with the necessary information in order to optimally compute the cube grid dimension.
 

HIFI Products

HIFI Spectrum Toolbox

Revision 412014-03-14 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
Changed:
<
<

What's coming up in HIPE 12

>
>

What's new in HIPE 12

 
PDF Version Click here
Line: 13 to 13
 
Deleted:
<
<

Planned work

HIPE

  • Gyro-propagation for pointing products
  • List-return syntax for tasks (reduction of memory leaks)
  • Improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • Improvement of SPG interface for DP TAs to ease future reprocessing exercises
  • Framework for on-demand processing profiles
  • Creation of a multi-observation context to reduce download time for users

HIFI

  • Performance issues for HIFI pipeline
  • HEB standing wave mitigation

PACS

  • Level 3 products
  • Tailored level 2.5 products (extended vs. pointsource)

SPIRE

  • Alternative Error maps for na´ve mapper Provide the user with a set of alternative error maps including standard (no weighting), bolometer noise weighted and hybrid cases for low coverage maps
  • Destriper improvements
    • Improved Level 2 deglitching algorithms
    • Destriper working on entire timelines
    • Implementation of weighting into destriping
  • Automatic correction of data affected by Cooler burps
  • Detection of bolometer jumps in Destriper
  • Continued improvements on Zero Point Calibration with Planck
  • Flux Calibration: New flux calibration using new Neptune fluxes from (ESA4?) models Will produce new flux calibration files and new Temp Drift Correction calibration files (and new Relative gain correction)
  • Super Resolution Maps: Port the HiRES code into HIPE as a task for Super resolution mapping
  • Iterative pipeline models to improve deglitching and jump detection.
  • Quick pipeline without FFT modules up to the Level 2 deglitcher in the destriper that flags glitches in the Level 0.5 timelines and then we run the full pipeline again.
  • Documentation
    • Continued updates to DRG
    • Continued updates to PSM
    • Homogenization and review of product metadata
 

Highlights

HIPE

  • Drastic improvement in memory consumption for certain pipeline and analysis tasks.
Added:
>
>
  • Tasks with multiple outputs return a list (__list__ argument deprecated). (This information is to be expanded by Pat Morris)
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it. See Task parameters
 
  • Improved contents and documentation in the headers of FITS files generated with HCSS or HIPE.

HIFI

Line: 197 to 155
 

Product Access Layer

Tasks

Changed:
<
<
  • Tasks with multiple outputs return a list (__list__ argument deprecated).
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it. See Task parameters
>
>
 
  • Task GUIs: You can now drag and drop from the Navigator into 'file' arguments.

Quality control

Line: 491 to 448
 

-- StephanOtt - 01 Mar 2013 \ No newline at end of file

Added:
>
>
META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Google Analytics Script" date="1394808936" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.AlvarGarcia" version="1"

Revision 402014-03-05 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 288 to 288
 

Deconvolution

Spectral Cube creation

Added:
>
>
  • DoGridding task: new command line syntax in line with the general behavior of Tasks with multi output (see documentation update).
 

flagTool

  • New GUI figure to reflect the addition of an input parameter for htp

Revision 392014-03-04 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 296 to 296
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
Changed:
<
<
    • Added a figure to Introduction, How to get your data.
>
>
    • Added 3 figures to Introduction, How to get your data. Updated text.
 
    • Added four new cookbooks to chapter 2: "HIFI Cookbooks": Point Mode Frequency Switch, Point Mode Position Switch, Point Mode Load Chop, and Spectral Scan.
    • Update to section 4.2 "What was done to my data" / "Level 0".
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product".
Line: 307 to 307
 
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
    • Updates to chapter 12: Sideband Deconvolution.
Changed:
<
<
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size".
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI.
>
>
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size". Introducing new syntax (for tasks with multiple results) to create cubes.
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI. Improved method to export results of deconvolution to Class.
 
  • Updates to the HIFI Pipeline Specification manual
    • Added tasks doMainBeamTemp, polarPair, doFold, and mkRms in General Pipeline, Level 2.5 Pipeline section

Revision 382014-02-21 - MarkusNielbock

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 319 to 319
 

Photometer

Changed:
<
<
  • a new task was introduced convertToFixedPixelSize() that performs the optical distortion correction. It is now applied in MADmap ipipe and will be used in the SPG12 processing, correcting for a 6% flux scale overestimate in the red channel and 2% underestimate in the blue channel.
>
>
  • A new task was introduced convertToFixedPixelSize() that performs the optical distortion correction. It is now applied in MADmap ipipe and will be used in the SPG12 processing, correcting for a 6% flux scale overestimate in the red channel and 2% underestimate in the blue channel.
 
  • JScanam: We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.

Changed:
<
<
  • a new task photTevCorrection() is available and used for SPG, see section on calibration.
>
>
  • A new task photTevCorrection() is available and used for SPG, see section on calibration.

  • There is a new task for chopped observations photCalPsToScan() that accounts for the difference in responsivity as compared to the scan map flux calibration scheme. When applying this task, the photometry of pint sources observed with the chopped photometry mode are in line with the results from scan map observations. For details of the method see the publication in Experimental Astronomy.
 

Spectroscopy

Line: 336 to 338
 

SPG Pipeline

Photometry

Changed:
<
<
  • a correction is applied on level 1 frames for the evaporator temperature.
>
>
  • A correction is applied on level 1 frames to correct for influences of the evaporator temperature.

  • A correction is applied on level 1 frames of the chopped photometry data to correct for differences in the responsivity as compared to scan maps.
 
  • JScanam maps will be available in level 2.5

Line: 350 to 354
 
  • A new task photTevCorrection() and related calibration file is available to correct for the dependence of the responsitivity to the evaporate temperature. The correction is typically below 1%. Only 1.2% of the observation will have a larger correction.
Added:
>
>
  • There is a new task for chopped observations photCalPsToScan() that accounts for the difference in responsivity as compared to the scan map flux calibration scheme. When applying this task, the photometry of pint sources observed with the chopped photometry mode are in line with the results from scan map observations. For details of the method see the publication in Experimental Astronomy.
 

Spectroscopy

  • For point source pointing offset flux calibration a time dependent correction to the current telescope background model is implemented. The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground

Revision 372014-02-21 - BrunoAltieri

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 323 to 323
 
  • JScanam: We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.

Added:
>
>
  • a new task photTevCorrection() is available and used for SPG, see section on calibration.
 

Spectroscopy

  • the pointing offset correction ipipe scripts for line (ChopNodPointingCorrectionLineScan.py) and range scans (ChopNodPointingCorrection.py) of point sources are made available in the hipe pipeline menu inclusive detailed documentation on the pointing offset correction algorithms
  • for the point source pointing offset correction pipeline 2 new tasks were developed to determine the pointing offset correction in case the
Line: 334 to 336
 

SPG Pipeline

Photometry

Added:
>
>
  • a correction is applied on level 1 frames for the evaporator temperature.
 
  • JScanam maps will be available in level 2.5

  • MADmap maps will be corrected for the flux scale due to the fact that optical distortion was not applied so far.
Line: 339 to 343
 
  • MADmap maps will be corrected for the flux scale due to the fact that optical distortion was not applied so far.
Added:
>
>
 

Calibration

Added:
>
>
 

Photometry

Added:
>
>
  • A new task photTevCorrection() and related calibration file is available to correct for the dependence of the responsitivity to the evaporate temperature. The correction is typically below 1%. Only 1.2% of the observation will have a larger correction.
 

Spectroscopy

  • For point source pointing offset flux calibration a time dependent correction to the current telescope background model is implemented. The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground

Revision 362014-02-11 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 236 to 236
 

Virtual Observatory

Installer

Added:
>
>
  • The installer now bundles one specific version of the Java Runtime Environment (JRE) for Mac OS as it is already done with Linux and Windows. This will help isolate HIPE from the JRE installed at operating system level, but has the inevitable consequence of adding about 50 MB to the installer size.
 

Documentation

  • The internal name for the Data Analysis Guide was renamed from howtos to dag. Now when searching the documentation the results within this manual appear below the dag name.

Revision 352014-02-07 - BrunoAltieri

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 314 to 314
 

PACS

Changed:
<
<

Pipeline

Photometry

>
>

Interactive Analysis and Tools

Photometer

  • a new task was introduced convertToFixedPixelSize() that performs the optical distortion correction. It is now applied in MADmap ipipe and will be used in the SPG12 processing, correcting for a 6% flux scale overestimate in the red channel and 2% underestimate in the blue channel.
 
Changed:
<
<
We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.
>
>
  • JScanam: We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.
 

Spectroscopy

Line: 327 to 328
  accurate pointing product is available for an observation.
    • specDeterminePreCalculatedPointing: it calculates the pointing offset using the ra/dec/rollAngle information of the Frames.
    • specDeterminePointingOffsetFromPreCalculatedPointing: it determines the flux correction factors by using the pointing offset determined by specDeterminePreCalculatedPointing
Added:
>
>

SPG Pipeline

Photometry

  • JScanam maps will be available in level 2.5

  • MADmap maps will be corrected for the flux scale due to the fact that optical distortion was not applied so far.
 

Calibration

Photometry

Spectroscopy

Revision 342014-02-03 - EdwardPolehampton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 367 to 367
 

Calibration Products

Added:
>
>

Spectrometer

  • Point source calibration for off-axis detectors corrected to account for the pointing of Uranus in the calibration measurements. Only affects the off-axis detectors. Centre detector point source calibration changes by less than 0.15%.
  • Unused Spatial Correction Coefficient product removed (was designed for use with the semi-extended correction tool, but never actually used).
 

Calibration Framework

Changed:
<
<
  • New Spire Calibration Automatic Updated introduced: it run during HIPE startup and notifies the user if a new tree is available. The tool allows also the installation of new calibration tree.
  • New Spire Calibration View introduced: this is a new HIPE view callable from HIPE view menu. The view shows all the available calibrations trees, their release notes and allows installation/removal of each tree. Different colors are used to distinguish default/installed/not installed trees.
  • New Sire Calibration Preferences added to HIPE preferences: the preferences panel allows some configurations for the Spire Calibration View and the Spire Calibration Automatic Updater.
>
>
  • New SPIRE Calibration Automatic Updater introduced: it runs during HIPE startup and notifies the user if a new calibration tree is available. The tool allows also the installation of the new calibration tree.
  • New SPIRE Calibration View introduced: this is a new HIPE view callable from HIPE view menu. The view shows all the available SPIRE calibration trees with their release notes, and allows installation/removal of each tree. Different colours are used to distinguish default/installed/not installed trees.
  • New SPIRE Calibration Preferences panel added to the HIPE preferences: the preferences panel allows some configurations for the SPIRE Calibration View and the SPIRE Calibration Automatic Updater.
 

Preprocessing

Line: 386 to 391
 

Spectrometer Pipeline

Added:
>
>
  • All spectra and spectral cubes are now corrected to the Local Standard of Rest. The frequency grid is interpolated back to the original scale so that all observations still have a consistent frequency grid. A metadata keyword, freqFrame (or SPECSYS in FITS), tells you whether the LSR correction has been applied or not.
  • Vignetted detectors are now included in spectral maps by default. The calibration of the vignetted outer ring of detectors was found to be reasonably consistent with the other detectors. This increases the area covered by the maps.
  • The frequency axis for spectral cubes is now contained in the 3rd axis of the WCS (to match HIFI cubes), rather than in a separate dataset called ImageIndex.
  • SpireWcsCreator has been renamed SpecWcsCreator to distinguish it from the photometer WCS task.
  • Pipeline tasks with multiple outputs must now be specified explicitly in the pipeline - this affects 5 tasks: waveletDeglitcher, sigmaKappaDeglitcher, baselineSubtraction, phaseCorrection and spireProjection. Pipeline scripts have been updated with the new syntax, which is explained in the SPIRE Pipeline Specification Manual.
  • The functionality of the preCube product was extended to make it easier to add or remove spectra.
 

Interactive Analysis and Tools

Changed:
<
<

General

  • A tool is now available to match the FTS continuum with the SPIRE photometry.
>
>
 

Photometer

  • The Maximum Correlation Method (MCM) super-resolution algorithm developed for IRAS data can be applied to SPIRE photometer maps and is now available as the "hiresMapper" task. A useful script is also provided to help with using it.
Line: 403 to 414
 
  • SPIA (SPIRE Photometric Interactive Analysis), previously available as a plugin, is now integrated into HIPE.

Spectrometer

Changed:
<
<
  • Semi-Extended Correction Tool TBW
>
>
  • A new SPIA task has been added to carry out background subtraction, called "spiaFtsBackgroundRemoval"
  • The Semi-extended Correction Tool has been updated:
    • Sersic profile added
    • The ability to select a Gaussian reference beam has been added
    • A threshold parameter to exclude off-axis detectors from the output when they do not overlap with the source
  • A new tool is available to calculate FTS synthetic photometry called "specMatchPhot".
  • Small additions/corrections to the FTS useful scripts.
  • SpecWcsCreator allows a WCS to be calculated in instrument coordinates.
 

Documentation

Added:
>
>
 

Release Notes

  • Full list of tickets implemented: here.

Revision 332014-01-20 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 296 to 296
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
    • Added a figure to Introduction, How to get your data.
Changed:
<
<
    • Added three new cookbooks to chapter 2: "HIFI Cookbooks": Point Mode Frequency Switch, Point Mode Load Chop, and Spectral Scan.
>
>
    • Added four new cookbooks to chapter 2: "HIFI Cookbooks": Point Mode Frequency Switch, Point Mode Position Switch, Point Mode Load Chop, and Spectral Scan.
 
    • Update to section 4.2 "What was done to my data" / "Level 0".
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product".
    • Regular updates to chapter 8: "Flags in HIFI data", specifically to the Quality Flags Table.

Revision 322014-01-15 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 198 to 198
 

Tasks

  • Tasks with multiple outputs return a list (__list__ argument deprecated).
Changed:
<
<
    • Warning, important Errors mentioning ArrayList suggest that you code is using tasks that return multiple outputs and you need to update it. See Task parameters
>
>
    • Warning, important Errors mentioning ArrayList suggest that your code is using tasks that return multiple outputs and you need to update it. See Task parameters
 
  • Task GUIs: You can now drag and drop from the Navigator into 'file' arguments.

Quality control

Revision 312013-12-17 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 245 to 245
 

HIFI Software Configuration and Properties

HIFI Calibration

Added:
>
>
  • Updates to CleanDF tables (Level 0)
  • Non-sense LO settings in spectral scan (Level 0)
  • Calibration tables for Electrical Standing Wave task *hebCorrection*: WBS-Splines (6aH, 6aV, 6bH, 6bV, 7aH, 7aV, 7bH, 7bV)
 

HIFI Pipeline

hifiPipeline task

Revision 302013-12-17 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 278 to 278
 
    • The backends option now works correctly - only the ones selected are processed. This is true for obs, htp, and sds.
    • If the task cannot fit the data, it no longer enters into a loop but the task nicely moves on to the next data-frame.
Added:
>
>

Electrical Standing Wave correction in HEB bands

  • hebCorrection
    • A new task is now available to help correct the ESWs in bands 6 and 7. Details can be found in Chapter 10, section 10.4 (see documentation update section below)
 

Deconvolution

Spectral Cube creation

flagTool

Line: 289 to 293
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
    • Added a figure to Introduction, How to get your data.
Changed:
<
<
    • Updates to the doDeconvolution chapter.
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter.
>
>
    • Added three new cookbooks to chapter 2: "HIFI Cookbooks": Point Mode Frequency Switch, Point Mode Load Chop, and Spectral Scan.
 
    • Update to section 4.2 "What was done to my data" / "Level 0".
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product".
Added:
>
>
    • Regular updates to chapter 8: "Flags in HIFI data", specifically to the Quality Flags Table.
 
    • Update to chapter 9, flagTool GUI figure (possible input parameters are now "obs" and "htp"). Adjusted text accordingly.
Changed:
<
<
    • Update to chapter 10, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
>
>
    • Update to chapter 10: "Standing Wave Removal, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
    • Update to chapter 10: "Standing Wave Removal, specifically to the section "Electrical Standing Wave correction in HEB bands".
 
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
Added:
>
>
    • Updates to chapter 12: Sideband Deconvolution.
 
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size".
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI.
  • Updates to the HIFI Pipeline Specification manual
Changed:
<
<
    • Added task doFold, in General Pipeline, Level 2 Pipeline section
>
>
    • Added tasks doMainBeamTemp, polarPair, doFold, and mkRms in General Pipeline, Level 2.5 Pipeline section
 

PACS

Revision 292013-11-22 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 198 to 198
 

Tasks

  • Tasks with multiple outputs return a list (__list__ argument deprecated).
Changed:
<
<
    • Warning, important Errors mentioning ArrayList suggest that you code is using tasks that return multiple outputs and you need to update it. See Task parameters
>
>
    • Warning, important Errors mentioning ArrayList suggest that you code is using tasks that return multiple outputs and you need to update it. See Task parameters
 
  • Task GUIs: You can now drag and drop from the Navigator into 'file' arguments.

Quality control

Revision 282013-11-20 - SteveGuest

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 373 to 373
 

Photometer Pipeline

  • TemperatureDriftCorrectionTask now reacts to the "coolerBurpDetect" parameter defined in the timeline.
Added:
>
>
  • The quality of some Level-3 mosaic maps has been improved by constructing them from Level-2.5 maps where available.
 

Spectrometer Pipeline

Interactive Analysis and Tools

Added:
>
>

General

  • A tool is now available to match the FTS continuum with the SPIRE photometry.

Photometer

  • The Maximum Correlation Method (MCM) super-resolution algorithm developed for IRAS data can be applied to SPIRE photometer maps and is now available as the "hiresMapper" task. A useful script is also provided to help with using it.
  • The new "Bolometer Finder Tool" provides a friendlier front-end to the "boloFinder" task, and functions as an interactive deglitching tool. In principle it makes the corresponding "useful script" obsolete. Its features include:
    • Identify a suspect pixel by image visualisation.
    • Plot the timeline data contributing to a selected pixel.
    • Identify glitches by clicking on the plots.
    • Remake the image with the identified glitched masked out.
    • Undockable tabs to allow side-by-side comparisons.
    • Save the modified masks back to the Level-1 and Level-0.5 timelines.
  • SPIA (SPIRE Photometric Interactive Analysis), previously available as a plugin, is now integrated into HIPE.

Spectrometer

  • Semi-Extended Correction Tool TBW
 

Documentation

Release Notes

Revision 272013-11-12 - BrunoMerin

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 62 to 62
  HIPE
Added:
>
>
  • Drastic improvement in memory consumption for certain pipeline and analysis tasks.
  • Improved contents and documentation in the headers of FITS files generated with HCSS or HIPE.
 HIFI
Added:
>
>
  • Special task to mitigate electronic standing waves in HIFI HEB bands.
  • There is no strong reason to reprocess HIFI data for bands other than the HEB bands with this version.
 PACS
Added:
>
>
  • Systematic pipeline produces Level 2.5 and Level 3 mosaics.
  • All observations should be reprocessed with this HIPE version.
 SPIRE
Added:
>
>
  • Super-resolution map-making algorithm for SPIRE-PHOT data.
  • There is no strong reason to reprocess SPIRE-PHOT data with this version and for the SPIRE-SPEC data it depends on the science case.
 

Core system

HIPE

Revision 262013-11-11 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 269 to 269
 

Deconvolution

Spectral Cube creation

flagTool

Changed:
<
<
  • New GUI to reflect the addition of an input parameter for htp
>
>
  • New GUI figure to reflect the addition of an input parameter for htp
 

HiClass export tool

  • It is now possible to open the hiClass task (to export in FITS) by using a right-click on a variable (Sent to / CLASS FITS file)

Revision 252013-11-11 - JavierGracia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 295 to 295
 

Pipeline

Photometry

Added:
>
>
We have introduced significant improvements in the JScanam pipeline. Most of JScanam task run now considerably faster and require less memory than in their previous Hipe 11 version, specially when the debug option is deactivated. The quality of the final products has also improved. In particular, the task scanamorphosIndividualDrifts is reducing the correlated noise in parallel observations in a better way.

 

Spectroscopy

  • the pointing offset correction ipipe scripts for line (ChopNodPointingCorrectionLineScan.py) and range scans (ChopNodPointingCorrection.py) of point sources are made available in the hipe pipeline menu inclusive detailed documentation on the pointing offset correction algorithms
  • for the point source pointing offset correction pipeline 2 new tasks were developed to determine the pointing offset correction in case the

Revision 242013-11-06 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 252 to 252
 

HIFI Data Processing Tools

Standing Wave Removal

Changed:
<
<
    • Input parameter *data* replaces the multiple inputs such as "obs_or_htp", "simple_spectrum","sds", and "cube".
>
>
    • Input parameter *data* replaces the multiple inputs such as "obs_or_htp", "simple_spectrum", "sds", and "cube". (New GUI figure to reflect the change)
 
    • For the last (or single) spectrum, the *move to next* option has been removed from the pop-up dialog window. The task exit more elegantly and leaves the two plot windows open (for the default plot=2 option).

Baseline Removal

Added:
>
>
    • Input parameter *data* replaces the multiple inputs such as "obs", "htp", "sds", and "simpleSpectrum". (New GUI figure to reflect the change)
 
    • FitBaseline should now work from within SpectrumExplorer in handling line mask windows, draw 'curtains' and allow plot scaling with right mouse button.
    • FitBaseline should now work on a simpleSpectrum (a.k.a Spectrum1d).
    • FitBaseline will skip spectrum if "empty".
Line: 268 to 269
 

Deconvolution

Spectral Cube creation

flagTool

Added:
>
>
  • New GUI to reflect the addition of an input parameter for htp
 

HiClass export tool

Added:
>
>
  • It is now possible to open the hiClass task (to export in FITS) by using a right-click on a variable (Sent to / CLASS FITS file)
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
Changed:
<
<
    • Added a figure to Introduction, How to get your data
    • Updates to the doDeconvolution chapter
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter
    • Update to section 4.2 "What was done to my data" / "Level 0"
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product"
>
>
    • Added a figure to Introduction, How to get your data.
    • Updates to the doDeconvolution chapter.
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter.
    • Update to section 4.2 "What was done to my data" / "Level 0".
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product".
    • Update to chapter 9, flagTool GUI figure (possible input parameters are now "obs" and "htp"). Adjusted text accordingly.
    • Update to chapter 10, fitHifiFringe GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
    • Update to chapter 11, fitBaseline GUI figure to reflect change in input parameter named data. Adjusted text accordingly.
 
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
Changed:
<
<
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size"
>
>
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size".
    • Update to chapter 20, Added a note for HIPE 12 on right-click on variable to open hiClass GUI.
 
  • Updates to the HIFI Pipeline Specification manual
    • Added task doFold, in General Pipeline, Level 2 Pipeline section

Revision 232013-11-06 - JuergenSchreiber

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 289 to 289
 

Pipeline

Photometry

Spectroscopy

Changed:
<
<
>
>
  • the pointing offset correction ipipe scripts for line (ChopNodPointingCorrectionLineScan.py) and range scans (ChopNodPointingCorrection.py) of point sources are made available in the hipe pipeline menu inclusive detailed documentation on the pointing offset correction algorithms
  • for the point source pointing offset correction pipeline 2 new tasks were developed to determine the pointing offset correction in case the accurate pointing product is available for an observation.
    • specDeterminePreCalculatedPointing: it calculates the pointing offset using the ra/dec/rollAngle information of the Frames.
    • specDeterminePointingOffsetFromPreCalculatedPointing: it determines the flux correction factors by using the pointing offset determined by specDeterminePreCalculatedPointing
 

Calibration

Photometry

Spectroscopy

Changed:
<
<
>
>
  • For point source pointing offset flux calibration a time dependent correction to the current telescope background model is implemented. The calfiles for each spectral band are called TelBackCorR1, TelBackCorB2A, TelBackCorB2B, TelBackCorB3A and used by the corresponding task called specCorrectTelescopeBackground
 

Analysis tools

Photometry

Line: 323 to 328
 

Documentation

  • Improved the table of contents of the PACS User Reference Manual.
Added:
>
>
  • Detailed documentation of the point source pointing offset correction algorithm is delivered, which is a general description of the processing and a detailed description of the single tasks used including a flow chart.
 

SPIRE

Revision 222013-10-30 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 251 to 251
 

HIFI Data Processing Tools

Standing Wave Removal

Added:
>
>
  • FitHifiFringe
    • Input parameter *data* replaces the multiple inputs such as "obs_or_htp", "simple_spectrum","sds", and "cube".
    • For the last (or single) spectrum, the *move to next* option has been removed from the pop-up dialog window. The task exit more elegantly and leaves the two plot windows open (for the default plot=2 option).
 

Baseline Removal

Added:
>
>
  • FitBaseline
    • FitBaseline should now work from within SpectrumExplorer in handling line mask windows, draw 'curtains' and allow plot scaling with right mouse button.
    • FitBaseline should now work on a simpleSpectrum (a.k.a Spectrum1d).
    • FitBaseline will skip spectrum if "empty".
  • Bug Fixes:
    • The backends option now works correctly - only the ones selected are processed. This is true for obs, htp, and sds.
    • If the task cannot fit the data, it no longer enters into a loop but the task nicely moves on to the next data-frame.
 

Deconvolution

Spectral Cube creation

flagTool

Revision 212013-10-30 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 286 to 287
 

Spectroscopy

Product changes

Added:
>
>
  • Improved the browse product structure (numbers changed to meaningful names)
  • Added a new observation summary dataset to the browse products. The obsSummary task shows the contents of this dataset and it can be viewed also in the Observation Context Viewer. Note that in order to update this summary to reflect changes in the observation context you have to run this task with 'forceUpdate=True'.
  • Improved the names of many FITS keywords, which makes the headers of PACS products easier to read outside HIPE.
  • Added new meta keyword sliceNumber to slices. This number also appears in the FITS filenames in the pools, which makes them better readable.
  • Fixed some problems with copying products.
 

Photometry

Added:
>
>
 

Spectroscopy

Added:
>
>
  • Improved the meta keywords which describe the slices. The following keywords were added:
    • meanWave: the mean wavelength of the wavelength range of a slice.
    • prime: True if a slice belongs to the prime channel, false otherwise.
    • inLeak: Can be 'yes', 'no' or 'partial', depending on whether a slice is fully, not or partially in the leak region.
    • repetition: the repetition number of a slice.
    • gratingStep: the grating step size within a slice.
  • Added more flags to the rebinned cubes: We now propagate besides the saturation masks also all other inactive masks into the Flag dataset of the rebinned cubes.
 

Documentation

Added:
>
>
  • Improved the table of contents of the PACS User Reference Manual.
 

SPIRE

Calibration Products

Revision 202013-10-30 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 265 to 265
 
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter
    • Update to section 4.2 "What was done to my data" / "Level 0"
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product"
Deleted:
<
<
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size"
 
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
Added:
>
>
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size"
 
  • Updates to the HIFI Pipeline Specification manual
    • Added task doFold, in General Pipeline, Level 2 Pipeline section

Revision 192013-10-30 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 161 to 161
 
  • The raster panel allows to show coordinates in either sexagesimal or decimal format.
  • Text of some popup menu options improved.
Added:
>
>
  • Improved the display of cubes in the Spectrum Explorer and added the panner with compass to the display panel.
  • Improved loading large cubes.
 

Analysis

Added:
>
>
  • The cropCube task now also accepts ranges in wavelength units.
  • The moment algorithm of computeVelocityMap has been significantly improved. Especially the error on the dispersion is now much smaller.
  • Fixed a bug in integrateSpectralMap when using a cube with regular wavelength grid (in WCS).
  • All cube tasks now propagate the description of the cubes to the result.
 

Data cubes

Display

Analysis

Revision 182013-10-30 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 252 to 252
 

HiClass export tool

Documentation

Added:
>
>
  • Updates to the HIFI Data Reduction Guide:
    • Added a figure to Introduction, How to get your data
    • Updates to the doDeconvolution chapter
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter
    • Update to section 4.2 "What was done to my data" / "Level 0"
    • Update to section 5.4 "Re-pipelining with a new Auxiliary product"
    • Update to chapter 13, "How to make a spectral cube", section "...to change beam, pixel, map size"
    • Added a new subsection called "Caveats" in chapter 11, "HIFI Baseline Removal" chapter, section "The FitBaseline Task".
  • Updates to the HIFI Pipeline Specification manual
    • Added task doFold, in General Pipeline, Level 2 Pipeline section
 

PACS

Revision 172013-10-21 - GabrieleMainetti

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 279 to 279
 

Calibration Framework

Added:
>
>
  • New Spire Calibration Automatic Updated introduced: it run during HIPE startup and notifies the user if a new tree is available. The tool allows also the installation of new calibration tree.
  • New Spire Calibration View introduced: this is a new HIPE view callable from HIPE view menu. The view shows all the available calibrations trees, their release notes and allows installation/removal of each tree. Different colors are used to distinguish default/installed/not installed trees.
  • New Sire Calibration Preferences added to HIPE preferences: the preferences panel allows some configurations for the Spire Calibration View and the Spire Calibration Automatic Updater.
 

Preprocessing

Engineering Conversion

Revision 162013-10-18 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 19 to 19
 
  • Gyro-propagation for pointing products
  • List-return syntax for tasks (reduction of memory leaks)
Changed:
<
<
  • improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • improvement of SPG interface for DP TAs to ease future reprocessing exercises
>
>
  • Improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • Improvement of SPG interface for DP TAs to ease future reprocessing exercises
 
  • Framework for on-demand processing profiles
  • Creation of a multi-observation context to reduce download time for users
Line: 28 to 28
  HIFI
Changed:
<
<
  • performance issues for HIFI pipeline
>
>
  • Performance issues for HIFI pipeline
 
  • HEB standing wave mitigation
Line: 219 to 219
 

Installer

Documentation

Changed:
<
<
>
>
  • The internal name for the Data Analysis Guide was renamed from howtos to dag. Now when searching the documentation the results within this manual appear below the dag name.
  • The internal name for the Scripting Guide was renamed from um to sg. Now when searching the documentation the results within this manual appear below the sg name.
 

HIFI

HIFI Software Configuration and Properties

Revision 152013-10-17 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 158 to 158
 

Spectra

Display

Added:
>
>
  • The raster panel allows to show coordinates in either sexagesimal or decimal format.
  • Text of some popup menu options improved.
 

Analysis

Data cubes

Revision 142013-10-16 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 99 to 99
 

Drag & Drop

  • Multiple result rows can be selected at once in the Product Browser and create variables for them in a single drag & drop operation to the Variables View.
Added:
>
>
  • Observation variables created by drag & drop from the Product Browser onto the Variables View have more sensible names.
  • If a drop in the Variables View is not valid for certain variable (for example, trying to drop a non-observation in the Observations section), a forbidden icon will be shown to let the user know.
 
  • Files can be dragged from the Navigator and dropped in different places:
    • In the Console, they echo their absolute path.
    • Within task dialogs, in parameters expecting a file path.

Editors & Viewers

Added:
>
>
  • The reduced browse image at the top-right corner of the Observation viewer has much better quality, so details can be distinguished even without having to enlarge it. The same applies for observations shown in the Outline.
 
  • Map and List viewers have been improved. It is possible to open their elements in separate viewers, or to create variables for them.
Added:
>
>
  • If the Data section of the Observation, Product and Dataset viewers is collapsed (by clicking on its header), the available space is given to the Meta Data section.
  • A preference to restart Jython scripts when finished has been added. It is disabled by default, but can be enabled in the Editors & Viewers > Text Editor > Jython Editor preference panel.
  • When autosave of text editors is on, a backup file is generated only when the original file is modified.
 

Miscellany

Revision 132013-10-16 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 98 to 98
 

Drag & Drop

Changed:
<
<
  • Multiple result rows can be selected at once in the Product Browser and create variables for them in a single drag & drop to the Variables View.
>
>
  • Multiple result rows can be selected at once in the Product Browser and create variables for them in a single drag & drop operation to the Variables View.
 
  • Files can be dragged from the Navigator and dropped in different places:
    • In the Console, they echo their absolute path.
    • Within task dialogs, in parameters expecting a file path.
Line: 109 to 109
 

Miscellany

Changed:
<
<
  • Perspectives: Minimized views are remembered as part of the persisted layout of perspectives.
  • Restart: HIPE now asks to restart upon changes that require a new session to be applied.
>
>
  • Minimized views are remembered as part of the persisted layout of perspectives.
  • HIPE now asks to restart upon changes that require a new session in order to be applied.
 

Plotting

TablePlotter

Revision 122013-10-16 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 78 to 78
  To execute scripts in batch mode, run hipe with file path arguments.
Deleted:
<
<

Navigator

Files can be dragged from the Navigator and dropped in different places:

  • In the Console, they echo their absolute path.
  • Within task dialogs, in parameters expecting a file path.
 

Status bar

Any code can echo messages in the status bar. For example, from a Jython task:

Line: 96 to 89
 
Added:
>
>

Directories

From the General > Directories preferences panel, the user can:

  • Select the default directory where to open file dialogues.
  • Select the working directory, which will be used when reading or saving files with no absolute path specified.

Drag & Drop

  • Multiple result rows can be selected at once in the Product Browser and create variables for them in a single drag & drop to the Variables View.
  • Files can be dragged from the Navigator and dropped in different places:
    • In the Console, they echo their absolute path.
    • Within task dialogs, in parameters expecting a file path.

Editors & Viewers

  • Map and List viewers have been improved. It is possible to open their elements in separate viewers, or to create variables for them.

Miscellany

  • Perspectives: Minimized views are remembered as part of the persisted layout of perspectives.
  • Restart: HIPE now asks to restart upon changes that require a new session to be applied.
 

Plotting

TablePlotter

OverPlotter

Changed:
<
<

Dataset viewer

>
>
 

Astronomical utilities

  • Sso: Added a variant that uses internal Horizons.

Revision 112013-10-15 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 74 to 74
 

Batch mode

Changed:
<
<
The hipe executable needs to be used to run scripts in batch mode, as jylaunch was removed
>
>
The jylaunch application has been removed.

To execute scripts in batch mode, run hipe with file path arguments.

Navigator

Files can be dragged from the Navigator and dropped in different places:

  • In the Console, they echo their absolute path.
  • Within task dialogs, in parameters expecting a file path.

Status bar

Any code can echo messages in the status bar. For example, from a Jython task:

from herschel.ia.gui.kernel.util import SiteUtil
SiteUtil.getSite().getStatusManager().submit(message)
 

Plotting

TablePlotter

Revision 102013-10-14 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 154 to 154
 
  • asciiTableWriter :
    • Warning, important default value for warn has changed to false. By default the system will not ask for confirmation if the file to be written already exists.
    • By default, it will save meta-data.
Changed:
<
<
    • Added tableType parameter that can generated output in fixed-width format (3 spaces between columns).
>
>
    • Added tableType parameter that can generate output in fixed-width format (3 spaces between columns).
 
    • Simplified GUI and improved documentation.
  • asciiTableReader :
    • Added null conversion parameters.
    • Simplified GUI and improved documentation.
Changed:
<
<
  • convertAngles : no longer a prototype. It converts from numeric to string formats and vice versa.
>
>
  • convertAngles : (no longer a prototype) It converts from numeric to string formats and vice versa.
 
  • convertUnits : several improvements.
  • Export View : simplified GUI.
  • getObservation:

Revision 92013-10-14 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 96 to 96
 

Source extraction

Images

Added:
>
>
  • SimpleCube.copy() and SimpleImage.copy() create accurate copies now.
  • WCS 3rd axis does follow FITS convention for reference pixel now.
  • The WCS metadata is copied to all planes from images (spectra).
 

Display

Added:
>
>
  • Display ignore flags when the description is prefixed with 'INFO:'.
  • Colour table drawn in the axes is corrected.
  • Display does also work when image contains a TableDataset.
  • Zoom does work also on RGB images.
 

Analysis

Added:
>
>
openTask("annularSkyAperturePhotometry",inputName="image,radiusArcsec,centerX,centerY,innerArcsec,outerArcsec",variableName="myImage,myRadiusArcsec,xCenter,yCenter,innerRadius,outerRadius")
  • ImageCeil, imageFloor and imageRound tasks allow the user to decide which decimal is to be rounded.
  • ImageDivide also works with images without a unit.
  • The output of the MosaicTask now has the metadata of the first image of the mosaic.
  • Fixes in the gui of SkyAperturePhotometry tasks.
 

Spectra

Display

Revision 82013-10-11 - LijunZhang

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 225 to 225
 

Photometer Pipeline

Added:
>
>
  • TemperatureDriftCorrectionTask now reacts to the "coolerBurpDetect" parameter defined in the timeline.
 

Spectrometer Pipeline

Interactive Analysis and Tools

Revision 72013-10-10 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 231 to 231
 

Documentation

Added:
>
>

Release Notes

  • Full list of tickets implemented: here.
 
<-- COMMENT BOX CODE - DO NOT EDIT -->

Revision 62013-09-26 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 117 to 117
 

Product Access Layer

Tasks

Added:
>
>
  • Tasks with multiple outputs return a list (__list__ argument deprecated).
    • Warning, important Errors mentioning ArrayList suggest that you code is using tasks that return multiple outputs and you need to update it. See Task parameters
  • Task GUIs: You can now drag and drop from the Navigator into 'file' arguments.
 

Quality control

Line: 124 to 127
 

Data input-output

Deleted:
<
<
  • asciiTableWriter :
    • Warning, important default value for warn has changed to false. By default the system will not ask for confirmation if the file to be written already exists.
    • Added tableType parameter that can generated output in fixed-width format (3 spaces between columns)
  • asciiTableReader :
 
  • Table reading:
Changed:
<
<
    • metadata and table descriptions are now read
>
>
    • metadata and table descriptions are now read.
 
    • nulls are converted to valid values (can be user supplied).
  • Table writing:
Changed:
<
<
    • FixedWidthFormatter: can easily generate an appropiate formatter passing a table.
>
>
    • FixedWidthFormatter: can easily generate an appropriate formatter passing a table.
 
  • FITS:
    • BUNIT is now written
Changed:
<
<
    • quality flags: (ongoing) now generate keywords
>
>
    • quality flags: (ongoing) now generate keywords.
 
Added:
>
>
  • asciiTableWriter :
    • Warning, important default value for warn has changed to false. By default the system will not ask for confirmation if the file to be written already exists.
    • By default, it will save meta-data.
    • Added tableType parameter that can generated output in fixed-width format (3 spaces between columns).
    • Simplified GUI and improved documentation.
  • asciiTableReader :
    • Added null conversion parameters.
    • Simplified GUI and improved documentation.
  • convertAngles : no longer a prototype. It converts from numeric to string formats and vice versa.
  • convertUnits : several improvements.
  • Export View : simplified GUI.
  • getObservation:
    • improved GUI.
    • If an observation is not found locally (and the main MyHSA is connected to the archive) the Archive will be tried.
  • help : Also provides access to Python help.
  • openTask : you can now open a task attaching variables to any parameters.
 

Virtual Observatory

Revision 52013-09-26 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 82 to 82
 

Dataset viewer

Astronomical utilities

Changed:
<
<
>
>
  • Sso: Added a variant that uses internal Horizons.
  • radialV and RadialV.getProjection(...) : if Ephem is null the system will use its own if needed.
 

Numeric routines

Data fitting

Data interpolation

Line: 123 to 124
 

Data input-output

Changed:
<
<
* asciiTableWriter : Warning, important default for warn is false. By default the system will not ask for confirmation if the file to be written already exists
>
>
  • asciiTableWriter :
    • Warning, important default value for warn has changed to false. By default the system will not ask for confirmation if the file to be written already exists.
    • Added tableType parameter that can generated output in fixed-width format (3 spaces between columns)
  • asciiTableReader :
  • Table reading:
    • metadata and table descriptions are now read
    • nulls are converted to valid values (can be user supplied).
  • Table writing:
    • FixedWidthFormatter: can easily generate an appropiate formatter passing a table.
  • FITS:
    • BUNIT is now written
    • quality flags: (ongoing) now generate keywords
 

Virtual Observatory

Revision 42013-07-04 - StephanOtt

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 72 to 72
 

HIPE

Added:
>
>

Batch mode

The hipe executable needs to be used to run scripts in batch mode, as jylaunch was removed

 

Plotting

TablePlotter

OverPlotter

Revision 32013-05-14 - PedroGarciaLario

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 217 to 217
 

Revision 22013-04-25 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
Deleted:
<
<
 
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
Line: 120 to 119
 

Data input-output

Added:
>
>
* asciiTableWriter : Warning, important default for warn is false. By default the system will not ask for confirmation if the file to be written already exists
 

Virtual Observatory

Installer

Revision 12013-03-01 - StephanOtt

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="HipeWhatsNew"

<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 12

PDF Version Click here

Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.

See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.

Planned work

HIPE

  • Gyro-propagation for pointing products
  • List-return syntax for tasks (reduction of memory leaks)
  • improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • improvement of SPG interface for DP TAs to ease future reprocessing exercises
  • Framework for on-demand processing profiles
  • Creation of a multi-observation context to reduce download time for users

HIFI

  • performance issues for HIFI pipeline
  • HEB standing wave mitigation

PACS

  • Level 3 products
  • Tailored level 2.5 products (extended vs. pointsource)

SPIRE

  • Alternative Error maps for na´ve mapper Provide the user with a set of alternative error maps including standard (no weighting), bolometer noise weighted and hybrid cases for low coverage maps
  • Destriper improvements
    • Improved Level 2 deglitching algorithms
    • Destriper working on entire timelines
    • Implementation of weighting into destriping
  • Automatic correction of data affected by Cooler burps
  • Detection of bolometer jumps in Destriper
  • Continued improvements on Zero Point Calibration with Planck
  • Flux Calibration: New flux calibration using new Neptune fluxes from (ESA4?) models Will produce new flux calibration files and new Temp Drift Correction calibration files (and new Relative gain correction)
  • Super Resolution Maps: Port the HiRES code into HIPE as a task for Super resolution mapping
  • Iterative pipeline models to improve deglitching and jump detection.
  • Quick pipeline without FFT modules up to the Level 2 deglitcher in the destriper that flags glitches in the Level 0.5 timelines and then we run the full pipeline again.
  • Documentation
    • Continued updates to DRG
    • Continued updates to PSM
    • Homogenization and review of product metadata

Highlights

HIPE

HIFI

PACS

SPIRE

Core system

HIPE

Plotting

TablePlotter

OverPlotter

Dataset viewer

Astronomical utilities

Numeric routines

Data fitting

Data interpolation

Random numbers

Statistics

Trend analysis

Mapping

Other functions

Source extraction

Images

Display

Analysis

Spectra

Display

Analysis

Data cubes

Display

Analysis

Herschel Science Archive

Calibration sources

Products and datasets

Observation context

Product Access Layer

Tasks

Quality control

Systematic product generation

Data input-output

Virtual Observatory

Installer

Documentation

HIFI

HIFI Software Configuration and Properties

HIFI Calibration

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Level 2.5 Pipeline

HIFI Products

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

HIFI Data Processing Tools

Standing Wave Removal

Baseline Removal

Deconvolution

Spectral Cube creation

flagTool

HiClass export tool

Documentation

PACS

Pipeline

Photometry

Spectroscopy

Calibration

Photometry

Spectroscopy

Analysis tools

Photometry

Spectroscopy

Product changes

Photometry

Spectroscopy

Documentation

SPIRE

Calibration Products

Calibration Framework

Preprocessing

Engineering Conversion

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

Interactive Analysis and Tools

Documentation


<-- COMMENT BOX CODE - DO NOT EDIT -->
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

<--  
-->

-- StephanOtt - 01 Mar 2013

 
This site is powered by the TWiki collaboration platform Powered by Perl