Difference: HipeWhatsNew4x (1 vs. 54)

Revision 542012-10-30 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 7 to 7
 
PDF Version Click here
Added:
>
>
Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.
 

This document lists the changes in HIPE version 4.2 with respect to the 3.x series. Additional pages list changes between minor versions of the 4.x series.

Revision 532012-10-19 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
Added:
>
>
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
 

What's New in HIPE 4

PDF Version Click here
Line: 471 to 474
 
<--  
-->
\ No newline at end of file
Added:
>
>
META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1350656221" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"

Revision 522012-05-14 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Line: 451 to 451
 

Spectral Maps (Raster/Jiggle observations)

  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
Added:
>
>

<-- COMMENT BOX CODE - DO NOT EDIT -->
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

 

Revision 512010-11-16 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Line: 11 to 11
 
Added:
>
>
 

Core system

Revision 502010-11-09 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Line: 10 to 10
 
Added:
>
>
 

Core system

Revision 492010-10-01 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Line: 9 to 9
 This document lists the changes in HIPE version 4.2 with respect to the 3.x series. Additional pages list changes between minor versions of the 4.x series.

Added:
>
>
 

Core system

Revision 482010-09-22 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Line: 6 to 6
 
Changed:
<
<
This document lists the changes in HIPE version 4.2 with respect to the 3.x series. Additional sections list changes between minor versions of the 4.x series.
>
>
This document lists the changes in HIPE version 4.2 with respect to the 3.x series. Additional pages list changes between minor versions of the 4.x series.
 
Changed:
<
<

Changes between HIPE 4.2 and 4.3

  • Implemented new gyro_nodding_pointing mode, a special case of the nodding_pointing using raster. This mode switches the boresight repeatedly between two positions A and B on the sky, starting in a predefined OFF position which is the same as the A nodding position. This mode is a special case of the nodding_pointing mode with no holds nor load slews. Its pattern is based on the raster pattern. Therefore, the maximum number of AB switches corresponds to the maximum number of raster lines, i.e. 32.
>
>
 

Core system

Revision 472010-09-13 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4

Changed:
<
<
PDF Version Click here
>
>
PDF Version Click here
 
Added:
>
>
This document lists the changes in HIPE version 4.2 with respect to the 3.x series. Additional sections list changes between minor versions of the 4.x series.

Changes between HIPE 4.2 and 4.3

  • Implemented new gyro_nodding_pointing mode, a special case of the nodding_pointing using raster. This mode switches the boresight repeatedly between two positions A and B on the sky, starting in a predefined OFF position which is the same as the A nodding position. This mode is a special case of the nodding_pointing mode with no holds nor load slews. Its pattern is based on the raster pattern. Therefore, the maximum number of AB switches corresponds to the maximum number of raster lines, i.e. 32.
 

Core system

HIPE

Revision 462010-09-08 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
Changed:
<
<

What's New in HIPE 4.0

>
>

What's New in HIPE 4

 
PDF Version Click here

Revision 452010-08-19 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 271 to 271
 

DoDeconvolution

  • Introduction of an 'expert' panel in the GUI
Added:
>
>
    • The following parameters are found in the 'expert' panel, which is on the right hand side:
      • use_entropy
      • lambda1_channels
      • lamda2_gains
      • cont_offset
      • Variable name for interim_output
    • Plotting of chi^2 against iteration number is possible from the expert panel. On the same plot the channel rms'es, the channel and gain inverse entropy are plotted as well.
    • It is also possible to plot SSB solution against frequency for each iteration of the deconvolution. There are four plots to a page.

  • Bin size is automatically set by DoDeconvolution to be the same as the sampling of the DSB data, the information is taken from the metadata "frequencyWidth".

  • Only the USB is used as input data to avoid the smearing of narrow lines that can arise after averaging LSB and USB data.
 

DoGridding

Revision 442010-08-11 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 17 to 17
 

Editors & Viewers

  • Text and Jython editors will save backup files so that, if HIPE exits abnormally, you can recover (at least part of) your unsaved changes.
Added:
>
>
  • When an error is produced the error highlight is now set to the closest (deepest in the call stack) line in the currently open script. Before, it was set to the top line (highest in the call stack); now it "goes into functions".
 
  • Dragging a variable from the Variables view and dropping it into a Jython editor will write its name in the drop location.
  • Variables can be created directly from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
  • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.

Revision 432010-08-11 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 176 to 176
 
  • All tasks can now be started and cleared with the HIPE toolbar buttons.
  • Improved default layout of task GUIs and behaviour of parameter editors.
  • Background tasks appear in the active list of tasks and send messages to the console when starting and finishing.
Deleted:
<
<
  • Added the untar task for unpacking TAR files.
 

Quality control

Line: 192 to 191
 

Data input-output

Changed:
<
<
  • SimpleFitsWriter no longer stores the path of the FITS file when zipping.
  • Improved product recognition in FitsReader.
>
>
  • simpleFitsWriter no longer stores the path of the FITS file when zipping.
  • Improved product recognition in fitsReader.
 
  • Improved GUI of fitsReader and simpleAsciiTableReader: they now automatically fill the output variable name based on the input file name.
  • getObservation has a new optional instrument argument which you can use in parallel mode to specify the instrument for which to retrieve the data.
Changed:
<
<
  • Extended exportPalToUfDir task to allow compression and renaming/moving.
  • Import View improvements: redesigned user interface, supports importing zipped pools and tarred (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned user interface, supports exporting zipped pools. It will support, in the future, tarred (and gzipped) HSA data (now it just supports loose files).
>
>
  • Extended exportPalToUfDir task to allow renaming/moving
  • Import View improvements: redesigned user interface, supports importing zipped pools (and renaming, if necessary) and tarred (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned user interface, supports exporting zipped pools. It currently supports exporting HSA data as loose files.
 

Installer

Revision 422010-08-06 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 132 to 132
 
  • NearestNeighbourProjectionTask is now capable of regridding a list of spectral cubes.
  • NearestNeighbourProjectionTask is now capable of creating a default target grid (world coordinate system) from a list of target grids.
Changed:
<
<

Herschel Science Archive

>
>

Interoperation with the Herschel Science Archive

 
Changed:
<
<
  • Support for the new HSA data format (XML files at top level).
>
>
  • Support for the new HSA data format (top directory named after HSA request ID and visible XML file at top level).
  • Support for importing data in HSA format without unpacking.
 

Calibration sources

Revision 412010-07-29 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 89 to 89
 

Analysis

  • A lot of Tasks were incorrectly available twice. The tasknames ending in -Task are not longer available. For example: cropTask is not longer available, crop should be used instead.
Added:
>
>

Spectra

Display

  • Improved information displayed in the status bar when hovering mouse.
  • Channel / flag information to the display.
  • Tooltips on FilterPanel, Table headers and cells.
  • Middle-click copies content of table cells.
  • Relativistic frequency-to-velocity transform on auxiliary axis.

Analysis

  • New task, ExportSpectrumToASCII, that allows to export spectra to ASCII.
  • TruncatedLinearInterpolator for spectrum interpolation added to the toolbox.
  • SpectrumStatistics: ignoreNaN's by default now set to true.
  • Fold task can now deal with missing segments when used with overwrite=False.
  • Checks in Extract task, which used to throw an exception when dimensionality >1, relaxed for cubes.
  • ResampleFrequency: Problem that gave different results for resampling a Spectrum1d and resampling a SimpleSpectralCube is fixed.
 

Data cubes

Display

  • Cube Spectrum Analysis Toolbox (CSAT)
Line: 268 to 284
 

Flags

SpectrumExplorer (HIFI specifics)

Added:
>
>
  • Faster loading of HifiTimelineProduct with ability to select which datasets to load by displaying summary table information.
 

HIFI DP scripts (User tool scripts)

Revision 402010-07-29 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 227 to 227
 

Level 1 Pipeline

Changed:
<
<
>
>
  • DoVelocityCorrection:
 
    • Use of Horizons ephemeris data for transforming to the rest frame of the source for SSO's introduced, using naifid to identify SSO's
    • Improvements to transform to the rest frame of the source for fixed target when using the task interactively
    • 'freqFrame' meta data parameter, which informs what frame the frequencies are expressed in, is introduced
Changed:
<
<
>
>
  • DoRadialVelocity:
 
    • No longer a part of the automatic pipeline but supplied for interactive use, it now uses the auxiliary product rather than rely on the velocity column in the datasets.
Changed:
<
<
>
>
    • Compliance with DoVelocityCorrection in the sense that the LO Frequency is also adjusted and the same meta data parameters are set.
 
Changed:
<
<
  • Fix of the problem associated with the interpolations schemes used in the DoOffSubtract and the DoFluxHotCold. Use of the linear interpolation scheme had lead to a "noise explosion" in the pipeline. A truncated linear interpolation scheme is introduced which uses nearest neighbor in case measurements are not bracketed and linear in case they are. The pipeline is now configured to use: * nearest neighbor interpolation for FSwitch and LoadChop in DoOffSubtract * truncuated linear interpolation for all the other observing modes in DoOffSubtract (actually only OTF). * truncuated linear interpolation for all the observing modes in DoFluxHotCold.
>
>
  • Fix of the problem associated with the interpolations schemes used in the DoOffSubtract and the DoFluxHotCold. Use of the linear interpolation scheme had lead to a "noise explosion" in the pipeline. A truncated linear interpolation scheme is introduced which uses nearest neighbour in case measurements are not bracketed and linear in case they are. The pipeline is now configured to use:
    • nearest neighbour interpolation for FSwitch and LoadChop in DoOffSubtract
    • truncated linear interpolation for all the other observing modes in DoOffSubtract (actually only OTF).
    • truncated linear interpolation for all the observing modes in DoFluxHotCold.
 

Level 2 Pipeline

Line: 253 to 253
 

DoDeconvolution

Added:
>
>
  • Introduction of an 'expert' panel in the GUI
 

DoGridding

FitHifiFringe

Added:
>
>
  • A number of bug fixes have made FitHifiFringe more stable in HIPE 4. In case a problem still occurs, a warning message is given, but the task will not crash.

  • Also, the sine wave fitting parameters applied to the data are now stored in a table in the ObservationContext (click on 'calibration" and then "pipeline-out')
 

HiClass export tool

Flags

Line: 265 to 271
 

HIFI DP scripts (User tool scripts)

Added:
>
>
  • Introduction of PolarPairs, a class to average and difference H and V polarisations
 

Documentation

Added:
>
>
  • HIFI User's Manual
    • Introduction of HIFI Cookbook, as first chapter of HIFI User's Manual
    • New chapter for PolarPairs
    • New chapter describing relative (rms) performance of HRS and WBS
    • Updates to HiClass (export to CLASS) chapter
    • Updates to HIFI pipeline chapter
    • Bug fixes and improvement of figures in pdf versions of document

  • HIFI Pipeline Specification Document
    • "Generic Pipeline" (verrrrry old name for what is now known as Level 1 and Level 2 pipelines) chapter split into sections for Level 1 and Level 2 pipelines
    • Addition of DoVelocityCorrection section, rearrangement of names and orders of sections to reflect current status of pipeline
    • New flow diagrams for levels 1- and 2- pipeline
    • Introduction of Level 0 pipeline description (incomplete)
    • Bug fixes and improvement of figures in pdf versions of document
 

Other

Revision 392010-07-27 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 250 to 249
 

Products

Added:
>
>
  • Hot and cold load (hc) observations are boxed in the HTP in the same way that datasets are
 

DoDeconvolution

DoGridding

Revision 382010-07-19 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 218 to 218
 
    • No need to set the HCSS_PROPS environment variable or use the hifi-new.props or hifi-installer-new.props files.
    • Properties files replaced by hifi.dp.properties, which is automatically picked up by the system.
Added:
>
>

hifiPipelineTask

HRS Pipeline

WBS Pipeline

Level 1 Pipeline

  • DoVelocityCorrection:
    • Use of Horizons ephemeris data for transforming to the rest frame of the source for SSO's introduced, using naifid to identify SSO's
    • Improvements to transform to the rest frame of the source for fixed target when using the task interactively

    • 'freqFrame' meta data parameter, which informs what frame the frequencies are expressed in, is introduced

  • DoRadialVelocity:
    • No longer a part of the automatic pipeline but supplied for interactive use, it now uses the auxiliary product rather than rely on the velocity column in the datasets.
    • Compliance with DoVelocityCorrection in the sense that the LoFrequency is also adjusted and the same meta data parameters are set.

  • Fix of the problem associated with the interpolations schemes used in the DoOffSubtract and the DoFluxHotCold. Use of the linear interpolation scheme had lead to a "noise explosion" in the pipeline. A truncated linear interpolation scheme is introduced which uses nearest neighbor in case measurements are not bracketed and linear in case they are. The pipeline is now configured to use: * nearest neighbor interpolation for FSwitch and LoadChop in DoOffSubtract * truncuated linear interpolation for all the other observing modes in DoOffSubtract (actually only OTF). * truncuated linear interpolation for all the observing modes in DoFluxHotCold.

Level 2 Pipeline

  • Fixes for cross maps: the points in a cross map are no longer averaged into one point.

  • Names of map contexts at level 2 changed to fit HCSS convention.

Products

DoDeconvolution

DoGridding

FitHifiFringe

HiClass export tool

Flags

SpectrumExplorer (HIFI specifics)

HIFI DP scripts (User tool scripts)

Documentation

Other

 

PACS

Pipeline

Revision 372010-07-14 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 54 to 54
 
  • A legend check box is added to display the plot legend.
  • An Appearance menu item is introduced in Layer Props which allows to change layer's name in single layer mode and change both layer's name and color in all layer mode.
Deleted:
<
<

Dataset viewer

 

Astronomical utilities

  • Radial velocity's LSR definition is now consistent with MPS definition.
  • Radial Velocity can now also use data from downlink.
Line: 67 to 65
 
  • Updated documentation.

Numeric routines

Changed:
<
<

Data fitting

Data interpolation

Trend analysis

Mapping

>
>
 

New functions

  • NAN_FILTER: Returns the NaN elements of an array (in a one dimensional array) leaving the original array untouched. If no NaN element is found, the original array is returned.
  • IS_ANY_NAN: Checks if the given array contains a NaN value.
Line: 94 to 89
 

Analysis

  • A lot of Tasks were incorrectly available twice. The tasknames ending in -Task are not longer available. For example: cropTask is not longer available, crop should be used instead.
Deleted:
<
<

Spectra

Display

Analysis

 

Data cubes

Display

  • Cube Spectrum Analysis Toolbox (CSAT)
Line: 133 to 123
 

Calibration sources

Products and datasets

Deleted:
<
<

Observation context

 

TableDataset

Column name duplicity is no longer allowed.
Line: 194 to 183
 
  • Import View improvements: redesigned user interface, supports importing zipped pools and tarred (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned user interface, supports exporting zipped pools. It will support, in the future, tarred (and gzipped) HSA data (now it just supports loose files).
Deleted:
<
<

Virtual Observatory

 

Installer

  • The Versant setup screen in the advanced installation mode has been added to the Mac OS X platform.
Line: 231 to 218
 
    • No need to set the HCSS_PROPS environment variable or use the hifi-new.props or hifi-installer-new.props files.
    • Properties files replaced by hifi.dp.properties, which is automatically picked up by the system.
Deleted:
<
<

hifiPipelineTask

HRS Pipeline

WBS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Products

DoDeconvolution

DoGridding

FitHifiFringe

HiClass export tool

Flags

SpectrumExplorer (HIFI specifics)

HIFI DP scripts (User tool scripts)

Documentation

Other

 

PACS

Pipeline

Line: 299 to 256
 

Photometry

  • Blue and green separated in ArrayInstrument calfile and in the code using it.
Deleted:
<
<

Spectroscopy

 

Analysis tools

  • Ipipe scripts are now part of the HIPE top Menu (pipeline -> PACS)
Line: 335 to 290
  the meta keywords aotMode, lineDescription and rasterId to the slices and adds three columns to the MasterBlockTable: MinWave, MaxWave and LineDescription

Deleted:
<
<

Photometry

 

Spectroscopy

  • Reordered the PacsCube data in the wavelength domain and added PacsStatus dataset
Line: 343 to 297
 
  • Updated the PACS Data Reduction Guide, mainly in the spectroscopy chapter. The new version has updated explanations of the spectroscopy pipeline and of the so-called slicing pipeline.
Deleted:
<
<

Other

 

SPIRE

Data Products

Line: 357 to 309
 
  • Reference interferograms and Flux Calibration products have been updated to allow for the creation of proper Level-2 Spectral Maps.
  • Reference interferograms now created such that the interferogram baseline has been removed.
Deleted:
<
<

Calibration Framework

 

Preprocessing

  • Some uplink parameters now copied into the metadata of the ObservationContext.
Deleted:
<
<

Engineering Conversion

 

Common Pipeline

  • Metadata propagated into various level contexts.
Line: 390 to 338
 

Spectral Maps (Raster/Jiggle observations)

  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
Deleted:
<
<

Interactive Analysis and Tools

Documentation

Other

 

Revision 362010-07-13 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 17 to 17
 

Editors & Viewers

  • Text and Jython editors will save backup files so that, if HIPE exits abnormally, you can recover (at least part of) your unsaved changes.
Changed:
<
<
  • Dragging a variable from the Variables view and dropping it into a Jython editor will write its name in the drop location.
>
>
  • Dragging a variable from the Variables view and dropping it into a Jython editor will write its name in the drop location.
 
  • Variables can be created directly from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
  • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.
  • Data tables can be sorted by clicking on the corresponding column header. Successive clicks will either add more columns to the sorting, revert the order (if re-click in the same column), or remove it by returning to the original state.

Console & History

Changed:
<
<
  • Console capabilities have been improved: to show the list of available actions, press Ctrl-Shift-H with the Console as the current view.
>
>
  • Console capabilities have been improved: to show the list of available key bindings, press Ctrl-Shift-H with the Console as the current view.
 
  • The History now ignores empty lines. This means that, if you go back to previous commands in the Console with the up arrow, empty lines are skipped automatically, making the command navigation easier.

Startup & Shutdown

Line: 37 to 37
 

Perspectives

  • Perspectives have been simplified: now there is a unique Work Bench, while the proof-of-concept Classic (JIDE) perspective has been suppressed.
Added:
>
>
  • The PAL Browser perspective has now completely replaced the Data Access view.
 
  • Reset perspective option has been added at the right side of the perspectives toolbar, so it is now more visible and accessible.

Miscellanea

Line: 58 to 59
 

Astronomical utilities

  • Radial velocity's LSR definition is now consistent with MPS definition.
  • Radial Velocity can now also use data from downlink.
Added:
>
>
  • Reorganised aberration correction methods in the Aberration class of the ia.obs.auxiliary.pointing package.
 
  • Updated documentation.

Pointing

  • SSO correction now maintains the overall shape of a raster observation.
Line: 88 to 90
 
    • added getFlagFromROI(selection) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection.
    • Example: roi = d.getROI([276, 269, 387, 312, 326, 436, 186, 428, 189, 318])
  • A preview is given when a fits file with a SimpleImage is selected in the Navigator.
Added:
>
>
  • In the Image Viewer section of the HIPE Preferences window you can now set the default algorithm and intensity of the colour table, as already possible by right-clicking on an image and selecting Edit colours.
 

Analysis

Changed:
<
<
  • A lot of Tasks where incorrectly available twice. The tasks which end on Task are not longer available. For example: cropTask is not longer available, crop should be used instead.
>
>
  • A lot of Tasks were incorrectly available twice. The tasknames ending in -Task are not longer available. For example: cropTask is not longer available, crop should be used instead.
 

Spectra

Display

Line: 137 to 140
 

Product Access Layer

  • Improved the GUI editor for local stores.
Added:
>
>
  • The result table of the PAL browser is now customisable.
 
  • Added task localStoreCopier to create a compressed copy of a Local Store.

Local Store

Revision 352010-07-13 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 46 to 46
 
  • This version contains some bugfixes with respect to the previous user release.

Plotting

Changed:
<
<

PlotXY

  • New auxiliary axis class ReciprocalAuxAxis, which provide reciprocal tick allocation.
>
>
  • New auxiliary axis class ReciprocalAuxAxis, providing reciprocal tick allocation.
 

TablePlotter

  • New APIs are introduced which allow to set initial column mode and to specify if data extraction is allowed or not.

OverPlotter

  • A legend check box is added to display the plot legend.
Changed:
<
<
  • An "Appearance" menu item is introduced in "Layer Props" which allows to change layer's name in single layer mode and change both layer's name and color in all layer mode.
>
>
  • An Appearance menu item is introduced in Layer Props which allows to change layer's name in single layer mode and change both layer's name and color in all layer mode.
 

Dataset viewer

Astronomical utilities

Changed:
<
<
  • Radial velocity's LSR definition is now consistent with MPS definition
  • Radial Velocity can now also use data from downlink
  • Updated documentation
>
>
  • Radial velocity's LSR definition is now consistent with MPS definition.
  • Radial Velocity can now also use data from downlink.
  • Updated documentation.
 

Pointing

Changed:
<
<
  • SSO correction now maintains the overall shape of a raster observation
  • SSO can now also use data from downlink
  • Updated documentation
>
>
  • SSO correction now maintains the overall shape of a raster observation.
  • SSO can now also use data from downlink.
  • Updated documentation.
 

Numeric routines

Data fitting

Line: 77 to 76
  Median function returns NaN if any array value is NaN.

Source extraction

Changed:
<
<
  • Every source in the input source list will now be included in the output source list, including sources that lie outside of the image
  • Extraction now fails if the image has non-square pixels
>
>
  • Every source in the input source list will now be included in the output source list, including sources that lie outside of the image.
  • Extraction now fails if the image has non-square pixels.
 

Images

Display

  • Display now has the SLS and the HSV color tables as known from ds9. It is also possible to change the color table according to the square and a power algorithm (Linear Scaling, Sqrt, Log and Histogram equalisation were already available)
Changed:
<
<
  • Display can use Regions of interest
    • added method getROI([row1, column1, row2, column2, ...]) to Display which returns a Selection
    • added getFlagFromROI([row1, column1, row2, column2, ...]) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection
    • added getFlagFromROI(selection) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection
    • Example : roi = d.getROI([276, 269, 387, 312, 326, 436, 186, 428, 189, 318])
  • A preview is given when a fits file with a SimpleImage is selected in the Navigator.
>
>
  • Display can use Regions of interest.
    • added method getROI([row1, column1, row2, column2, ...]) to Display which returns a Selection.
    • added getFlagFromROI([row1, column1, row2, column2, ...]) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection.
    • added getFlagFromROI(selection) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection.
    • Example: roi = d.getROI([276, 269, 387, 312, 326, 436, 186, 428, 189, 318])
  • A preview is given when a fits file with a SimpleImage is selected in the Navigator.
 

Analysis

Changed:
<
<
  • A lot of Tasks where incorrectly available twice. The tasks which end on Task are not longer available. For example : cropTask is not longer available, crop should be used instead.
>
>
  • A lot of Tasks where incorrectly available twice. The tasks which end on Task are not longer available. For example: cropTask is not longer available, crop should be used instead.
 

Spectra

Display

Line: 100 to 99
 

Data cubes

Display

  • Cube Spectrum Analysis Toolbox (CSAT)
Changed:
<
<
    • Main Gui
      • allow to define a "reference spaxel" for the real time spectrum viewer
      • WCS viewer section corrected for the WCS with imageindex section
>
>
    • Main interface
      • You can define a "reference spaxel" for the real time spectrum viewer.
      • WCS viewer section corrected for the WCS with imageindex section.
 
    • Single spectrum extraction
Changed:
<
<
      • allow to extract many single spaxel spectrum and save them to hipe or in separates fits files
      • allow to clean the selection
    • Region specrum extraction
      • added SUM and MEDIAN in addition to Average in the Gui
      • added polygon and ellipse selection mode , each can be moved and resized
      • allow to see the spaxel effectively selected
>
>
      • You can extract many single spaxel spectra and save them to HIPE or to separates FITS files.
      • You can clear selections.
    • Region spectrum extraction
      • Added polygon and ellipse selection modes, with the ability to move and resize
      • You can see the spaxel effectively selected.
 
    • Comparison cube
Changed:
<
<
      • the tool allow the user to compare directly spectrum of 2 different cubes
    • Line intensity map:
      • added the voigt profil , in an automatic mode.
>
>
      • With this tool you can compare directly the spectra of two different cubes.
 
    • Spectrum Explorer
Changed:
<
<
      • added scroll bar in the panel for SpectralCubes
      • in the single spaxel selection mode the color of the rectangle correspond the color of the spectrum in the plotter
>
>
      • Added scroll bar in the panel for SpectralCubes.
      • In the single spaxel selection mode the color of the rectangle correspond the color of the spectrum in the plotter
 

Analysis

    • Region specrum extraction
Changed:
<
<
      • added SUM and MEDIAN in addition to Average in the Gui
    • Line intensity map: * added the voigt profil , in an automatic mode.
>
>
      • Added Sum and Median in addition to Average in the graphical interface.
    • Line intensity map
      • Added the Voigt profile, in automatic mode.
 

Creation

  • Cubes created using NearestNeighbourProjectionTask now contain unit and metadata information.
  • NearestNeighbourProjectionTask is now capable of regridding a list of spectral cubes.
Line: 129 to 125
 

Herschel Science Archive

Changed:
<
<
  • Support for the new HSA data format (xml files at top level)
>
>
  • Support for the new HSA data format (XML files at top level).
 

Calibration sources

Line: 140 to 136
 

Product Access Layer

Changed:
<
<
  • Improved the GUI editor for local stores
  • Added a task that makes a compressed copy of a Local Store (localStoreCopier)
>
>
  • Improved the GUI editor for local stores.
  • Added task localStoreCopier to create a compressed copy of a Local Store.
 

Local Store

Changed:
<
<
  • Local store that new created from HCSS 4.0 can be simple renamed by renaming the pool directory. Old lstores still need to run PoolSchemaEvoler.evolve() to update to new format to use this feature.
  • Allow turning off of backup when re-indexing. Use property hcss.ia.pal.pool.lstore.index.backup to control this.
>
>
  • You can rename local stores newly created with HCSS 4.0 by renaming their pool directory. For older local stores you need to run PoolSchemaEvoler.evolve() to update them to the new format before using this feature.
  • It is now possible to turn off the backup when re-indexing. Use the property hcss.ia.pal.pool.lstore.index.backup to control this feature.
 

Cached Pool

Changed:
<
<
Caches now have a default size limit of 10 GB. Instead of continuing to grow, if more than 10 GB of data is retrieved into a cache, products that have been least recently used will be deleted. If this happens and the product is accessed again, it will be retrieved from the remote pool again. Note: The 10 GB size limit is approximate and applies to the downloaded products only. Metadata and other small items are cached as well, but these are not taken into account for this limit.

Several issues on Windows have been fixed, mostly related to removing items from the cache.

>
>
  • Caches now have a default size limit of 10 GB. Instead of continuing to grow, if more than 10 GB of data is retrieved into a cache, products that have been least recently used will be deleted. If this happens and the product is accessed again, it will be retrieved from the remote pool again. The 10 GB size limit is approximate and applies to the downloaded products only. Metadata and other small items are cached as well, but these are not taken into account for this limit.
  • Several issues on Windows have been fixed, mostly related to removing items from the cache.
 

HsaPool

  • Changes related to PAL interfaces modifications (added new methods, removed deprecated methods).
  • Query performance improvements: Changed subclasses retrieval mechanism.
Changed:
<
<
  • Support for importing observations using xml's files located under .exported directory and root directory.
>
>
  • Support for importing observations using XML files located under .exported directory and root directory.
 

View: Save Products to Pool

Changed:
<
<
The HIPE View "Save Products to Pool" serves to save products that are loaded into a HIPE session into a PAL product pool. New product pools (local stores) can now be created directly from this view.
>
>
With the HIPE view Save Products to Pool you can save products to a PAL product pool. New product pools (local stores) can now be created directly from this view.
 

HSA Access: HIPE Login

Changed:
<
<
The HIPE Log-in panel on the HSA View now encrypts the username and password, before sending them over the network (using HTTPS).
>
>
The HIPE login panel on the HSA view now encrypts the username and password, before sending them over the network (using HTTPS).
 

Tasks

Changed:
<
<
  • All tasks can now be started and cleared with the HIPE toolbar buttons
  • Improved default layout of task GUIs and behaviour of parameter editors
  • Background tasks appear in the active list of tasks, write to the console when starting and finishing
  • Added a task that untars a tar file (untar)
>
>
  • All tasks can now be started and cleared with the HIPE toolbar buttons.
  • Improved default layout of task GUIs and behaviour of parameter editors.
  • Background tasks appear in the active list of tasks and send messages to the console when starting and finishing.
  • Added the untar task for unpacking TAR files.
 

Quality control

Changed:
<
<
  • Include a new option in the menu "File" to get all the observations for an operational day.Optionally, the user can also filter these observations by instrument.
  • New option in the menu "Tools" allowing the user to create the summary for a set of observations in one single step
>
>
  • New option in the File menu to get all the observations for an operational day. Optionally you can filter these observations by instrument.
  • New option in the Tools menu to create the summary for a set of observations in one single step.
 
  • Date added to the time column into the logs table.

Systematic product generation

Changed:
<
<
  • New observations will contain only the pointing samples covered by the observation time range. This menas that, for each observation, a new PointingProduct will be created containing only a copy of the datasets identified with the same obsid.
  • Attach the Horizons, Orbit Events and Satellite Housekeeping new products to the auxiliary context
  • Quality tickets include the instrument mode for every observation
>
>
  • New observations will contain only the pointing samples covered by the observation time range. This means that, for each observation, a new PointingProduct will be created containing only a copy of the datasets identified with the same obsid.
  • Attached the Horizons, Orbit Events and Satellite Housekeeping new products to the auxiliary context.
  • Quality tickets include the instrument mode for every observation.
 

Data input-output

Changed:
<
<
  • SimpleFitsWriter when zipping, no longer stores the path of the fits
  • Improved product recognition in FitsReader
  • Improved GUI of fitsReader and simpleAsciiTableReader: they now autofill the output variable name based on the input file name
  • getObservation has a new optional 'instrument' argument which can be used in parallel mode to specify the instrument for which you would like to retrieve the observation data
  • Extended exportPalToUfDir task to allow compression and renaming/moving
  • Import View improvements: redesigned UI, supports importing zipped pools and tared (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned UI, supports exporting zipped pools. It will support, in the future, tared (and gzipped) HSA data (now it just supports loose files).
>
>
  • SimpleFitsWriter no longer stores the path of the FITS file when zipping.
  • Improved product recognition in FitsReader.
  • Improved GUI of fitsReader and simpleAsciiTableReader: they now automatically fill the output variable name based on the input file name.
  • getObservation has a new optional instrument argument which you can use in parallel mode to specify the instrument for which to retrieve the data.
  • Extended exportPalToUfDir task to allow compression and renaming/moving.
  • Import View improvements: redesigned user interface, supports importing zipped pools and tarred (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned user interface, supports exporting zipped pools. It will support, in the future, tarred (and gzipped) HSA data (now it just supports loose files).
 

Virtual Observatory

Installer

  • The Versant setup screen in the advanced installation mode has been added to the Mac OS X platform.
Changed:
<
<
  • The option to cancel an installation once the download phase (when the installer connects to the repository to download the missing components) has begun, has been removed.
>
>
  • Removed the option to cancel an installation once the download phase starts (when the installer connects to the repository to download the missing components).
 

Documentation

  • What's New
Changed:
<
<
    • The What's New document is now web based.
>
>
    • The What's New document is now web-based.
 
  • Quick Start Guide
    • Updated most screenshots.
  • Scripting and Data Mining
Line: 229 to 223
 

Configuration

  • Property Configuration
Changed:
<
<
    • Using the build installer for all instruments will mean that the hifi properties are correct and the HIFI pipeline will run out-of-the-box.
    • No need to set the HCSS_PROPS environment variable or use the hifi-new.props or hifi-installer-new.props files.
    • Properties files replaced by hifi.dp.properties file and it is automatically picked-up by the system.
>
>
    • Using the build installer for all instruments will mean that the HIFI properties are correct and the HIFI pipeline will run out-of-the-box.
    • No need to set the HCSS_PROPS environment variable or use the hifi-new.props or hifi-installer-new.props files.
    • Properties files replaced by hifi.dp.properties, which is automatically picked up by the system.
 

hifiPipelineTask

Line: 272 to 266
  Responsivity determination comes from astronomical sources and gives with the flat an acceptable flux.
Estimated accuracy on point sources 5%, estimated accuracy on extended sources 10%
Changed:
<
<

Spectrometry

>
>

Spectroscopy

 
  • specAddNod is not part of the level 1 chopNod pipeline anymore.
    Instead, the level1 product is sliced according to nod positions (SlicingRule "NoddingPosition") and the nod slices are then recombined in specProject
Changed:
<
<
PacsSpr:2527 speccAddNod should work on Cube
  • specCorrectHerschelVelocity can now optionally just compute the S/C velocity without applying it to the wavelengths ( PacsSpr:2510 )
  • specAddNodCubes has been improved and now works on contexts with multiple raster positions as well (PacsSpr:2718)
    Also, one no longer has to split the data to raster position before running this task.
>
>
speccAddNod now works on cubes.
  • specCorrectHerschelVelocity can now optionally just compute the S/C velocity without applying it to the wavelengths.
  • specAddNodCubes has been improved and now works on contexts with multiple raster positions as well.
    Also, you no longer have to split the data to raster position before running this task.
 

Calibration

Changed:
<
<
  • Proper treatment of time dependent SIAM calibration product ( PacsSpr:2646 )
>
>
  • Proper treatment of time dependent SIAM calibration product.
  Now we have a first time dependency with the SIAM.
It is important to pass the observation context to getCalTree:

Line: 290 to 284
  or calTree = getCalTree(time="20-Apr-2010 12:00:00")
Changed:
<
<
See also : PacsSpr:2667 getCalTree should accept FineTime next to a String time representation

If this is not done, the latest siam will be applied, which will give a 5" offset for observations before OD320
>
>
If this is not done, the latest SIAM will be applied, which will give a 5" offset for observations before OD320

  • getCalTree now accepts a FineTime in addition to a String time representation.
 
  • Two new bad pixels identified for the red photometer
Changed:
<
<
Analysis based on the pixel noise then individual/neighbor pixel behavior comparison
>
>
Analysis based on the pixel noise then individual/neighbour pixel behavior comparison
  Pixels flagged [4,5] and [3,6]
Deleted:
<
<
PacsSpr:1588 Red bad pixel calfile misses some key bad pixels
 

Photometry

Changed:
<
<
  • Separate blue and green in ArrayInstrument calfile and the code using it ( PacsSpr:2617 )
>
>
  • Blue and green separated in ArrayInstrument calfile and in the code using it.
 
Changed:
<
<

Spectrometry

>
>

Spectroscopy

 

Analysis tools

  • Ipipe scripts are now part of the HIPE top Menu (pipeline -> PACS)
Deleted:
<
<
PacsSpr:2558 Add pipeline scripts under Pipeline > PACS
 

Photometry

  • New Task: MapIndex2signalCubeTask allows to recreate a signal cube from a MapIndex.
Deleted:
<
<
PacsSpr:2466 Reading a map back into the signal should be possible
 
  • PhotProjectPointSource has been extended to accept the same options as PhotProject
Deleted:
<
<
PacsSpr:2524 photProjectPointSource() should provide the same options like photProject()
 
  • Photometer 2nd level deglitching more memory efficient
Changed:
<
<
    • PacsSpr:2448: a more memory efficient deglitching is available.
>
>
    • A more memory efficient deglitching is available.
  The map can be devided into a chess-board like pattern and deglitiching may be done tile by tile.
This way, less memory is necessary, because the MapIndex will be calculated only for the
currently processed tile. Quicker processing becomes possible by using the FullMapindex
instead of the SlimMapindex.
  • Madmap improvements
Changed:
<
<
    • PacsSpr:2579 Flux correction for scale < 1. A factor of 1/(1/scale)^2 is missing in previous releases when scale < 1.
    • PacsSpr:2591 Huge improvement on memory usage.
    • PacsSpr:2629 Use Mattools to calculate wcs, which got rid of usage of Basic.MEDIAN that causes JVM crashes for large datasets.
    • PacsSpr:2642 The Madmap output now contains coverage map instead of exposure map.
>
>
    • Flux correction for scale < 1. A factor of 1/(1/scale)^2 is missing in previous releases when scale < 1.
    • Huge improvement on memory usage.
    • Use Mattools to calculate WCS, which got rid of usage of Basic.MEDIAN that causes JVM crashes for large datasets.
    • The Madmap output now contains coverage map instead of exposure map.
 
Changed:
<
<

Spectrometry

>
>

Spectroscopy

 
  • The Spectrum Explorer now also works with the PACS Frames and PacsCube products.
    You can open the Spectrum Explorer in HIPE by right clicking on a variable of such a product
Changed:
<
<
and selecting the "Spectrum Explorer". We have extended this tool with additional panels to
    • (De)activate masks
    • (De)select complete spaxels in a Frames object (all 16 pixels)
    • (De)select blocks from the blocktable
>
>
and selecting Spectrum Explorer. We have extended this tool with additional panels to perform the following tasks:
    • (De)activate masks.
    • (De)select complete spaxels in a Frames object (all 16 pixels).
    • (De)select blocks from the blocktable.
  Most standard functionalities are available, but selecting data points and creating a user mask
does not yet work properly.

Product changes

Changed:
<
<
  • PACS Products now contain all available meta data
    • PacsSpr:2517 pacsPropagateMetaKeywords() should propagate ALL metadata
>
>
  • PACS Products now contain all available meta data.
 
    • Spectrometer pipeline scripts now contain addSliceMetaData step which adds
Changed:
<
<
the meta keywords aotMode, lineDescription and rasterId to the slices and adds 3 columns to the MasterBlockTable:
>
>
the meta keywords aotMode, lineDescription and rasterId to the slices and adds three columns to the MasterBlockTable:
  MinWave, MaxWave and LineDescription
Deleted:
<
<
      • PacsSpr:2328 Meta data in the Level 1/2 listcontext products
      • PacsSpr:2557 The Master Block Table should contain a column with the description of the spectral lines
 

Photometry

Changed:
<
<

Spectrometry

  • Reorder the PacsCube data in the wavelength domain and added PacsStatus dataset)
>
>

Spectroscopy

  • Reordered the PacsCube data in the wavelength domain and added PacsStatus dataset
 

Documentation

Changed:
<
<
  • During track 4.0 two versions of the PACS Data Reduction Guide were provided. The difference is mainly in the spectroscopy chapter. The earlier PDRG is from March 2010 and explains the spectroscopy pipeline used during most of the 3.0 track. The later PDRG, from May 2010, explains the so-called slicing pipeline, which has been available from part of the way through the 3.0 track.
>
>
  • Updated the PACS Data Reduction Guide, mainly in the spectroscopy chapter. The new version has updated explanations of the spectroscopy pipeline and of the so-called slicing pipeline.
 

Other

Line: 360 to 345
 

Data Products

  • SpirePreprocessedCube now contains raster/jiggle position data.
Changed:
<
<
  • Level-1 Spectral Products are now all calibration using the extended-source flux conversion.
>
>
  • Level-1 Spectral Products are now all calibrated using the extended-source flux conversion.
 
  • New Level-2 Product introduced for Point-source sparse sampling observations. This Level-2 data product contains the point-source calibrated detectors for the two target (typically the two central) detectors of each Spectrometer array.

Calibration Products

Line: 386 to 371
 

Spectrometer Pipeline

All Pipelines

  • Order of pipeline processing has changed to improve SLW signal to noise ratio. Telescope/SCAL correction now follows 2nd-Level deglitching.
Changed:
<
<
  • Level-1 and Level-2 spectra data by default now only contain spectral information within a range defined by the Spectrometer Band Edge calibration product (see SPIRE Observer's Manual for spectral ranges). NB To access out-of-band spectral samples, one must use the pipeline in an interactive manner.
  • Pixel Sizes have been updated for mapping observations based in in-flight calibration data:
>
>
  • Level-1 and Level-2 spectra data by default now only contain spectral information within a range defined by the Spectrometer Band Edge calibration product (see SPIRE Observer's Manual for spectral ranges).
    NB To access out-of-band spectral samples, you must use the pipeline in an interactive manner.
  • Pixel Sizes have been updated for mapping observations based on in-flight calibration data:
 
AOT Mode Spatial Sampling Pixel Size (SLW) Pixel Size (SSW)
SOF1 Raster Sparse 2 x 35.0" 2 x 19.0"

Revision 342010-07-08 - KevinEdwards

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 227 to 227
 

HIFI

Added:
>
>

Configuration

  • Property Configuration
    • Using the build installer for all instruments will mean that the hifi properties are correct and the HIFI pipeline will run out-of-the-box.
    • No need to set the HCSS_PROPS environment variable or use the hifi-new.props or hifi-installer-new.props files.
    • Properties files replaced by hifi.dp.properties file and it is automatically picked-up by the system.
 

hifiPipelineTask

HRS Pipeline

Revision 332010-06-16 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 193 to 193
 
  • getObservation has a new optional 'instrument' argument which can be used in parallel mode to specify the instrument for which you would like to retrieve the observation data
  • Extended exportPalToUfDir task to allow compression and renaming/moving
  • Import View improvements: redesigned UI, supports importing zipped pools and tared (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
Changed:
<
<
  • Export View improvements: redesigned UI, supports exporting zipped pools and tared (and gzipped) HSA data.
>
>
  • Export View improvements: redesigned UI, supports exporting zipped pools. It will support, in the future, tared (and gzipped) HSA data (now it just supports loose files).
 

Virtual Observatory

Revision 322010-06-08 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 358 to 358
 
  • New Level-2 Product introduced for Point-source sparse sampling observations. This Level-2 data product contains the point-source calibrated detectors for the two target (typically the two central) detectors of each Spectrometer array.

Calibration Products

Changed:
<
<
  • New calibration product introduced to convert from Level-1 extended-source calibration to LEvel-2 point source calibration for Point-source sparse sampling observations.
>
>
  • New calibration product introduced to convert from Level-1 extended-source calibration to Level-2 point source calibration for Point-source sparse sampling observations.
 
  • Reference interferograms and Flux Calibration products have been updated to allow for the creation of proper Level-2 Spectral Maps.
  • Reference interferograms now created such that the interferogram baseline has been removed.

Revision 312010-05-31 - PasqualePanuzzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 365 to 365
 

Calibration Framework

Preprocessing

Added:
>
>
  • Some uplink parameters now copied into the metadata of the ObservationContext.
 

Engineering Conversion

Common Pipeline

Added:
>
>
  • Metadata propagated into various level contexts.
 

Photometer Pipeline

Added:
>
>
  • Added new deglitcher task to remove concurrent glitches (concurrentGlitchDeglitcher). Not yet included in the standard pipeline but available to users.
  • Added new task to detect jumps in bolometer timelines (signalJumpDetector). Not yet included in the standard pipeline but available to users.
 

Spectrometer Pipeline

All Pipelines

Revision 302010-05-28 - PeterDavis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 122 to 122
 
      • added SUM and MEDIAN in addition to Average in the Gui
    • Line intensity map: * added the voigt profil , in an automatic mode.
Added:
>
>

Creation

  • Cubes created using NearestNeighbourProjectionTask now contain unit and metadata information.
  • NearestNeighbourProjectionTask is now capable of regridding a list of spectral cubes.
  • NearestNeighbourProjectionTask is now capable of creating a default target grid (world coordinate system) from a list of target grids.
 

Herschel Science Archive

Line: 381 to 385
 

Sparse Sampling (SOF1) Pipeline.

  • Single-pointing Level-2 now contains a point-source calibrated spectra for the two target (typically the two central) detectors of each Spectrometer array.
Changed:
<
<
  • Raster Level-2 spectral maps are now produced for SOF! Raster observations.
>
>
  • Raster Level-2 spectral maps are now produced for SOF1 Raster observations.
 
Changed:
<
<

Spectral Maps (Raseter/Jiggle observations)

>
>

Spectral Maps (Raster/Jiggle observations)

 
  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
Deleted:
<
<
  • Cubes created using NearestNeighbourProjectionTask now contain unit and metadata information.
  • NearestNeighbourProjectionTask is now capable of regridding a list of spectral cubes.
  • NearestNeighbourProjectionTask is now capable of creating a default target grid (world coordinate system) from a list of target grids.
 

Interactive Analysis and Tools

Revision 292010-05-28 - PeterDavis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 385 to 385
 

Spectral Maps (Raseter/Jiggle observations)

  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
Added:
>
>
  • Cubes created using NearestNeighbourProjectionTask now contain unit and metadata information.
  • NearestNeighbourProjectionTask is now capable of regridding a list of spectral cubes.
  • NearestNeighbourProjectionTask is now capable of creating a default target grid (world coordinate system) from a list of target grids.
 

Interactive Analysis and Tools

Revision 282010-05-28 - EkkehardWieprecht

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 257 to 257
 

Pipeline

Photometry

Added:
>
>
  • Photometer Flux calibration
    Calibration products involved in the photometry adjustment are stable.
    Responsivity determination comes from astronomical sources and gives with the flat an acceptable flux.
    Estimated accuracy on point sources 5%, estimated accuracy on extended sources 10%
 

Spectrometry

Added:
>
>
  • specAddNod is not part of the level 1 chopNod pipeline anymore.
    Instead, the level1 product is sliced according to nod positions (SlicingRule "NoddingPosition") and the nod slices are then recombined in specProject
    PacsSpr:2527 speccAddNod should work on Cube
  • specCorrectHerschelVelocity can now optionally just compute the S/C velocity without applying it to the wavelengths ( PacsSpr:2510 )
  • specAddNodCubes has been improved and now works on contexts with multiple raster positions as well (PacsSpr:2718)
    Also, one no longer has to split the data to raster position before running this task.
 

Calibration

Added:
>
>
  • Proper treatment of time dependent SIAM calibration product ( PacsSpr:2646 )
    Now we have a first time dependency with the SIAM.
    It is important to pass the observation context to getCalTree:
         calTree = getCalTree(obs=obs)
         or
         calTree = getCalTree(time="20-Apr-2010 12:00:00")
         
    See also : PacsSpr:2667 getCalTree should accept FineTime next to a String time representation

    If this is not done, the latest siam will be applied, which will give a 5" offset for observations before OD320

  • Two new bad pixels identified for the red photometer
    Analysis based on the pixel noise then individual/neighbor pixel behavior comparison
    Pixels flagged [4,5] and [3,6]
    PacsSpr:1588 Red bad pixel calfile misses some key bad pixels
 

Photometry

Added:
>
>
  • Separate blue and green in ArrayInstrument calfile and the code using it ( PacsSpr:2617 )
 

Spectrometry

Analysis tools

Added:
>
>
  • Ipipe scripts are now part of the HIPE top Menu (pipeline -> PACS)
    PacsSpr:2558 Add pipeline scripts under Pipeline > PACS
 

Photometry

Added:
>
>
  • New Task: MapIndex2signalCubeTask allows to recreate a signal cube from a MapIndex.
    PacsSpr:2466 Reading a map back into the signal should be possible
  • PhotProjectPointSource has been extended to accept the same options as PhotProject
    PacsSpr:2524 photProjectPointSource() should provide the same options like photProject()
  • Photometer 2nd level deglitching more memory efficient
    • PacsSpr:2448: a more memory efficient deglitching is available.
      The map can be devided into a chess-board like pattern and deglitiching may be done tile by tile.
      This way, less memory is necessary, because the MapIndex will be calculated only for the
      currently processed tile. Quicker processing becomes possible by using the FullMapindex
      instead of the SlimMapindex.
  • Madmap improvements
    • PacsSpr:2579 Flux correction for scale < 1. A factor of 1/(1/scale)^2 is missing in previous releases when scale < 1.
    • PacsSpr:2591 Huge improvement on memory usage.
    • PacsSpr:2629 Use Mattools to calculate wcs, which got rid of usage of Basic.MEDIAN that causes JVM crashes for large datasets.
    • PacsSpr:2642 The Madmap output now contains coverage map instead of exposure map.
 

Spectrometry

Added:
>
>
  • The Spectrum Explorer now also works with the PACS Frames and PacsCube products.
    You can open the Spectrum Explorer in HIPE by right clicking on a variable of such a product
    and selecting the "Spectrum Explorer". We have extended this tool with additional panels to
    • (De)activate masks
    • (De)select complete spaxels in a Frames object (all 16 pixels)
    • (De)select blocks from the blocktable Most standard functionalities are available, but selecting data points and creating a user mask
      does not yet work properly.
 

Product changes

Added:
>
>
  • PACS Products now contain all available meta data
    • PacsSpr:2517 pacsPropagateMetaKeywords() should propagate ALL metadata
    • Spectrometer pipeline scripts now contain addSliceMetaData step which adds the meta keywords aotMode, lineDescription and rasterId to the slices and adds 3 columns to the MasterBlockTable: MinWave, MaxWave and LineDescription
      • PacsSpr:2328 Meta data in the Level 1/2 listcontext products
      • PacsSpr:2557 The Master Block Table should contain a column with the description of the spectral lines

 

Photometry

Spectrometry

Added:
>
>
  • Reorder the PacsCube data in the wavelength domain and added PacsStatus dataset)
 

Documentation

Revision 272010-05-27 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 279 to 279
 

SPIRE

Added:
>
>

Data Products

  • SpirePreprocessedCube now contains raster/jiggle position data.
  • Level-1 Spectral Products are now all calibration using the extended-source flux conversion.
  • New Level-2 Product introduced for Point-source sparse sampling observations. This Level-2 data product contains the point-source calibrated detectors for the two target (typically the two central) detectors of each Spectrometer array.
 

Calibration Products

Added:
>
>
  • New calibration product introduced to convert from Level-1 extended-source calibration to LEvel-2 point source calibration for Point-source sparse sampling observations.
  • Reference interferograms and Flux Calibration products have been updated to allow for the creation of proper Level-2 Spectral Maps.
  • Reference interferograms now created such that the interferogram baseline has been removed.
 

Calibration Framework

Line: 292 to 300
 

Photometer Pipeline

Spectrometer Pipeline

Added:
>
>

All Pipelines

  • Order of pipeline processing has changed to improve SLW signal to noise ratio. Telescope/SCAL correction now follows 2nd-Level deglitching.
  • Level-1 and Level-2 spectra data by default now only contain spectral information within a range defined by the Spectrometer Band Edge calibration product (see SPIRE Observer's Manual for spectral ranges). NB To access out-of-band spectral samples, one must use the pipeline in an interactive manner.
  • Pixel Sizes have been updated for mapping observations based in in-flight calibration data:

AOT Mode Spatial Sampling Pixel Size (SLW) Pixel Size (SSW)
SOF1 Raster Sparse 2 x 35.0" 2 x 19.0"
SOF2 Single/Raster Intermediate 1 x 35.0" 1 x 19.0"
SOF2 Single/Raster Full 0.5 x 35.0" 0.5 x 19.0"

Sparse Sampling (SOF1) Pipeline.

  • Single-pointing Level-2 now contains a point-source calibrated spectra for the two target (typically the two central) detectors of each Spectrometer array.
  • Raster Level-2 spectral maps are now produced for SOF! Raster observations.

Spectral Maps (Raseter/Jiggle observations)

 
  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
Changed:
<
<
  • SpirePreprocessedCube now contains raster/jiggle position data.
>
>
 

Interactive Analysis and Tools

Documentation

Revision 262010-05-27 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 18 to 18
 

Editors & Viewers

  • Text and Jython editors will save backup files so that, if HIPE exits abnormally, you can recover (at least part of) your unsaved changes.
  • Dragging a variable from the Variables view and dropping it into a Jython editor will write its name in the drop location.
Changed:
<
<
  • Variables can be created from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
>
>
  • Variables can be created directly from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
 
  • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.
  • Data tables can be sorted by clicking on the corresponding column header. Successive clicks will either add more columns to the sorting, revert the order (if re-click in the same column), or remove it by returning to the original state.
Line: 41 to 41
 

Miscellanea

  • When opening a file, the window's title shows the complete path.
Changed:
<
<
  • Tooltip in the spinnig throbber (at bottom right corner) informs about all running jobs.
>
>
  • Tooltip in the spinning throbber (at bottom right corner) informs about all running jobs.
 
  • Tips of the Day have been added and improved.
  • This version contains some bugfixes with respect to the previous user release.

Revision 252010-05-27 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 177 to 177
 

Systematic product generation

Changed:
<
<
  • New observations will contain only the pointing samples covered by the observation time range. This menas that, for each observation, a new PointingProdcut will be created containing only a copy of the datasets identified with the same obsid.
>
>
  • New observations will contain only the pointing samples covered by the observation time range. This menas that, for each observation, a new PointingProduct will be created containing only a copy of the datasets identified with the same obsid.
 
  • Attach the Horizons, Orbit Events and Satellite Housekeeping new products to the auxiliary context
  • Quality tickets include the instrument mode for every observation
Line: 195 to 195
 

Installer

Changed:
<
<
  • The Versant setup screen in the advanced installation mode has been added for Mackintosh platforms.
>
>
  • The Versant setup screen in the advanced installation mode has been added to the Mac OS X platform.
 
  • The option to cancel an installation once the download phase (when the installer connects to the repository to download the missing components) has begun, has been removed.

Documentation

Revision 242010-05-27 - StephanOtt

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 205 to 205
 
  • Quick Start Guide
    • Updated most screenshots.
  • Scripting and Data Mining
Changed:
<
<
    • Expanded section od Cached Pool.
>
>
    • Expanded section on Cached Pool.
 
    • Added more links to numeric functions in the URM.
    • Removed section on JIDE view in HIPE.
  • Data Analysis Guide

Revision 232010-05-26 - PeterDavis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 292 to 292
 

Photometer Pipeline

Spectrometer Pipeline

Changed:
<
<
>
>
  • SpirePreprocessCubeTask has added three filtering parameters for specifying which spectra are passed to output: UNVIGNETTED, detectors, and arrayType. These parameters may be used to help with construction of spectral cubes from customized lists of detectors.
  • SpirePreprocessedCube now contains raster/jiggle position data.
 

Interactive Analysis and Tools

Documentation

Revision 222010-05-26 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 10 to 10
 

HIPE

Changed:
<
<
  • Navigator view
>
>

Navigator view

 
    • The Navigator view allows adding customized user areas.
    • The Navigator view is able to remove an entire directory along with its contents. As usually done with removals, this operation requires user confirmation.
    • Selecting a FITS image in the Navigator view shows a preview of it in the Outline view. Previews are cached so re-visiting them is faster.
Changed:
<
<
  • Editors & Viewers
>
>

Editors & Viewers

  • Text and Jython editors will save backup files so that, if HIPE exits abnormally, you can recover (at least part of) your unsaved changes.
  • Dragging a variable from the Variables view and dropping it into a Jython editor will write its name in the drop location.
 
    • Variables can be created from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
    • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.
    • Data tables can be sorted by clicking on the corresponding column header. Successive clicks will either add more columns to the sorting, revert the order (if re-click in the same column), or remove it by returning to the original state.
Changed:
<
<
  • Console & History
>
>

Console & History

 
    • Console capabilities have been improved: to show the list of available actions, press Ctrl-Shift-H with the Console as the current view.
    • The History now ignores empty lines. This means that, if you go back to previous commands in the Console with the up arrow, empty lines are skipped automatically, making the command navigation easier.
Changed:
<
<
  • Startup & Shutdown
>
>

Startup & Shutdown

 
    • When variables have been saved in a previous session, HIPE asks whether to load them. This dialog can be optionally omitted.
    • If there are running jobs when closing the application, HIPE asks for confirmation before exiting.
    • HIPE checks whether there is a new user release at startup; if so, it informs the user with a link to the web page from where to download it.
Changed:
<
<
  • Error handling
    • If HIPE crashes, it may inform about a file dump at next start. If you raise a ticket, please attach this dump for helping developers to debug the error.
>
>

Error handling

  • If HIPE crashes, it will inform about a file dump at next start, if possible. If you raise a ticket, please attach this dump for helping developers to debug the error.
 
    • HIPE has been made more robust against Out of Memory errors: instead of hanging, it offers the possibility of exiting in an ordered manner (for example, by saving unsaved editors), or try to continue working to manually free resources.
Changed:
<
<
  • Perspectives
>
>

Perspectives

 
    • Perspectives have been simplified: now there is a unique Work Bench, while the proof-of-concept Classic (JIDE) perspective has been suppressed.
    • Reset perspective option has been added at the right side of the perspectives toolbar, so it is now more visible and accessible.
Changed:
<
<
  • Miscellanea
>
>

Miscellanea

 
    • When opening a file, the window's title shows the complete path.
    • Tooltip in the spinnig throbber (at bottom right corner) informs about all running jobs.
    • Tips of the Day have been added and improved.

Revision 212010-05-26 - JuanCarlosSegovia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 136 to 136
 
  • Improved the GUI editor for local stores
  • Added a task that makes a compressed copy of a Local Store (localStoreCopier)
Deleted:
<
<
  • Extended exportPalToUfDir task to allow compression and renaming/moving
 

Local Store

  • Local store that new created from HCSS 4.0 can be simple renamed by renaming the pool directory. Old lstores still need to run PoolSchemaEvoler.evolve() to update to new format to use this feature.
Line: 186 to 185
 
  • Improved product recognition in FitsReader
  • Improved GUI of fitsReader and simpleAsciiTableReader: they now autofill the output variable name based on the input file name
  • getObservation has a new optional 'instrument' argument which can be used in parallel mode to specify the instrument for which you would like to retrieve the observation data
Added:
>
>
  • Extended exportPalToUfDir task to allow compression and renaming/moving
  • Import View improvements: redesigned UI, supports importing zipped pools and tared (and gzipped) HSA data, importing observations to new pools, and importing each observation to a new pool.
  • Export View improvements: redesigned UI, supports exporting zipped pools and tared (and gzipped) HSA data.
 

Virtual Observatory

Revision 202010-05-26 - LiBo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 138 to 138
 
  • Added a task that makes a compressed copy of a Local Store (localStoreCopier)
  • Extended exportPalToUfDir task to allow compression and renaming/moving

Added:
>
>

Local Store

  • Local store that new created from HCSS 4.0 can be simple renamed by renaming the pool directory. Old lstores still need to run PoolSchemaEvoler.evolve() to update to new format to use this feature.
  • Allow turning off of backup when re-indexing. Use property hcss.ia.pal.pool.lstore.index.backup to control this.
 

Cached Pool

Caches now have a default size limit of 10 GB. Instead of continuing to grow, if more than 10 GB of data is retrieved into a cache, products that have been least recently used will be deleted. If this happens and the product is accessed again, it will be retrieved from the remote pool again. Note: The 10 GB size limit is approximate and applies to the downloaded products only. Metadata and other small items are cached as well, but these are not taken into account for this limit.

Revision 192010-05-25 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 58 to 58
 
  • Radial velocity's LSR definition is now consistent with MPS definition
  • Radial Velocity can now also use data from downlink
  • Updated documentation
Added:
>
>

Pointing

  • SSO correction now maintains the overall shape of a raster observation
  • SSO can now also use data from downlink
  • Updated documentation
 

Numeric routines

Data fitting

Line: 119 to 123
 

Herschel Science Archive

Added:
>
>
  • Support for the new HSA data format (xml files at top level)
 

Calibration sources

Products and datasets

Line: 128 to 134
 

Product Access Layer

Added:
>
>
  • Improved the GUI editor for local stores
  • Added a task that makes a compressed copy of a Local Store (localStoreCopier)
  • Extended exportPalToUfDir task to allow compression and renaming/moving

 

Cached Pool

Caches now have a default size limit of 10 GB. Instead of continuing to grow, if more than 10 GB of data is retrieved into a cache, products that have been least recently used will be deleted. If this happens and the product is accessed again, it will be retrieved from the remote pool again. Note: The 10 GB size limit is approximate and applies to the downloaded products only. Metadata and other small items are cached as well, but these are not taken into account for this limit.

Line: 150 to 159
 

Tasks

Added:
>
>
  • All tasks can now be started and cleared with the HIPE toolbar buttons
  • Improved default layout of task GUIs and behaviour of parameter editors
  • Background tasks appear in the active list of tasks, write to the console when starting and finishing
  • Added a task that untars a tar file (untar)
 

Quality control

  • Include a new option in the menu "File" to get all the observations for an operational day.Optionally, the user can also filter these observations by instrument.
Line: 164 to 178
 

Data input-output

Added:
>
>
  • SimpleFitsWriter when zipping, no longer stores the path of the fits
  • Improved product recognition in FitsReader
  • Improved GUI of fitsReader and simpleAsciiTableReader: they now autofill the output variable name based on the input file name
  • getObservation has a new optional 'instrument' argument which can be used in parallel mode to specify the instrument for which you would like to retrieve the observation data
 

Virtual Observatory

Installer

Revision 182010-05-25 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 55 to 55
 

Dataset viewer

Astronomical utilities

Added:
>
>
  • Radial velocity's LSR definition is now consistent with MPS definition
  • Radial Velocity can now also use data from downlink
  • Updated documentation
 

Numeric routines

Data fitting

Line: 170 to 173
 

Documentation

Added:
>
>
  • What's New
    • The What's New document is now web based.
  • Quick Start Guide
    • Updated most screenshots.
  • Scripting and Data Mining
    • Expanded section od Cached Pool.
    • Added more links to numeric functions in the URM.
    • Removed section on JIDE view in HIPE.
  • Data Analysis Guide
    • Fully updated data input/output chapter.
    • Fully updated plot chapter.
    • Updated section on Spectrum Explorer.
    • Added links to spectrum arithmetics tasks in URM.
  • HIPE Owner's Guide
    • Fully updated text and screenshots of views and perspectives.
    • Updated location of dump files.
    • Expanded section on the HIPE Help System.
    • Added table on mouse events in HIPE.
    • Added section on HIPE toolbar and status bar.
 

HIFI

hifiPipelineTask

Revision 172010-05-25 - KatrinaExter

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 222 to 222
 

Documentation

Added:
>
>
  • During track 4.0 two versions of the PACS Data Reduction Guide were provided. The difference is mainly in the spectroscopy chapter. The earlier PDRG is from March 2010 and explains the spectroscopy pipeline used during most of the 3.0 track. The later PDRG, from May 2010, explains the so-called slicing pipeline, which has been available from part of the way through the 3.0 track.
 

Other

SPIRE

Revision 152010-05-24 - JuanCarlosSegovia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 59 to 59
 

Data interpolation

Trend analysis

Mapping

Added:
>
>

New functions

  • NAN_FILTER: Returns the NaN elements of an array (in a one dimensional array) leaving the original array untouched. If no NaN element is found, the original array is returned.
  • IS_ANY_NAN: Checks if the given array contains a NaN value.

Median function (MEDIAN)

Median function returns NaN if any array value is NaN.
 

Source extraction

  • Every source in the input source list will now be included in the output source list, including sources that lie outside of the image
Line: 113 to 118
 

Products and datasets

Observation context

Added:
>
>

TableDataset

Column name duplicity is no longer allowed.
 

Product Access Layer

Line: 122 to 129
  Several issues on Windows have been fixed, mostly related to removing items from the cache.
Added:
>
>

HsaPool

  • Changes related to PAL interfaces modifications (added new methods, removed deprecated methods).
  • Query performance improvements: Changed subclasses retrieval mechanism.
  • Support for importing observations using xml's files located under .exported directory and root directory.
 

View: Save Products to Pool

The HIPE View "Save Products to Pool" serves to save products that are loaded into a HIPE session into a PAL product pool. New product pools (local stores) can now be created directly from this view.

Revision 142010-05-24 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 11 to 11
 
  • Navigator view
    • The Navigator view allows adding customized user areas.
    • The Navigator view is able to remove an entire directory along with its contents. As usually done with removals, this operation requires user confirmation.
Changed:
<
<
    • Selecting a FITS file in the Navigator view shows a preview of it in the Outline view. Previews are cached so re-visiting them is faster.
>
>
    • Selecting a FITS image in the Navigator view shows a preview of it in the Outline view. Previews are cached so re-visiting them is faster.
 
Changed:
<
<
  • Editors and viewers
>
>
  • Editors & Viewers
 
    • Variables can be created from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
    • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.
    • Data tables can be sorted by clicking on the corresponding column header. Successive clicks will either add more columns to the sorting, revert the order (if re-click in the same column), or remove it by returning to the original state.
Changed:
<
<
  • Startup and shutdown
>
>
  • Console & History
    • Console capabilities have been improved: to show the list of available actions, press Ctrl-Shift-H with the Console as the current view.
    • The History now ignores empty lines. This means that, if you go back to previous commands in the Console with the up arrow, empty lines are skipped automatically, making the command navigation easier.

  • Startup & Shutdown
 
    • When variables have been saved in a previous session, HIPE asks whether to load them. This dialog can be optionally omitted.
    • If there are running jobs when closing the application, HIPE asks for confirmation before exiting.
    • HIPE checks whether there is a new user release at startup; if so, it informs the user with a link to the web page from where to download it.

  • Error handling
    • If HIPE crashes, it may inform about a file dump at next start. If you raise a ticket, please attach this dump for helping developers to debug the error.
Changed:
<
<
    • HIPE has been made more robust against Out of Memory errors: instead of hanging, it offers the possibility of exiting in an ordered manner, or try to continue working to manually free resources.
>
>
    • HIPE has been made more robust against Out of Memory errors: instead of hanging, it offers the possibility of exiting in an ordered manner (for example, by saving unsaved editors), or try to continue working to manually free resources.
 
  • Perspectives
    • Perspectives have been simplified: now there is a unique Work Bench, while the proof-of-concept Classic (JIDE) perspective has been suppressed.
Line: 33 to 37
 
  • Miscellanea
    • When opening a file, the window's title shows the complete path.
Deleted:
<
<
    • Dump, history and log files are cleaned automatically from the file system when there are too many, so their number doesn't grow indefinitely.
 
    • Tooltip in the spinnig throbber (at bottom right corner) informs about all running jobs.
    • Tips of the Day have been added and improved.
Changed:
<
<
>
>
    • This version contains some bugfixes with respect to the previous user release.
 

Plotting

PlotXY

Revision 132010-05-24 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 8 to 8
 

HIPE

Added:
>
>
  • Navigator view
    • The Navigator view allows adding customized user areas.
    • The Navigator view is able to remove an entire directory along with its contents. As usually done with removals, this operation requires user confirmation.
    • Selecting a FITS file in the Navigator view shows a preview of it in the Outline view. Previews are cached so re-visiting them is faster.

  • Editors and viewers
    • Variables can be created from nodes in the Product Viewer's tree, with the option Create Variable of its popup menu.
    • If a Product Viewer or Dataset Viewer shows data that is changed with a Jython command, it informs that the contents are outdated, and offers the possibility of a refresh.
    • Data tables can be sorted by clicking on the corresponding column header. Successive clicks will either add more columns to the sorting, revert the order (if re-click in the same column), or remove it by returning to the original state.

  • Startup and shutdown
    • When variables have been saved in a previous session, HIPE asks whether to load them. This dialog can be optionally omitted.
    • If there are running jobs when closing the application, HIPE asks for confirmation before exiting.
    • HIPE checks whether there is a new user release at startup; if so, it informs the user with a link to the web page from where to download it.

  • Error handling
    • If HIPE crashes, it may inform about a file dump at next start. If you raise a ticket, please attach this dump for helping developers to debug the error.
    • HIPE has been made more robust against Out of Memory errors: instead of hanging, it offers the possibility of exiting in an ordered manner, or try to continue working to manually free resources.

  • Perspectives
    • Perspectives have been simplified: now there is a unique Work Bench, while the proof-of-concept Classic (JIDE) perspective has been suppressed.
    • Reset perspective option has been added at the right side of the perspectives toolbar, so it is now more visible and accessible.

  • Miscellanea
    • When opening a file, the window's title shows the complete path.
    • Dump, history and log files are cleaned automatically from the file system when there are too many, so their number doesn't grow indefinitely.
    • Tooltip in the spinnig throbber (at bottom right corner) informs about all running jobs.
    • Tips of the Day have been added and improved.
 

Plotting

PlotXY

  • New auxiliary axis class ReciprocalAuxAxis, which provide reciprocal tick allocation.

Revision 122010-05-24 - ThanosTsounis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 117 to 117
 

Installer

Added:
>
>
  • The Versant setup screen in the advanced installation mode has been added for Mackintosh platforms.
  • The option to cancel an installation once the download phase (when the installer connects to the repository to download the missing components) has begun, has been removed.
 

Documentation

HIFI

Revision 112010-05-21 - AlainGueguen

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 45 to 45
 
  • A lot of Tasks where incorrectly available twice. The tasks which end on Task are not longer available. For example : cropTask is not longer available, crop should be used instead.

Spectra

Display

Added:
>
>
 

Analysis

Data cubes

Display

Added:
>
>
  • Cube Spectrum Analysis Toolbox (CSAT)
    • Main Gui
      • allow to define a "reference spaxel" for the real time spectrum viewer
      • WCS viewer section corrected for the WCS with imageindex section
    • Single spectrum extraction
      • allow to extract many single spaxel spectrum and save them to hipe or in separates fits files
      • allow to clean the selection
    • Region specrum extraction
      • added SUM and MEDIAN in addition to Average in the Gui
      • added polygon and ellipse selection mode , each can be moved and resized
      • allow to see the spaxel effectively selected
    • Comparison cube
      • the tool allow the user to compare directly spectrum of 2 different cubes
    • Line intensity map:
      • added the voigt profil , in an automatic mode.
    • Spectrum Explorer
      • added scroll bar in the panel for SpectralCubes
      • in the single spaxel selection mode the color of the rectangle correspond the color of the spectrum in the plotter
 

Analysis

Added:
>
>
    • Region specrum extraction
      • added SUM and MEDIAN in addition to Average in the Gui
    • Line intensity map: * added the voigt profil , in an automatic mode.
 

Herschel Science Archive

Revision 102010-05-21 - JingjingLi

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 9 to 9
 

HIPE

Plotting

Added:
>
>

PlotXY

  • New auxiliary axis class ReciprocalAuxAxis, which provide reciprocal tick allocation.
 

TablePlotter

  • New APIs are introduced which allow to set initial column mode and to specify if data extraction is allowed or not.

OverPlotter

Revision 92010-05-20 - AnthonySmith

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 26 to 26
 

Mapping

Source extraction

Added:
>
>
  • Every source in the input source list will now be included in the output source list, including sources that lie outside of the image
  • Extraction now fails if the image has non-square pixels
 

Images

Display

Revision 82010-05-20 - PaulBalm

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 56 to 56
 

Product Access Layer

Added:
>
>

Cached Pool

Caches now have a default size limit of 10 GB. Instead of continuing to grow, if more than 10 GB of data is retrieved into a cache, products that have been least recently used will be deleted. If this happens and the product is accessed again, it will be retrieved from the remote pool again. Note: The 10 GB size limit is approximate and applies to the downloaded products only. Metadata and other small items are cached as well, but these are not taken into account for this limit.

Several issues on Windows have been fixed, mostly related to removing items from the cache.

View: Save Products to Pool

The HIPE View "Save Products to Pool" serves to save products that are loaded into a HIPE session into a PAL product pool. New product pools (local stores) can now be created directly from this view.

HSA Access: HIPE Login

The HIPE Log-in panel on the HSA View now encrypts the username and password, before sending them over the network (using HTTPS).

 

Tasks

Quality control

Revision 72010-05-19 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 29 to 29
 

Images

Display

Changed:
<
<

Analysis

>
>
  • Display now has the SLS and the HSV color tables as known from ds9. It is also possible to change the color table according to the square and a power algorithm (Linear Scaling, Sqrt, Log and Histogram equalisation were already available)
  • Display can use Regions of interest
    • added method getROI([row1, column1, row2, column2, ...]) to Display which returns a Selection
    • added getFlagFromROI([row1, column1, row2, column2, ...]) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection
    • added getFlagFromROI(selection) to Display which returns a flag where all pixels are masked out, expect the pixels in the Selection
    • Example : roi = d.getROI([276, 269, 387, 312, 326, 436, 186, 428, 189, 318])
  • A preview is given when a fits file with a SimpleImage is selected in the Navigator.
 
Added:
>
>

Analysis

  • A lot of Tasks where incorrectly available twice. The tasks which end on Task are not longer available. For example : cropTask is not longer available, crop should be used instead.
 

Spectra

Display

Analysis

Revision 62010-05-18 - JoseOsinde

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 52 to 52
 

Quality control

Added:
>
>
  • Include a new option in the menu "File" to get all the observations for an operational day.Optionally, the user can also filter these observations by instrument.
  • New option in the menu "Tools" allowing the user to create the summary for a set of observations in one single step
  • Date added to the time column into the logs table.
 

Systematic product generation

Added:
>
>
  • New observations will contain only the pointing samples covered by the observation time range. This menas that, for each observation, a new PointingProdcut will be created containing only a copy of the datasets identified with the same obsid.
  • Attach the Horizons, Orbit Events and Satellite Housekeeping new products to the auxiliary context
  • Quality tickets include the instrument mode for every observation
 

Data input-output

Virtual Observatory

Revision 52010-05-17 - LijunZhang

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Revision 42010-05-17 - LijunZhang

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 10 to 10
 

Plotting

TablePlotter

Added:
>
>
* New APIs are introduced which allow to set initial column mode and to specify if data extraction is allowed or not.
 

OverPlotter

Added:
>
>
* A legend check box is added to display the plot legend. * An "Appearance" menu item is introduced in "Layer Props" which allows to change layer's name in single layer mode and change both layer's name and color in all layer mode.
 

Dataset viewer

Astronomical utilities

Revision 32010-05-17 - JoseOsinde

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Revision 22010-05-17 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Line: 133 to 133
 

Documentation

Other

\ No newline at end of file
Added:
>
>
<--  
-->
 \ No newline at end of file

Revision 12010-05-14 - DavideRizzo

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 4.0

Core system

HIPE

Plotting

TablePlotter

OverPlotter

Dataset viewer

Astronomical utilities

Numeric routines

Data fitting

Data interpolation

Trend analysis

Mapping

Source extraction

Images

Display

Analysis

Spectra

Display

Analysis

Data cubes

Display

Analysis

Herschel Science Archive

Calibration sources

Products and datasets

Observation context

Product Access Layer

Tasks

Quality control

Systematic product generation

Data input-output

Virtual Observatory

Installer

Documentation

HIFI

hifiPipelineTask

HRS Pipeline

WBS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Products

DoDeconvolution

DoGridding

FitHifiFringe

HiClass export tool

Flags

SpectrumExplorer (HIFI specifics)

HIFI DP scripts (User tool scripts)

Documentation

Other

PACS

Pipeline

Photometry

Spectrometry

Calibration

Photometry

Spectrometry

Analysis tools

Photometry

Spectrometry

Product changes

Photometry

Spectrometry

Documentation

Other

SPIRE

Calibration Products

Calibration Framework

Preprocessing

Engineering Conversion

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

Interactive Analysis and Tools

Documentation

Other

 
This site is powered by the TWiki collaboration platform Powered by Perl