Difference: HipeWhatsNew7x (1 vs. 43)

Revision 432012-10-30 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 7 to 7
 
PDF Version Click here
Added:
>
>
Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.
 This document lists the changes in HIPE version 7.0 with respect to the 6.x series. Additional pages list changes between minor versions of the 7.x series.

Revision 422012-10-19 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
Added:
>
>
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
 

What's New in HIPE 7

PDF Version Click here
Line: 447 to 450
 
<--  
-->
\ No newline at end of file
Added:
>
>
META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1350656430" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"

Revision 412012-05-14 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 427 to 427
 

Documentation

  • Pipeline Specification Manual: Entries on spectroscopy have been reviewed, examples have been validated.
Added:
>
>

<-- COMMENT BOX CODE - DO NOT EDIT -->
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

 
<--  
-->
\ No newline at end of file

Revision 402011-09-13 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 8 to 8
 
Added:
>
>
  See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.

Revision 392011-08-29 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 7 to 7
 This document lists the changes in HIPE version 7.0 with respect to the 6.x series. Additional pages list changes between minor versions of the 7.x series.

Added:
>
>
  See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.

Revision 372011-07-04 - BertrandMorin

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 58 to 58
 

Mapping

-->

Wavelet transform

Added:
>
>
 

Revision 362011-07-01 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 47 to 47
 

Astronomical utilities

RadialVelocity task and utility class renamed to RadialV and now using the proper Doppler sign convention.
Added:
>
>

Numeric routines

 

Wavelet transform

Revision 352011-06-10 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 39 to 39
 
  • If the Monospaced font is not really monospaced, HIPE proposes an alternate font.

Line: 48 to 48
 RadialVelocity task and utility class renamed to RadialV and now using the proper Doppler sign convention.

Images

Line: 91 to 91
 
    • A count-down progress bar.

Calibration sources

Line: 105 to 105
 The Calibrators view allows access to the database of calibration sources at ESAC, used by HSC calibration scientists. It contains spectra of planets, asteroids, and fixed targets. The data can be viewed in the usual HIPE viewers for spectra and images, and manipulated using Jython commands.

Line: 126 to 126
 There is now a detailed outline shown in the Outline view when a task is selected in the Tasks view. This allows inspection of the structure of a task without the need to either use the Console view or open its GUI in the Editor view.

Data input-output

Line: 146 to 146
 We have also added a few pre-set applications (Topcat, Aladin and VOSpec) to the Send To menu. This menu is accessible by right-clicking on a variable. The pre-set applications are visible, even if the application in question is not running and/or HIPE is not connected to the VO. Using these pre-set is transparent to the user: When sending a variable, the application will be automatically started first and the data will be sent.

Documentation

Line: 189 to 189
 

HIFI

HIFI Pipeline

Line: 206 to 206
 

Level 1 Pipeline

Level 2 Pipeline

Changed:
<
<

HIFI Products

>
>

HIFI Products

 
Changed:
<
<

HIFI Spectrum Toolbox

>
>

HIFI Spectrum Toolbox

 

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

-->
Line: 235 to 235
 
  • Obsid now exported again to CLASS header

PACS

Line: 367 to 367
 
  • The API has new methods for showing differences between two calibration trees and for verifying that expected metadata is present and correct.

Common Pipeline

Revision 342011-06-01 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 38 to 38
 
  • Indent and unindent buttons added to the toolbar.
  • If the Monospaced font is not really monospaced, HIPE proposes an alternate font.
Added:
>
>
 

Astronomical utilities

RadialVelocity task and utility class renamed to RadialV and now using the proper Doppler sign convention.
Added:
>
>
 

Images

Display

Line: 85 to 90
 
    • Fit parameters are written to file.
    • A count-down progress bar.
Added:
>
>
 

Calibration sources

Line: 97 to 104
  The Calibrators view allows access to the database of calibration sources at ESAC, used by HSC calibration scientists. It contains spectra of planets, asteroids, and fixed targets. The data can be viewed in the usual HIPE viewers for spectra and images, and manipulated using Jython commands.
Added:
>
>
 

Product Access Layer

Line: 116 to 125
  There is now a detailed outline shown in the Outline view when a task is selected in the Tasks view. This allows inspection of the structure of a task without the need to either use the Console view or open its GUI in the Editor view.
Added:
>
>
 

Data input-output

  • simpleFitsReader and simpleFitsWriter now also support reading/writting datasets (not just products).
Line: 134 to 145
  We have also added a few pre-set applications (Topcat, Aladin and VOSpec) to the Send To menu. This menu is accessible by right-clicking on a variable. The pre-set applications are visible, even if the application in question is not running and/or HIPE is not connected to the VO. Using these pre-set is transparent to the user: When sending a variable, the application will be automatically started first and the data will be sent.
Added:
>
>
 

Documentation

Line: 167 to 180
 
    • Replaced some hardcoded references with hyperlinks.
    • Updates to Chapter 5 and Chapter 11 for Level 2.5 products.
Changed:
<
<

Plug-ins

>
>

Plug-ins

  It is now possible for plug-in authors to publish new versions of plug-ins, which will be automatically picked up by existing users of the plug-in. If a new version of a plug-in is found by HIPE, and the author has indicated that the update is compatible with the user's version of HIPE, then HIPE will ask the user if the plug-in should be updated. The update mechanism is automatic, though HIPE must be restarted for the changes to be completed.
Line: 175 to 188
 

HIFI

Added:
>
>
 

HIFI Pipeline

  • doPipelineConfiguration now passes changes to the level 2 pipeline. To use this task, pass an HTP to the GUI (doPipelineConfiguration), modify the pipeline steps as required. Press accept (default name of output is out) then pass this new configuration to the pipeline task:
obs_new = hifiPipeline(obs=obs, params=out, save=False)
Added:
>
>
 

HIFI Data Processing Tools

Standing Wave Removal

Line: 210 to 227
 
  • doDeconvolution now produces a result even if deconvolution fails. In this case an error message is given
  • doDeconvolution now read flags from USB, rather than LSB. Channel flags have always been read from the USB so this change makes it easier for you to pass flagged data to the task
Added:
>
>
 

HiClass export tool

  • Obsid now exported again to CLASS header
Added:
>
>
 

PACS

Line: 345 to 366
 
    • The trees available in the archive can be listed.
  • The API has new methods for showing differences between two calibration trees and for verifying that expected metadata is present and correct.
Added:
>
>
 

Common Pipeline

  • The AssociateSkyPositionTask now creates a new table "avgVelocity" in photometer level1 scanmap products. The table contains two columns: "sampleTime" (TAI) and "avgVelocity" (deg/sec)

Revision 332011-05-24 - PaulBalm

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 130 to 130
 

Virtual Observatory

Added:
>
>
The VO external tools have been made accessible from the Tools menu.

We have also added a few pre-set applications (Topcat, Aladin and VOSpec) to the Send To menu. This menu is accessible by right-clicking on a variable. The pre-set applications are visible, even if the application in question is not running and/or HIPE is not connected to the VO. Using these pre-set is transparent to the user: When sending a variable, the application will be automatically started first and the data will be sent.

 

Installer

Documentation

Line: 163 to 167
 
    • Replaced some hardcoded references with hyperlinks.
    • Updates to Chapter 5 and Chapter 11 for Level 2.5 products.
Added:
>
>

Plug-ins

It is now possible for plug-in authors to publish new versions of plug-ins, which will be automatically picked up by existing users of the plug-in. If a new version of a plug-in is found by HIPE, and the author has indicated that the update is compatible with the user's version of HIPE, then HIPE will ask the user if the plug-in should be updated. The update mechanism is automatic, though HIPE must be restarted for the changes to be completed.

 

HIFI

HIFI Software Configuration and Properties

Revision 322011-05-24 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

PDF Version Click here
Changed:
<
<
>
>
 

Core system

Line: 18 to 18
 

History

Changed:
<
<
  • Detailed error can be opened by double-click in the history table.
>
>
  • Detailed error information can be opened with a double click in the Trace column of the History view.
 

Status bar

  • Progress bar shows the current line number of the executing script.
Changed:
<
<
  • The garbage collector can be run with the button located at the right side of the memory bar.
>
>
  • New bin-shaped button to the right of the memory bar, at the bottom of the HIPE window, to run the garbage collector and free memory manually.
 

Generic viewers

Dataset viewer
Changed:
<
<
  • Multiple cells can be selected and copied in the TableDataset viewer.
>
>
  • Multiple cells can be selected and copied in the TableDataset viewer.
 
Jython editor
Changed:
<
<
  • Find/Replace dialog enhanced. It can show now whitespace characters.
>
>
  • Find/Replace dialog enhanced. It can now show now whitespace characters.
 
  • Autoindentation of Jython code improved.
  • Indent and unindent buttons added to the toolbar.
  • If the Monospaced font is not really monospaced, HIPE proposes an alternate font.
Line: 43 to 43
 

OverPlotter

Astronomical utilities

Changed:
<
<
RadialVelocity task and util class renamed to RadialV and now use the proper Doppler sign convention.
>
>
RadialVelocity task and utility class renamed to RadialV and now using the proper Doppler sign convention.
 

Numeric routines

Data fitting

Data interpolation

Line: 54 to 54
 

Other functions

Source extraction

Deleted:
<
<
  • Various internal changes have been made to the Source Extractor tasks, but no changes to the functionality.
 

Images

Display

  • Adapted the popup menu to make it possible to work with axes, add a compass and add a scale.
  • Display now returns the commands done using the popup menu to the HIPE console. This makes it very easy to reconstruct an image plot from within a script.
  • When dragging source positions to an image, the circles are locked. When dragging contours to an image, the contours are also locked.
Changed:
<
<
  • Added method addArcSecs to add a line of a number of arcseconds to the image.
>
>
  • Added method addArcSecs to add a line of a given length in arcseconds to an image.
 
  • When using the opacity slider with a cube, the next image is used as the underlying image, not the next layer of the cube anymore.

Analysis

Changed:
<
<
  • You can now load all monochrome or indexed gif files using importRgbImageTask
>
>
  • You can now load all monochrome or indexed gif files using importRgbImageTask.
 

Spectra

Display

Line: 77 to 76
 
    • sf.doFit( ) or sf.doGlobalFit( )
    • sf.saveFitParametersAsASCII(fileName) # writes parameters of all models to fileName
    • m.toASCII(dirName) # writes parameters to dirName/[modelname].txt
Changed:
<
<
  • The SpectrumFitterGUI has, in the export TAB, also the possibility to export fit parameters to file.
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, the user can select from:
>
>
  • The SpectrumFitterGUI has, in the export TAB, also the possibility to export fit parameters to file.
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, you can select from:
 
    • Instrument specific initial model.
Changed:
<
<
>
>
    • User specific initial models - you can specify the models.
  • Addition to SpectrumFitterGUI, MultiTAB:
 
    • Some information on what will happen.
    • Fit parameters are written to file.
    • A count-down progress bar.
Line: 94 to 93
 

Calibration sources

Changed:
<
<
We have integrated the Calibration Source Database into HIPE. There is a Calibrators View on the Workbench (you may have to reset the perspective for it to appear).
>
>
Integrated the Calibration Source Database into HIPE. There is a Calibrators view in the Work Bench perspective, next to the Navigator view. You may have to reset the perspective for it to appear.
 
Changed:
<
<
The Calibrators View allows access to the database with calibration sources at ESAC, that is used by HSC calibration scientists. It contains spectra of planets, asteroids, and fixed targets. The data can be viewed in the usual HIPE viewers for spectra and images, and manipulated using Jython commands.
>
>
The Calibrators view allows access to the database of calibration sources at ESAC, used by HSC calibration scientists. It contains spectra of planets, asteroids, and fixed targets. The data can be viewed in the usual HIPE viewers for spectra and images, and manipulated using Jython commands.
 

Products and datasets

Observation context

Line: 108 to 107
 

Tasks

The default Task GUI has been improved with the following upgrades:

Changed:
<
<
  • Parameter error detection (red X) also checks the validator of the parameter
  • A new Help button gives easy direct access to the URM description of the task
  • White space in layout moved to the lower part of the panel
  • Editors based on text fields now require half the width
>
>
  • Parameter error detection (red X) also checks the validator of the parameter.
  • A new Help button gives easy direct access to the URM description of the task.
  • White space in layout moved to the lower part of the panel.
  • Editors based on text fields now require half the width.
 
  • Labels of parameters have now a maximum size to reserve space for the editors.
Changed:
<
<
  • Support for grouping inputs in multiple Tabs. For tasks that have inputs related to different aspects or simply a lot of them, they can be presented in several tabs.

There is now a detailed outline shown in the Outline View when a task is selected in the Task View. This allows inspection of the structure of a task without the need to either use the Console or open its GUI in the Editor. Also, the system is undergoing a review of task compliancy (naming, documentation, tooltips ...) that will make all tasks self-explanatory (ongoing for HIPE 8).

>
>
  • Support for grouping inputs in multiple tabs. For tasks that have inputs related to different aspects or simply a lot of them, they can be presented in several tabs.
 
Added:
>
>
There is now a detailed outline shown in the Outline view when a task is selected in the Tasks view. This allows inspection of the structure of a task without the need to either use the Console view or open its GUI in the Editor view.
 

Quality control

Systematic product generation

Data input-output

Changed:
<
<
  • simpleFitsReader and simpleFitsWriter now also support reading/writting Datasets (not just Products).
  • The Export View now shows the tags associated with each Observation version.
  • The localStoreWriter task now allows to add a tag to the saved product.
  • Now, when you use the contextual menu to save a product variable you will use the Save to Pool tool instead of the localStoreWriter task.
  • localStoreWriter and localStoreCopier now use a better integrated GUI to select-create a pool.
>
>
  • simpleFitsReader and simpleFitsWriter now also support reading/writting datasets (not just products).
  • The Export view now shows the tags associated with each observation version.
  • The localStoreWriter task now allows to add a tag to the saved product.
  • localStoreWriter and localStoreCopier now use a better integrated GUI to select and create a pool.
 
  • File filters for file dialogs are now self-explanatory (accepted extensions ...).
Changed:
<
<
  • The clear task now has a simplified syntax to delete all variables (clear() without any parameter, will delete all).

>
>
  • The clear task now has a simplified syntax to delete all variables (clear(), without any parameter, will delete all variables).
 

Virtual Observatory

Line: 140 to 134
 

Documentation

Added:
>
>
 

HIFI

HIFI Software Configuration and Properties

Revision 312011-05-24 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 10 to 10
 

HIPE

Deleted:
<
<

Jython editor

  • Find/Replace dialog enhanced. It now can show whitespace characters.
  • Autoindentation of Jython improved.
  • Indent and unindent buttons added to the toolbar.
 

Console

  • Incremental search (Ctrl+I) available.
  • Console help text enhanced.
Changed:
<
<
  • New internal commands !clear, !help and !history added.
>
>
  • New internal commands !clear, !help and !history.
 

History

  • Detailed error can be opened by double-click in the history table.
Changed:
<
<

Jobs control

>
>

Status bar

 
  • Progress bar shows the current line number of the executing script.
Added:
>
>
  • The garbage collector can be run with the button located at the right side of the memory bar.

Generic viewers

Dataset viewer

  • Multiple cells can be selected and copied in the TableDataset viewer.

Jython editor

  • Find/Replace dialog enhanced. It can show now whitespace characters.
  • Autoindentation of Jython code improved.
  • Indent and unindent buttons added to the toolbar.
  • If the Monospaced font is not really monospaced, HIPE proposes an alternate font.
 

Plotting

TablePlotter

OverPlotter

Deleted:
<
<

Dataset viewer

 

Astronomical utilities

RadialVelocity task and util class renamed to RadialV and now use the proper Doppler sign convention.

Revision 302011-05-23 - AdwinBoogert

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 158 to 158
 

HIFI Data Processing Tools

Standing Wave Removal

Changed:
<
<
  • averscan option has been removed as it was found not to work well
>
>
  • new default doplot=2 option opens no more than 2 fitHifiFringe plot windows at the time and allows for inspection before processing next spectrum
  • averscan option fitHifiFringe has been removed as standing wave characteristics vary too much between scans
  • fitHifiFringe now shows up as applicable task to both HTPs and ObsContexts
 

Baseline Removal

Changed:
<
<
  • The htpcopy option has been removed
>
>
  • New non-stop option in interactive mode of fitBaseline allows automatic processing of remaining spectra
  • The htpcopy option of fitBaseline has been removed as modified HTPs are now properly displayed in SpectrumExplorer
 

Deconvolution

  • doDeconvolution now produces a result even if deconvolution fails. In this case an error message is given

Revision 292011-05-23 - CateLiu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 218 to 218
 HIPE> print c.photometer
Changed:
<
<
MadMap
New calibration files containing the actual 'best' calibration data for MadMap : PCalPhotometer_InvnttBL_FM_v4.fits
PCalPhotometer_InvnttBS_FM_v4.fits
PCalPhotometer_InvnttRed_FM_v4.fits
>
>
MadMap
New calibration files containing the actual 'best' calibration data for MadMap : PCalPhotometer_InvnttBL_FM_v4.fits
PCalPhotometer_InvnttBS_FM_v4.fits
PCalPhotometer_InvnttRed_FM_v4.fits
 You need to update your local calibration tree Menu to activate it (Menu -> Tools -> PACS_CAL -> run Updater).
You may check by printing the calibration tree :

Revision 282011-05-23 - JuergenSchreiber

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 193 to 193
 This shall have very minor impact on the coordinates, but correct reverse order of uplink.

Spectroscopy

Added:
>
>
  • All level-2 tasks now do an internal loop over line ID. They behave now the same as the level-0/1 tasks: If you do not select a particular line/range before then the level-2 tasks just process all lines/ranges. As a consequence the level-2 products have changed a bit:
  • We no longer have a list context for each line ID within another list context: All slices of a level-2 product are now stored in a single list context. This is much more practical when selecting slices based on arbitrary criteria.
  • The pacsSliceContext task now contains all the rules in the ipipe scripts as default rules: Also, it slices by line ID, raster column, raster line, nodding position, nod cycle number, is out of field and band. The rules in the scripts are also now optional and merely for information.
  • The interactive pipeline scripts (ipipe) are now tested in the nightly tester
  • The interactive pipeline scripts (ipipe) are moved in the build from the directory scripts/pacs/spg/pipeline/ipipe/spec to scripts/pacs/scripts/ipipe/spec since they had to be moved to the package pacs_scripts
 

Calibration

Photometry

Line: 226 to 231
 

Spectroscopy

Changed:
<
<
>
>
  • Wrong coordinates in Spectrometer results: update of spec spatial cal file
  • Improvements in wavelength calibration scatter for spectral pixels in band B2B -> wavelength calibration file updated
 

Analysis tools

Slicing

  • Saving intermediate data on machines with low memory is now done more clever: The slices are only saved to the temporary pool when the memory usage is more than 75% and the sliced product contains more than one slice.
Line: 274 to 280
  Also, since these keywords are now always consistent with the BlockTable and Status contents they can and should be used for slice selection. The new task pacsSelectSlices does this meta-keyword based selection. It has the same interface as the selectSlices Python function.
Deleted:
<
<
  • The wavelength grid is now also stored in a list context
 
    • All level-2 tasks now do an internal loop over line ID. They behave now the same as the level-0/1 tasks: If you do not select a particular line/range before then the level-2 tasks just process all lines/ranges. As a consequence the level-2 products have changed a bit:
    • The wavelength grid is now also stored in a list context, since one needs to pass several ranges from task to task.
    • We no longer have a list context for each line ID within another list context: All slices of a level-2 product are now stored in a single list context. This is much more practical when selecting slices based on arbitrary criteria.
Changed:
<
<
>
>
  • Status item "GratingCycle" and "IndexInCycle" is now created for unchopped modes
 

Documentation

Revision 272011-05-23 - EkkehardWieprecht

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 178 to 178
 

Pipeline

Photometry

Added:
>
>
Improvements for SSO scan maps
Assuming the object move linear a linear interpolation between start and end position is done. This method provides 'smoother' coordinates especially for point source.

Old behavior :

frames = correctRaDec4Sso(frames, horizonsProduct=horizonsProduct, timeOffset=timeOffset, orbitEphem=orbitEphem)
frames = correctRaDec4Sso(frames, horizonsProduct=horizonsProduct, timeOffset=timeOffset, linear=1, orbitEphem=orbitEphem)
New implementation :
frames = correctRaDec4Sso(frames, horizonsProduct=horizonsProduct, timeOffset=timeOffset, linear=0, orbitEphem=orbitEphem) 

Aberration correction
Change the oder applying SIAM and Aberration correction in photAddInstantPointing and specAddInstantPointing . This shall have very minor impact on the coordinates, but correct reverse order of uplink.
 

Spectroscopy

Calibration

Photometry

Added:
>
>
Flux calibration
The photometer flux calibration has changed (new response calibration file "FM, 6"). Absolute fluxes of point-sources will change by less than 5%, extended sources will change by 10-20%. Aperture photometry of point-sources requires from now on the application of new aperture correction factors, taking into account that there is still significant flux beyond 60 arcsec.
These new correction factors (together with the old ones) are stored in: PCalPhotometer_ApertureCorrection_FM_v2.fits and can be retrieved via the new task photApertureCorrectionPointSource to be applied after annularSkyAperturePhotometry .
See also the update of PACS ipipe script Menu -> Pipeline -> PACS -> Photometer -> Copped point source -> standard pipeline -> L3_pointSourceAperturePhotometry.py
You need to update your local calibration tree Menu to activate it (Menu -> Tools -> PACS_CAL -> run Updater).
You may check by printing the calibration tree :
HIPE> c=getCalTree()
HIPE> print c.photometer

MadMap
New calibration files containing the actual 'best' calibration data for MadMap : PCalPhotometer_InvnttBL_FM_v4.fits
PCalPhotometer_InvnttBS_FM_v4.fits
PCalPhotometer_InvnttRed_FM_v4.fits
You need to update your local calibration tree Menu to activate it (Menu -> Tools -> PACS_CAL -> run Updater).
You may check by printing the calibration tree :
HIPE> c=getCalTree()
HIPE> print c.photometer
 

Spectroscopy

Analysis tools

Added:
>
>

Slicing

  • Saving intermediate data on machines with low memory is now done more clever: The slices are only saved to the temporary pool when the memory usage is more than 75% and the sliced product contains more than one slice.
  • The temporary pools of HIPE are now written under a directory 'null value' which is created where you start HIPE ( HcssSpr:12911 ).
    Workaround: Set the following property in your user.props file:
hcss.ia.pg.temporalpoolparent = ${user.home}/.hcss/lstore

These temporary pools are called tmp_product_sink_NNNNN

 

Photometry

Added:
>
>
  • A new Mask Array Viewer displays Masks with their correct size (also the timeline).
  • Add start time of last cooler recycling to meta data of products A new calibration product was introduced : CoolerRecyclingTimes
    • A convenience tool times = extractCoolerRecTimes(obs, calTree) returns the last cooler recycling of an observation
    • This file will be updated on a regular base
 

Spectroscopy

Added:
>
>
  • Map2signalCubeTask gets an additional shortcut: m2sc (besides map2signalCube)
  • Spectrum Explorer : New extension panel to edit masks is now fully working
  • Spectrum Explorer : Performance improvements
 

Product changes

Added:
>
>
  • calTree version is now in meta data of products

 

Photometry

Spectroscopy

Added:
>
>
  • Frames and PacsCube meta data is made consistent for every product change (like select or join)
  • Additional meta keywords added: onOffSource, minWave, maxWave, nodCycle, lineId
  • All masks which are not excluded in rebinning are propagated from PacsCube to PacsRebinnedCube. They can be obtained with the getFlag() method which returns a Flag dataset, which is similar to a PACS mask.
  • We have now two more sliced products: SlicedPacsCube? and SlicedPacsRebinnedCube?. SlicedPacsCube? offers the same functionality as SlicedFrames?, but SlicedPacsRebinnedCube? has limited functionality, since it does not have a blocktable. Add, remove and replace work, but selection should be done with the pacsSelectSlices task.

Each slice is described by the following slice info meta keywords (recognizable by description prefix "SLICE_INFO:"):

Keyword Values Description
lineId 0..N Numerical ID of a distinct wavelength range (usually a line scan)
lineDescription string Which spectral line has been observed (or tells that it is a range scan)
nodPosition A/B Nodding position
nodCycleNum 1..N Nodding cycle number
isOffPosition false/true Is it an off position according to the IsOutOfField status?
onOffSource 0,1,2 Based on new ONSOURCE/OFFSOURCE Status keywords: 0 = not science, 1 = on-source, 2 = off-source
rasterId N M first value: raster column, second value: raster line
calBlock false/true Belongs to slice to a calibration block?
minWave float Minimum wavelength of range
maxWave float Maximum wavelength of range
aotMode string AOT mode

Also, since these keywords are now always consistent with the BlockTable and Status contents they can and should be used for slice selection. The new task pacsSelectSlices does this meta-keyword based selection. It has the same interface as the selectSlices Python function.

  • The wavelength grid is now also stored in a list context
    • All level-2 tasks now do an internal loop over line ID. They behave now the same as the level-0/1 tasks: If you do not select a particular line/range before then the level-2 tasks just process all lines/ranges. As a consequence the level-2 products have changed a bit:
    • The wavelength grid is now also stored in a list context, since one needs to pass several ranges from task to task.
    • We no longer have a list context for each line ID within another list context: All slices of a level-2 product are now stored in a single list context. This is much more practical when selecting slices based on arbitrary criteria.
 

Documentation

Added:
>
>
 

SPIRE

Revision 262011-05-23 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 10 to 10
 

HIPE

Added:
>
>

Jython editor

  • Find/Replace dialog enhanced. It now can show whitespace characters.
  • Autoindentation of Jython improved.
  • Indent and unindent buttons added to the toolbar.

Console

  • Incremental search (Ctrl+I) available.
  • Console help text enhanced.
  • New internal commands !clear, !help and !history added.

History

  • Detailed error can be opened by double-click in the history table.

Jobs control

  • Progress bar shows the current line number of the executing script.
 

Plotting

TablePlotter

OverPlotter

Revision 252011-05-02 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 211 to 211
 
Changes to existing Tasks
  • WaveletDeglitcherTask now offers the option to make the number of corrected samples dependent on the glitch size by setting the optionReconstruction parameter to "adaptative" or "adaptativeLinear".
  • SpecFluxConversionTask no longer automatically removes non-seeing channels. One must now use FilterChannelsTask to remove these channels from SpectrometerDetectorSpectrum products.
Added:
>
>
  • SpecFluxConversionTask now precedes SpecTelescopeCorrectionTask in the Standard pipelines.
  • SpecTelescopeCorrectionTask now, by default, subtracts only a model of the Herschel telescope and not the model multiplied by the RSRF for Telescope (Sky) port.
 

Level 1 to Level 2

New Tasks

Revision 242011-05-02 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 210 to 210
 

Level 0.5 to Level 1

Changes to existing Tasks
  • WaveletDeglitcherTask now offers the option to make the number of corrected samples dependent on the glitch size by setting the optionReconstruction parameter to "adaptative" or "adaptativeLinear".
Changed:
<
<
  • SpecFluxConversionTask no longer automatically removes non-seeing channels. One must now use FilterChannelsTask to remove these channels from SpectrometerDetectorSpectrum products.
>
>
  • SpecFluxConversionTask no longer automatically removes non-seeing channels. One must now use FilterChannelsTask to remove these channels from SpectrometerDetectorSpectrum products.
 

Level 1 to Level 2

New Tasks
Line: 219 to 219
 
Changes to existing Tasks
  • NaiveProjectionTask now creates a spectral cube containing error instead of weight.
Changed:
<
<
  • AverageSpectraTask no longer provides functionality to remove out-of-band spectral samples. One must use RemoveOutOfBandTask instead.
  • AverageSpectraTask no longer provides functionality to reject outlier from the average computation.
>
>
  • AverageSpectraTask no longer provides functionality to remove out-of-band spectral samples. One must use RemoveOutOfBandTask instead.
  • AverageSpectraTask no longer provides functionality to reject outlier from the average computation.
 

Interactive Analysis and Tools

  • New task DestriperTask to iteratively remove the relative offsets between Level-1 detector timelines of the same detector array, and thus removing the stripes in the Level-2 map. Signal timelines are re-sampled from a preliminary naive map and subtracted from the original timelines. The resulting offset functions are modeled as polynomials with default degree (n=0) and subtracted. A new naive map is generated from the new difference of original signal and polynomial for the next iteration. The bright source threshold is used to suppress the influence of strong spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.

Revision 232011-05-02 - TrevorFulton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 204 to 204
 
  • The mosaicing of maps from overlapping observations in a proposal is now fully functional (this is actually available from 6.1).

Spectrometer Pipeline

Changed:
<
<
  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
  • New task GriddingProjectionTask for spectral cube creation. Given SpirePreprocessedCube input, GriddingProjectionTask outputs a spectral cube. It uses HIFI's GriddingTask to perform the mapping.
  • NaiveProjectionTask now outputs a spectral cube containing error instead of weight.
  • WaveletDeglitcherTask offers the option to make the number of corrected samples dependent on the glitch size by setting the "optionReconstruction" parameter to 'adaptative' or 'adaptativeLinear'.
  • AverageSpectraTask no longer provides remove out of band data functionality. Use RemoveOutOfBandTask to remove out of band data from SpectrometerDetectorSpectrum products.
  • AverageSpectraTask no longer provides outlier rejection functionality.
  • SpecFluxConversionTask no longer filters channels. Use FilterChannelsTask to filter channels from SpectrometerDetectorSpectrum products.
>
>

Level 0 to Level 0.5

No changes.

Level 0.5 to Level 1

Changes to existing Tasks
  • WaveletDeglitcherTask now offers the option to make the number of corrected samples dependent on the glitch size by setting the optionReconstruction parameter to "adaptative" or "adaptativeLinear".
  • SpecFluxConversionTask no longer automatically removes non-seeing channels. One must now use FilterChannelsTask to remove these channels from SpectrometerDetectorSpectrum products.

Level 1 to Level 2

New Tasks
  • SpireProduct2SimpleSpectrumTask to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
  • GriddingProjectionTask for spectral cube creation. Given SpirePreprocessedCube input, GriddingProjectionTask produces a spectral cube output. This task uses HIFI's GriddingTask.

Changes to existing Tasks
  • NaiveProjectionTask now creates a spectral cube containing error instead of weight.
  • AverageSpectraTask no longer provides functionality to remove out-of-band spectral samples. One must use RemoveOutOfBandTask instead.
  • AverageSpectraTask no longer provides functionality to reject outlier from the average computation.
 

Interactive Analysis and Tools

  • New task DestriperTask to iteratively remove the relative offsets between Level-1 detector timelines of the same detector array, and thus removing the stripes in the Level-2 map. Signal timelines are re-sampled from a preliminary naive map and subtracted from the original timelines. The resulting offset functions are modeled as polynomials with default degree (n=0) and subtracted. A new naive map is generated from the new difference of original signal and polynomial for the next iteration. The bright source threshold is used to suppress the influence of strong spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.

Revision 222011-04-26 - AnthonySmith

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 27 to 27
 

Other functions

Source extraction

Added:
>
>
  • Various internal changes have been made to the Source Extractor tasks, but no changes to the functionality.
 

Images

Display

Line: 213 to 214
 

Interactive Analysis and Tools

  • New task DestriperTask to iteratively remove the relative offsets between Level-1 detector timelines of the same detector array, and thus removing the stripes in the Level-2 map. Signal timelines are re-sampled from a preliminary naive map and subtracted from the original timelines. The resulting offset functions are modeled as polynomials with default degree (n=0) and subtracted. A new naive map is generated from the new difference of original signal and polynomial for the next iteration. The bright source threshold is used to suppress the influence of strong spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.
Added:
>
>
  • New tasks BaselineRemovalMedianTask and BaselineRemovalPolynomialTask operate on SPIRE Level-1 data to remove a baseline from the data. This is necessary due to the residual baseline that remains in the Level-1 data, which can produce stripes in the map if not removed. For each bolometer, the signal timeline is taken, either for each scan line separately, or for the whole observation as one long timeline. Then either the median value is subtracted (BaselineRemovalMedianTask), or a polynomial is fit to the data and subtracted. These tasks can be thought of as a "lite" version of the DestriperTask: they are simpler and faster, but for some observations containing a lot of structure (such as Galactic cirrus), there will be significant improvement if the DestriperTask is used.
 

Documentation

  • Pipeline Specification Manual: Entries on spectroscopy have been reviewed, examples have been validated.

Revision 212011-04-21 - BernhardSchulz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 212 to 212
 
  • SpecFluxConversionTask no longer filters channels. Use FilterChannelsTask to filter channels from SpectrometerDetectorSpectrum products.

Interactive Analysis and Tools

Changed:
<
<
  • New task DestriperTask to remove the offset from Level-1 data and thus remove the stripes in the Level-2 map. The offset is modeled as a polynomial with default degree (n=0). The bright source threshold is used to eliminate the spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.
>
>
  • New task DestriperTask to iteratively remove the relative offsets between Level-1 detector timelines of the same detector array, and thus removing the stripes in the Level-2 map. Signal timelines are re-sampled from a preliminary naive map and subtracted from the original timelines. The resulting offset functions are modeled as polynomials with default degree (n=0) and subtracted. A new naive map is generated from the new difference of original signal and polynomial for the next iteration. The bright source threshold is used to suppress the influence of strong spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.
 

Documentation

  • Pipeline Specification Manual: Entries on spectroscopy have been reviewed, examples have been validated.

Revision 202011-04-21 - LijunZhang

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 212 to 212
 
  • SpecFluxConversionTask no longer filters channels. Use FilterChannelsTask to filter channels from SpectrometerDetectorSpectrum products.

Interactive Analysis and Tools

Added:
>
>
  • New task DestriperTask to remove the offset from Level-1 data and thus remove the stripes in the Level-2 map. The offset is modeled as a polynomial with default degree (n=0). The bright source threshold is used to eliminate the spikes in the data. The primary output is a SpireListContext containing updated PointedPhotTimelines. The additional outputs are a SimpleImage map, the convergence ratio, Tod etc.
 

Documentation

  • Pipeline Specification Manual: Entries on spectroscopy have been reviewed, examples have been validated.

Revision 192011-04-20 - SteveGuest

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 75 to 75
 

Product Access Layer

Added:
>
>
  • The HTTP pool now supports digest as well as basic authentication.
 

Tasks

The default Task GUI has been improved with the following upgrades:

Line: 175 to 177
 

Calibration Products

  • Spectrometer calibration products for nominal detector settings have been updated to make use of in-flight bolometer model parameters.
Added:
>
>
  • An updated TempDriftCorr product allows a new algorithm in the Signal Jump Detector module to be used (nominal mode only).
 

Calibration Framework

Changed:
<
<
The spireCal task has new features and modified behaviour:
>
>
  • The spireCal task has new features and modified behaviour:
 
  • It will look for a calibration tree in a local pool by default. The default is the one that was last saved if applicable; otherwise the default for the HIPE version.
  • It will only download from the HSA if explicitly requested via the calTree parameter.
  • Optionally the tree can be saved to a local pool. In this case that one will become the default.
Added:
>
>
    • The trees available in the archive can be listed.
  • The API has new methods for showing differences between two calibration trees and for verifying that expected metadata is present and correct.
 

Preprocessing

Line: 195 to 200
 

Photometer Pipeline

  • The LpfResponseCorrectionTask now accepts a new optional, boolean input parameter "doMirrorSignal". Setting this parameter to true, the task will perform the correction, by mirroring the signal time-lines in the y-axis. The effect of this is to avoid any edge-ringing, resulting from the default correction method when applied to timelines with a large slope. The draw-back of the new method is that it can double the processing time of the Task, however, not to a detrimental effect to single observation processing (It will definitely be noticeable when processing a large number of observations).
Added:
>
>
  • The mosaicing of maps from overlapping observations in a proposal is now fully functional (this is actually available from 6.1).
 

Spectrometer Pipeline

  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products

Revision 182011-04-18 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 16 to 16
 

Dataset viewer

Astronomical utilities

Changed:
<
<
>
>
RadialVelocity task and util class renamed to RadialV and now use the proper Doppler sign convention.
 

Numeric routines

Data fitting

Data interpolation

Line: 77 to 77
 

Tasks

Added:
>
>
The default Task GUI has been improved with the following upgrades:
  • Parameter error detection (red X) also checks the validator of the parameter
  • A new Help button gives easy direct access to the URM description of the task
  • White space in layout moved to the lower part of the panel
  • Editors based on text fields now require half the width
  • Labels of parameters have now a maximum size to reserve space for the editors.
  • Support for grouping inputs in multiple Tabs. For tasks that have inputs related to different aspects or simply a lot of them, they can be presented in several tabs.

There is now a detailed outline shown in the Outline View when a task is selected in the Task View. This allows inspection of the structure of a task without the need to either use the Console or open its GUI in the Editor. Also, the system is undergoing a review of task compliancy (naming, documentation, tooltips ...) that will make all tasks self-explanatory (ongoing for HIPE 8).

 

Quality control

Systematic product generation

Data input-output

Added:
>
>
  • simpleFitsReader and simpleFitsWriter now also support reading/writting Datasets (not just Products).
  • The Export View now shows the tags associated with each Observation version.
  • The localStoreWriter task now allows to add a tag to the saved product.
  • Now, when you use the contextual menu to save a product variable you will use the Save to Pool tool instead of the localStoreWriter task.
  • localStoreWriter and localStoreCopier now use a better integrated GUI to select-create a pool.
  • File filters for file dialogs are now self-explanatory (accepted extensions ...).
  • The clear task now has a simplified syntax to delete all variables (clear() without any parameter, will delete all).

 

Virtual Observatory

Revision 172011-04-17 - PeterDavis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 153 to 153
 

SPIRE

Calibration Products

Added:
>
>
  • Spectrometer calibration products for nominal detector settings have been updated to make use of in-flight bolometer model parameters.
 

Calibration Framework

Line: 172 to 173
 
    • scanVelocityLimits: Double1d([lowerVelocityLimit, upperVelocityLimit]), in arcsec/sec, defining a range of scan Velocities. Signal samples with angular velocity outside this range will have their NON_NOMINAL_VELOCITY mask set. Setting this parameter, parameter "scanVelocityTolerance" will be ignored. Setting any velocity limit to a negative value, the task will ignore the scanVelocityLimits parameter and revert to using "scanVelocityTolerance".

Photometer Pipeline

Changed:
<
<
  • The LpfResponseCorrectionTask now accepts a new optional, boolean input parameter "doMirrorSignal". Setting this parameter to true, the task will berform the correction, by mirroring the signal time-lines in the y-axis. The effect of this is to avoid any edge-ringing, resulting from the default correction method when applied to timelines with a large slope. The draw-back of the new method is that it can double the processing time of the Task, however, not to a detrimental effect to single observation processing (It will definately be noticeable when processing a large number of observations).
>
>
  • The LpfResponseCorrectionTask now accepts a new optional, boolean input parameter "doMirrorSignal". Setting this parameter to true, the task will perform the correction, by mirroring the signal time-lines in the y-axis. The effect of this is to avoid any edge-ringing, resulting from the default correction method when applied to timelines with a large slope. The draw-back of the new method is that it can double the processing time of the Task, however, not to a detrimental effect to single observation processing (It will definitely be noticeable when processing a large number of observations).
 

Spectrometer Pipeline

  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
  • New task GriddingProjectionTask for spectral cube creation. Given SpirePreprocessedCube input, GriddingProjectionTask outputs a spectral cube. It uses HIFI's GriddingTask to perform the mapping.
  • NaiveProjectionTask now outputs a spectral cube containing error instead of weight.
Added:
>
>
  • WaveletDeglitcherTask offers the option to make the number of corrected samples dependent on the glitch size by setting the "optionReconstruction" parameter to 'adaptative' or 'adaptativeLinear'.
 
  • AverageSpectraTask no longer provides remove out of band data functionality. Use RemoveOutOfBandTask to remove out of band data from SpectrometerDetectorSpectrum products.
  • AverageSpectraTask no longer provides outlier rejection functionality.
  • SpecFluxConversionTask no longer filters channels. Use FilterChannelsTask to filter channels from SpectrometerDetectorSpectrum products.
Line: 185 to 187
 

Interactive Analysis and Tools

Documentation

Changed:
<
<
Change.
>
>
  • Pipeline Specification Manual: Entries on spectroscopy have been reviewed, examples have been validated.
 

Revision 162011-04-15 - DavidSharpe

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 178 to 178
 
  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
  • New task GriddingProjectionTask for spectral cube creation. Given SpirePreprocessedCube input, GriddingProjectionTask outputs a spectral cube. It uses HIFI's GriddingTask to perform the mapping.
  • NaiveProjectionTask now outputs a spectral cube containing error instead of weight.
Added:
>
>
  • AverageSpectraTask no longer provides remove out of band data functionality. Use RemoveOutOfBandTask to remove out of band data from SpectrometerDetectorSpectrum products.
  • AverageSpectraTask no longer provides outlier rejection functionality.
  • SpecFluxConversionTask no longer filters channels. Use FilterChannelsTask to filter channels from SpectrometerDetectorSpectrum products.
 

Interactive Analysis and Tools

Revision 152011-04-15 - PaulBalm

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 66 to 66
 

Calibration sources

Added:
>
>
We have integrated the Calibration Source Database into HIPE. There is a Calibrators View on the Workbench (you may have to reset the perspective for it to appear).

The Calibrators View allows access to the database with calibration sources at ESAC, that is used by HSC calibration scientists. It contains spectra of planets, asteroids, and fixed targets. The data can be viewed in the usual HIPE viewers for spectra and images, and manipulated using Jython commands.

 

Products and datasets

Observation context

Revision 142011-04-14 - AndreasPapageorgiou

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 168 to 168
 
    • scanVelocityLimits: Double1d([lowerVelocityLimit, upperVelocityLimit]), in arcsec/sec, defining a range of scan Velocities. Signal samples with angular velocity outside this range will have their NON_NOMINAL_VELOCITY mask set. Setting this parameter, parameter "scanVelocityTolerance" will be ignored. Setting any velocity limit to a negative value, the task will ignore the scanVelocityLimits parameter and revert to using "scanVelocityTolerance".

Photometer Pipeline

Added:
>
>
  • The LpfResponseCorrectionTask now accepts a new optional, boolean input parameter "doMirrorSignal". Setting this parameter to true, the task will berform the correction, by mirroring the signal time-lines in the y-axis. The effect of this is to avoid any edge-ringing, resulting from the default correction method when applied to timelines with a large slope. The draw-back of the new method is that it can double the processing time of the Task, however, not to a detrimental effect to single observation processing (It will definately be noticeable when processing a large number of observations).
 

Spectrometer Pipeline

  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products

Revision 132011-04-07 - PeterKennedy

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 171 to 171
 

Spectrometer Pipeline

  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
Added:
>
>
  • New task GriddingProjectionTask for spectral cube creation. Given SpirePreprocessedCube input, GriddingProjectionTask outputs a spectral cube. It uses HIFI's GriddingTask to perform the mapping.
  • NaiveProjectionTask now outputs a spectral cube containing error instead of weight.
 

Interactive Analysis and Tools

Revision 122011-04-06 - SteveGuest

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 152 to 152
 

Calibration Framework

Added:
>
>
The spireCal task has new features and modified behaviour:
  • It will look for a calibration tree in a local pool by default. The default is the one that was last saved if applicable; otherwise the default for the HIPE version.
  • It will only download from the HSA if explicitly requested via the calTree parameter.
  • Optionally the tree can be saved to a local pool. In this case that one will become the default.
 

Preprocessing

Engineering Conversion

Revision 112011-03-31 - RoBaS

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 41 to 41
 

Spectra

Display

Analysis

Changed:
<
<
  • Addition to SpectrumFitter: create ASCII file with fit parameters (not yet in SpectrumFitterGUI). Use:
>
>
  • Addition to SpectrumFitter: create ASCII file with fit parameters. Use in the command line:
 
    • sf = SpectrumFitter(...)
    • ...
    • m = sf.addModel(...)
Line: 49 to 49
 
    • sf.doFit( ) or sf.doGlobalFit( )
    • sf.saveFitParametersAsASCII(fileName) # writes parameters of all models to fileName
    • m.toASCII(dirName) # writes parameters to dirName/[modelname].txt
Changed:
<
<
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, a poly and gauss will be fitted, if switched off, nothing.
>
>
  • The SpectrumFitterGUI has, in the export TAB, also the possibility to export fit parameters to file.
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, the user can select from:
    • Instrument specific initial model.
    • User specific initial models - the user can specify the models.
  • Addition to SpectrumFitterGUI, MultiTAB:
    • Some information on what will happen.
    • Fit parameters are written to file.
    • A count-down progress bar.
 

Data cubes

Display

Revision 102011-03-30 - AndreasPapageorgiou

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 150 to 150
 

Engineering Conversion

Common Pipeline

Added:
>
>
  • The AssociateSkyPositionTask now creates a new table "avgVelocity" in photometer level1 scanmap products. The table contains two columns: "sampleTime" (TAI) and "avgVelocity" (deg/sec)
  • The AssociateSkyPositionTask now now accepts two new optional parameters:
    • scanVelocityTolerance: double value, in arcsec/sec, defining the scan velocity tolerance relative the the mode's expected scan velocity. Signal samples outside this range will have their NON_NOMINAL_VELOCITY mask set. (default: 1.0"/sec)
    • scanVelocityLimits: Double1d([lowerVelocityLimit, upperVelocityLimit]), in arcsec/sec, defining a range of scan Velocities. Signal samples with angular velocity outside this range will have their NON_NOMINAL_VELOCITY mask set. Setting this parameter, parameter "scanVelocityTolerance" will be ignored. Setting any velocity limit to a negative value, the task will ignore the scanVelocityLimits parameter and revert to using "scanVelocityTolerance".
 

Photometer Pipeline

Spectrometer Pipeline

Added:
>
>
  • New task SpireProduct2SimpleSpectrumTask, to convert SPIRE Level-1 and Level-2 data to SimpleSpectrum products
 

Interactive Analysis and Tools

Revision 92011-03-25 - CarolynMcCoey

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 41 to 41
 

Spectra

Display

Analysis

Changed:
<
<
>
>
  • Addition to SpectrumFitter: create ASCII file with fit parameters (not yet in SpectrumFitterGUI). Use:
    • sf = SpectrumFitter(...)
 
    • ...
    • m = sf.addModel(...)
    • ...
    • sf.doFit( ) or sf.doGlobalFit( )
    • sf.saveFitParametersAsASCII(fileName) # writes parameters of all models to fileName
    • m.toASCII(dirName) # writes parameters to dirName/[modelname].txt
Changed:
<
<
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, a poly and gauss will be fitted, if switched off, nothing.
>
>
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, a poly and gauss will be fitted, if switched off, nothing.
 

Data cubes

Display

Line: 85 to 85
 

HIFI Calibration

HIFI Pipeline

Added:
>
>
  • doPipelineConfiguration now passes changes to the level 2 pipeline. To use this task, pass an HTP to the GUI (doPipelineConfiguration), modify the pipeline steps as required. Press accept (default name of output is out) then pass this new configuration to the pipeline task:
obs_new = hifiPipeline(obs=obs, params=out, save=False)
 

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

Line: 100 to 103
 

HIFI Data Processing Tools

Standing Wave Removal

Added:
>
>
  • averscan option has been removed as it was found not to work well
 

Baseline Removal

Added:
>
>
  • The htpcopy option has been removed
 

Deconvolution

Added:
>
>
  • doDeconvolution now produces a result even if deconvolution fails. In this case an error message is given
  • doDeconvolution now read flags from USB, rather than LSB. Channel flags have always been read from the USB so this change makes it easier for you to pass flagged data to the task
 

Spectral Cube creation

HiClass export tool

Added:
>
>
  • Obsid now exported again to CLASS header
 

Documentation

Revision 82011-03-23 - RoBaS

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 41 to 41
 

Spectra

Display

Analysis

Added:
>
>
  • Addition to SpectrumFitter: create ASCII file with fit parameters (not yet in SFGUI). Use:
    • sf = SpectrumFitter(...)
    • ...
    • m = sf.addModel(...)
    • ...
    • sf.doFit( ) or sf.doGlobalFit( )
    • sf.saveFitParametersAsASCII(fileName) # writes parameters of all models to fileName
    • m.toASCII(dirName) # writes parameters to dirName/[modelname].txt
  • Addition to SpectrumFitterGUI: user preference for initial models. If switched on, a poly and gauss will be fitted, if switched off, nothing.
 

Data cubes

Display

Revision 72011-03-15 - DavidSharpe

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 138 to 138
 

Interactive Analysis and Tools

Documentation

Added:
>
>
Change.
 

Revision 62011-03-15 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 138 to 138
 

Interactive Analysis and Tools

Documentation

\ No newline at end of file
Added:
>
>
<--  
-->
 \ No newline at end of file

Revision 52011-03-09 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 31 to 31
 

Images

Display

  • Adapted the popup menu to make it possible to work with axes, add a compass and add a scale.
Added:
>
>
  • Display now returns the commands done using the popup menu to the HIPE console. This makes it very easy to reconstruct an image plot from within a script.
 
  • When dragging source positions to an image, the circles are locked. When dragging contours to an image, the contours are also locked.
  • Added method addArcSecs to add a line of a number of arcseconds to the image.
  • When using the opacity slider with a cube, the next image is used as the underlying image, not the next layer of the cube anymore.

Revision 42011-03-04 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 30 to 30
 

Images

Display

Added:
>
>
  • Adapted the popup menu to make it possible to work with axes, add a compass and add a scale.
 
  • When dragging source positions to an image, the circles are locked. When dragging contours to an image, the contours are also locked.
  • Added method addArcSecs to add a line of a number of arcseconds to the image.
  • When using the opacity slider with a cube, the next image is used as the underlying image, not the next layer of the cube anymore.

Revision 32011-02-03 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 32 to 32
 

Display

  • When dragging source positions to an image, the circles are locked. When dragging contours to an image, the contours are also locked.
  • Added method addArcSecs to add a line of a number of arcseconds to the image.
Added:
>
>
  • When using the opacity slider with a cube, the next image is used as the underlying image, not the next layer of the cube anymore.
 

Analysis

Added:
>
>
  • You can now load all monochrome or indexed gif files using importRgbImageTask
 

Spectra

Display

Revision 22011-02-01 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

Line: 30 to 30
 

Images

Display

Added:
>
>
  • When dragging source positions to an image, the circles are locked. When dragging contours to an image, the contours are also locked.
  • Added method addArcSecs to add a line of a number of arcseconds to the image.
 

Analysis

Spectra

Revision 12011-01-21 - DavideRizzo

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="HipeWhatsNew"

What's New in HIPE 7

PDF Version Click here

Core system

HIPE

Plotting

TablePlotter

OverPlotter

Dataset viewer

Astronomical utilities

Numeric routines

Data fitting

Data interpolation

Random numbers

Statistics

Trend analysis

Mapping

Other functions

Source extraction

Images

Display

Analysis

Spectra

Display

Analysis

Data cubes

Display

Analysis

Herschel Science Archive

Calibration sources

Products and datasets

Observation context

Product Access Layer

Tasks

Quality control

Systematic product generation

Data input-output

Virtual Observatory

Installer

Documentation

HIFI

HIFI Software Configuration and Properties

HIFI Calibration

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

HIFI Products

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

HIFI Data Processing Tools

Standing Wave Removal

Baseline Removal

Deconvolution

Spectral Cube creation

HiClass export tool

Documentation

PACS

Pipeline

Photometry

Spectroscopy

Calibration

Photometry

Spectroscopy

Analysis tools

Photometry

Spectroscopy

Product changes

Photometry

Spectroscopy

Documentation

SPIRE

Calibration Products

Calibration Framework

Preprocessing

Engineering Conversion

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

Interactive Analysis and Tools

Documentation

 
This site is powered by the TWiki collaboration platform Powered by Perl