Difference: HipeWhatsNew11x (1 vs. 70)

Revision 702013-12-02 - ElenaPuga

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 329 to 329
 

Spectroscopy

Deleted:
<
<
  • Many improvements in the Chop/Nod pointing correction script.
 
  • Simplified fitting cubes and support projecting fitted parameters by using the new (Pacs)ParameterCube.
    • Introduced a new script for fitting and then projecting.
  • Tasks specRespCalToTelescope and specRespCalToBackground are now merged.

Revision 692013-10-17 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 130 to 130
 
  • When selecting plots/axes during an Align or Lock operation (by holding the Control key pressed, and clicking with the mouse), selected plots/axes are marked with blue lines.
  • New options Save and Print are available in the popup menu of the mosaic panel.
  • Icons of the toolboxes buttons pretend now to be more obvious.
Changed:
<
<
  • Numer of different colours to plot spectra increased from 7 to 10. Consecutive colours are now more distinguishable.
>
>
  • Number of different colours to plot spectra increased from 7 to 10. Consecutive colours are now more distinguishable.
 
  • When a spectrum task is going to be executed on a product belonging to a context tree, user confirmation is required.

Analysis

  • SpectrumFitterGUI has undergone some changes such as a new layout which includes a revamp of the "export" panel.

Revision 682013-07-29 - RolandVavrek

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 31 to 31
 
    • Level 3 products generated in the standard product generation (SPG) pipeline.
  • Spectrometer:
    • Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.
Added:
>
>
    • Spectrometer RSRF band R1 provides correct line fluxes in red leak region (beyond 190 microns). This RSRF is not applied by default since it increases the noise in the resulting spectrum, but can be used interactively within Hipe.
    • Update of the spectrometer telescope background model with new parameter set representing the aging model of the optical surface.
 SPIRE
  • Photometer:
    • Update to flux calibration to use new Neptune model (the ESA4 model instead of the ESA2 model).

Revision 672013-07-29 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 66 to 66
 

Editors & Viewers

Deleted:
<
<
  • When opened, the Observation viewer navigates automatically to a node of the browse product, to give a first impression of the observation contents.
 
  • Edition of product's metadata through the GUI does not allow to remove mandatory parameters (product's attributes).
  • The search dialogue for text editors is now more user-fiendly:
    • It focuses the text pane once opened, so the user doesn't need to click on it.
Line: 126 to 125
 

Spectra

Display

Changed:
<
<
  • When selecting plots during an Align or Lock operation (by holding the Control key pressed, and clicking with the mouse), selected plots are marked with a blue rectangle.
  • Options Save and Print available in the popup menu of the mosaic panel.
>
>
  • When selecting plots/axes during an Align or Lock operation (by holding the Control key pressed, and clicking with the mouse), selected plots/axes are marked with blue lines.
  • New options Save and Print are available in the popup menu of the mosaic panel.
 
  • Icons of the toolboxes buttons pretend now to be more obvious.
  • Numer of different colours to plot spectra increased from 7 to 10. Consecutive colours are now more distinguishable.
  • When a spectrum task is going to be executed on a product belonging to a context tree, user confirmation is required.

Revision 662013-07-27 - BartVandenbussche

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 340 to 340
 
  • Improved the pseudo WCS coordinates of PACS (rebinned) cubes, which contain just the row/column coordinates of their RA and Dec cubes.
  • Improved the background subtraction schemes in the unchopped pipelines.
  • Error propagation added to specProject.
Deleted:
<
<
  • New tool for computing flux corrections for small extended sources.
 

Calibration

Line: 353 to 352
 
  • Improved telescope background calibration file.
  • New calibration files with high resolution beams per spaxel.
  • Improved telescope emissivity model calibration file.
Added:
>
>
  • Relative spectral response updates to cover the edges of the spectral bands
  • Relative spectral response function for the red leak region (for use in hipe)
 

Analysis tools

Revision 652013-07-26 - SteveGuest

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 432 to 432
 

Photometer Pipeline

Added:
>
>
  • New definition of Level 2.5 and Level 3 products. Level 2.5 is now much more homogenised with PACS and contains single pairs of nominal and orthogonal SPIRE destriped parallel maps. The new Level 3 products are similar to the old Level 2.5 maps, but with different units (MJy/ster rather than Jy/beam). They contain mosaics of overlapping regions from a given program using the absolute calibrated maps from the Planck zero point.
 

Spectrometer Pipeline

  • Level-1 spectra are now averaged over scans by the pipeline (although level-1 interferograms remain unaveraged). This reduces the size of the observation context. The mapping algorithm has been updated to correctly propagate the errors when averaged scans are used. The individual scans can still be examined by running the pipeline script (either from the beginning or starting with the interferograms).

Revision 642013-07-26 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 220 to 220
 

hifiPipeline task

  • The option to choose a different CAL version via the hifiPipelineGUI is now fixed.

Level 0 Pipeline

Added:
>
>
  • Ephemeris positions of SSOs (ra_centre/dec_centre) were off by up to ~10" due to a bug; this is fixed in HIPE 11.
 

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Revision 632013-07-26 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 24 to 24
 
  • flagTool enhanced to allow better and simpler flagging of data for reprocessing.
  • Updates to CleanDF and spur tables and ghost identifications.
  • Improved performance of standing waves and baseline removal tasks.
Added:
>
>
  • doPointing now uses the proper identifier in the orbit ephemeris product for a given SSO.
 PACS
  • Photometer:
    • Level 2.5 MADmap maps now contain error maps.

Revision 622013-07-25 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 30 to 30
 
    • Level 3 products generated in the standard product generation (SPG) pipeline.
  • Spectrometer:
    • Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.
Deleted:
<
<
    • Many improvements in the Chop/Nod pointing correction script.
 SPIRE
  • Photometer:
    • Update to flux calibration to use new Neptune model (the ESA4 model instead of the ESA2 model).

Revision 612013-07-25 - BrunoMerin

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 17 to 17
 

Highlights

HIPE

Changed:
<
<
  • New indexing for pools. This results in faster search for local products but requires rebuilding the index when going back to previous versions. More information can be found at [http://herschel.esac.esa.int/twiki/bin/view/Public/HipeKnownIssues#Known_issues_in_HIPE_11].
  • Pointing products for ODs < 320 have been updated improving astrometry by a few arcseconds. TBD
>
>
  • New indexing for pools. This results in faster search for local products but requires rebuilding the index when going back to previous versions. More information can be found here.
  • Star tracker focal-length induced offsets of less than 5 arcsec have been corrected for data from ODs < 320.
  • Combined pipeline and aperture photometry script for PACS scanmaps of point sources.
 HIFI
  • flagTool enhanced to allow better and simpler flagging of data for reprocessing.
Changed:
<
<
  • Updates to CleanDF and spur tables and ghost identifications.
>
>
  • Updates to CleanDF and spur tables and ghost identifications.
 
  • Improved performance of standing waves and baseline removal tasks.
PACS
  • Photometer:
Line: 29 to 30
 
    • Level 3 products generated in the standard product generation (SPG) pipeline.
  • Spectrometer:
    • Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.
Changed:
<
<
    • Many improvements in the Chop/Nod pointing correction script.
>
>
    • Many improvements in the Chop/Nod pointing correction script.
 SPIRE
  • Photometer:
    • Update to flux calibration to use new Neptune model (the ESA4 model instead of the ESA2 model).
  • Spectrometer:
    • The telescope and instrument RSRFs have been updated to produce 20% lower instrument noise.
Changed:
<
<
>
>
    • The beam FWHM inside the SCalSpecBeamParam product has been updated.
 

Core system

HIPE

Line: 456 to 458
 

Documentation

Added:
>
>

Release Notes

  • Full list of tickets implemented: here.
 


Revision 602013-07-25 - BrunoAltieri

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 317 to 317
 
  • Masked out matrix 9 after OD 1375.
  • Level 3 processing.
  • Deglitching improvements.
Changed:
<
<
  • Many improvements to scanamorphous.
>
>
  • Many improvements to scanamorphos.
 
  • Better treatment of removal of calibration blocks.
  • Improved noise computations.
  • Improved memory handling.

Revision 592013-07-25 - AlvarGarcia

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 17 to 17
 

Highlights

HIPE

Changed:
<
<
>
>
  • New indexing for pools. This results in faster search for local products but requires rebuilding the index when going back to previous versions. More information can be found at [http://herschel.esac.esa.int/twiki/bin/view/Public/HipeKnownIssues#Known_issues_in_HIPE_11].
  • Pointing products for ODs < 320 have been updated improving astrometry by a few arcseconds. TBD
 HIFI
Changed:
<
<
>
>
  • flagTool enhanced to allow better and simpler flagging of data for reprocessing.
  • Updates to CleanDF and spur tables and ghost identifications.
  • Improved performance of standing waves and baseline removal tasks.
 PACS
Changed:
<
<
>
>
  • Photometer:
    • Level 2.5 MADmap maps now contain error maps.
    • Level 3 products generated in the standard product generation (SPG) pipeline.
  • Spectrometer:
    • Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.
    • Many improvements in the Chop/Nod pointing correction script.
 SPIRE
Changed:
<
<
>
>
  • Photometer:
    • Update to flux calibration to use new Neptune model (the ESA4 model instead of the ESA2 model).
  • Spectrometer:
    • The telescope and instrument RSRFs have been updated to produce 20% lower instrument noise.
    • The beam FWHM inside the SCalSpecBeamParam product has been updated.
 

Core system

HIPE

Revision 582013-07-22 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 204 to 204
 

HIFI Pipeline

hifiPipeline task

Added:
>
>
  • The option to choose a different CAL version via the hifiPipelineGUI is now fixed.
 

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Revision 572013-06-27 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 139 to 139
 

Tasks

Users

Changed:
<
<
  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
>
>
  • Warning, important Jython code with calls to tasks with multiple outputs must be updated: see User manual.
 
  • JTask deprecated, use Task instead (just remove the J).
Changed:
<
<
  • Warning message when a task shows 100% in the progress bar and stays there for a long time (bad progress reporting of the task)
>
>
  • Warning message when a task shows 100% in the progress bar and stays there for a long time (bad progress reporting of the task).
 

Developers

Changed:
<
<
  • You can link to external help by providing your own URL String with documentation implementing herschel.ia.gui.kernel.parts.ExternalHelp
  • You can now mark parameters as not shown in the GUI (see TaskParameter.setHasGui)
  • Framework now provides also a layout with just one column (one parameter per row) (see JTaskSignatureComponentNarrow and Wiki )
  • Added more methods and classes to Task GUIs to ease alternative implementations and customisations
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator should not be applicable ever), see Task.canBeApplicable
  • Interrupted tasks now throw CancellationException (was plain RuntimeException)
  • Task parameters can now be of type Class
  • Renamed Task.getHistory() and Task.setHistory()
>
>
  • You can link to external help by providing your own URL String with documentation implementing herschel.ia.gui.kernel.parts.ExternalHelp.
  • You can now mark parameters as not shown in the GUI (see TaskParameter.setHasGui).
  • Framework now provides also a layout with just one column (one parameter per row) (see JTaskSignatureComponentNarrow and Wiki ).
  • Added more methods and classes to Task GUIs to ease alternative implementations and customisations.
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator should not be applicable ever), see Task.canBeApplicable.
  • Interrupted tasks now throw CancellationException (was plain RuntimeException).
  • Task parameters can now be of type Class.
  • Renamed Task.getHistory() and Task.setHistory() (to Task.isHistoryRecordingEnabled() and Task.setHistoryRecordingEnabled() respectively).
 
  • Added methods to NameSpaceTest to test deprecation and removal of task parameters.
Line: 164 to 164
 
  • A focal length correction script is applied to the pointing product for all ODs up to 866 (excluding OD 858)

Data input-output

Changed:
<
<
  • Import View and importObservation are deprecated : use MyHSA
  • save and restore : extension is now ".ser", can be opened by double clicking in Navigator
  • localStoreCopier : parameters renamed, "warn" default is now True
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now gz (was gzip)
  • fitsReader & import*: Truncated (missing padding) FITS files can now be read
  • asciiTableReader : Warning, important ONGOING
    • Parameters renamed, descriptions improved, info log messages with configuration
    • columnType (was parserGuess) now supports (and prints) also String values (besides integers)
>
>
  • Import View and importObservation are deprecated : use MyHSA.
  • save and restore : the file extension is now ".ser", they can be opened by double clicking in the Navigator view.
  • localStoreCopier : parameters have been renamed, "warn" default value is now True.
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now ".gz" (it was ".gzip").
  • fitsReader & import tasks: Truncated (missing padding) FITS files can now be read by the system.
  • asciiTableReader : Warning, important Table I/O is being simplified: you will have to change your calls just once
    • Parameters renamed, descriptions improved, info log messages with configuration.
    • columnType (old name: parserGuess) now supports (and prints) also String values (besides integers).
 
    • tableType: improved support for the different types of tables.
Changed:
<
<
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)
  • asciiTableWriter : Warning, important ONGOING
>
>
    • skipRows (old name:parserSkip): is now a "basic" parameter (can be used also with tableType <> ADVANCED).
  • asciiTableWriter : Warning, important Table I/O is being simplified: you will have to change your calls just once
 
    • Parameters renamed, descriptions improved
Changed:
<
<
  • convertUnits: Converts numeric data expressed in one unit, in terms of another unit. Warning, important ONGOING
  • convertData : PROTOTYPE convert angle array data (strings) into numerical data, Warning, important ONGOING
  • decompress : Decompress task is opened when double clicking compressed files in the Navigator
>
>
  • convertUnits: Converts numeric data expressed in one unit, in terms of another unit.
  • convertAngles : Converts angle array data between string and numeric representations.
  • decompress : When double clicking compressed files in the Navigator the task will be opened.
 

Revision 562013-06-25 - JingjingLi

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 67 to 67
 As previously, the complete command history can be obtained by running !history, and a specific command can be recovered by its index through !<index>.

Plotting

Added:
>
>
  • A new axis type TAI
  • Bug fixes
 

TablePlotter

OverPlotter

Revision 552013-06-25 - LiBo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 133 to 133
 

Product Access Layer

  • The format of a PAL browser result table is now automatically persisted over multiple HIPE sessions.
Added:
>
>
  • The underlying Apache Lucene library is upgraded from 3.0 to 4.1. Local stores generated in earlier version need to run rebuild index to be accessed.
 

Tasks

Users

Revision 542013-06-19 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 281 to 281
 
    • Updates to "HIFI Baseline Removal" chapter, "FitBaseline Options" section
    • Updates to "Standing Wave Removal" chapter
    • Updates to "Exporting HIFI data to CLASS" chapter
Added:
>
>
    • Corrected typos and bad/missing links
 

PACS

Revision 532013-06-19 - ThanosTsounis

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 156 to 156
 

Systematic product generation

Added:
>
>

Pointing Product

  • Solar Aspect Angle was added to the Pointing Product
  • A focal length correction script is applied to the pointing product for all ODs up to 866 (excluding OD 858)
 

Data input-output

  • Import View and importObservation are deprecated : use MyHSA
  • save and restore : extension is now ".ser", can be opened by double clicking in Navigator

Revision 522013-06-19 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 110 to 110
 

Spectra

Display

Added:
>
>
  • When selecting plots during an Align or Lock operation (by holding the Control key pressed, and clicking with the mouse), selected plots are marked with a blue rectangle.
  • Options Save and Print available in the popup menu of the mosaic panel.
  • Icons of the toolboxes buttons pretend now to be more obvious.
  • Numer of different colours to plot spectra increased from 7 to 10. Consecutive colours are now more distinguishable.
  • When a spectrum task is going to be executed on a product belonging to a context tree, user confirmation is required.
 

Analysis

Changed:
<
<
  • SpectrumFitterGui has undergone some changes such as a new layout which includes a revamp of the "export" panel
>
>
  • SpectrumFitterGUI has undergone some changes such as a new layout which includes a revamp of the "export" panel.
 
  • A new Sinc-Gauss profile is available for use with the fitter. This is needed for extragalactic sources which may have partially resolved spectral lines.

Data cubes

Revision 512013-06-19 - MarcoSoldati

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 127 to 127
 

Observation context

Product Access Layer

Added:
>
>
  • The format of a PAL browser result table is now automatically persisted over multiple HIPE sessions.
 

Tasks

Users

Line: 176 to 177
 

Installer

Documentation

Added:
>
>
  • Documentation viewer is loaded significantly faster.
  • Search indexes are created at build time (faster start up of local help system)
  • Search provides more accurate results, new auto completion algorithm
 

HIFI

Revision 502013-06-19 - StephanOtt

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
Changed:
<
<

What's coming up in HIPE 11

>
>

What's new in HIPE 11

 
PDF Version Click here
Line: 13 to 13
 
Deleted:
<
<

Planned work

HIPE

  • Star tracker distortion (2nd level of pointing correction)
  • move to Java 7 (with the exception of Versant)
  • Upgrade to lucene 4.1
  • Restructuring of ACMS to support improved pointing reconstruction
  • Framework to generate level 2.5 and level 3 products (systematic and on-demand)
  • improvement of SPG interface for DP TAs to ease future reprocessing exercises
  • reduction of start-up time for HIPE
  • improvements to ASCII tables reading and writing
  • improvements to task registration and management
  • batch mode for HIPE (instead of jylaunch)
  • removal of ia_toolbox_spectrum_gui (old spectrum explorer)
  • replacement of HSA perspective by data access perspective
  • improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • Completion of CalSDB interface into HIPE
  • Pagination of HSA query results to improve response time for users (avoiding a long response time for HIPE)
  • Editing functionality of table and array datasets, including insertion of changed product into observation context and history recording of the changes
  • Irregular grid 2-d interpolation
  • Bug fixes for table explorer
  • documentation improvements for Binstruct
  • Display
    • Various bug fixes
    • aperture photometry improvements
    • design error and warnings reports fixes
    • test coverage improvements (drastic)
    • WCS matching of images
    • sourcefitting errors
    • import of rgb images
  • CSAT
    • Improve the moment algorithm for computeVelocityMap
    • Support for the new ParameterCube product (viewer)
    • Add rectangular selection
    • GUI improvements
  • Fixing the outstanding SxRs for the PDD
  • Addressing performance issues in PAL

HIFI

  • Investigation of performance issues for HIFI pipeline
  • HIFI uplink product
  • Update of spur-finder to improve data quality
  • Update of calibration table
  • Move to Java 7
  • Improvements to HEB standing wave mitigation prototype tool
  • Improvements to sideband ratio

PACS

general

  • Package / code cleanup
  • Search for further memory leaks / reduction/optimisation of memory use
  • Test harness coverage improvements
  • move to Java 7

Photometer

  • error maps provided by madmap
  • Improved calblock filtering
  • Scanamorphos HIPE implementation
<--   * Improvements in baseline drift correction : removed (Bruno A.) as not coming in Hipe 11-->

Spectrometer

  • ipipe script high flux pointing loss correction
  • Background subtraction improvements
  • specProject/drizzle improvements
  • Flatfielding improvements
  • Product improvements
  • Calibration improvements
  • general Ipipe improvements
  • User scripts: mapping of line fit parameters

SPIRE

general

  • move to Java 7

Photometer

  • New definition of Level 2.5 and Level 3 products in the archive Level 2.5 follows PACS list and contains single pairs of nominal and orthogonal SPIRE destriped parallel maps (Homogenization with PACS) Level 3 will be any overlapping region from a given program using the absolute calibrated maps from the Planck zero point

  • New extended calibration framework
    • Improved Calibration Scheme for extended sources taking into account the changing size of the beam across the band, including the colour corrections for point and extended sources for a given spectral index
    • Correction coefficients in the form of a Calibration table
  • Improved cross-calibration with Planck (TBC)
  • Map Projections for Na´ve Mapper: Implementation of different WCS and pixel minimization into map maker
  • Source Extraction
    • maintenance and improvements
    • Development of source subtractor
  • CInteractive Level-2 deglitcher tool

Spectrometer

  • Top level
    • Bright mode processing to be done in voltage pipeline (reduces size of calibration tree)
    • Updates to the telescope model calibration product (to include recent data)
    • H+L processing - LR part of these observations to be properly dealt with by pipeline
    • Updated instrument and telescopeRsrf calibration products (lower noise, presentation at the Herschel Calibration Workshop, March 2013, is here)
    • Level-1 spectral products to be averaged (reduced size of observation context)

  • Software:
    • Wavelet deglitcher - tuning of spectrometer parameters
    • Remove temperature drift correction task from pipeline script (it makes no difference to the output!)
    • Minor updates/corrections to useful scripts
    • Add the final resolution used in the processing to the observation context metadata
    • Viewing teleModel calibration products in SDS Explorer
    • Update MAD deglitching (2nd level deglitching) parameters for obs. with >30 reps
    • Improve memory usage when threading
    • Semi-extended tool improvements (including documentation in the DRG)
    • Sinc-Gauss function for the fitter
    • Updates to the mouse click procedure used for SDS Explorer
    • Convolution Mapper
    • WCS handling updates
    • Naive mapper algorithm updated for error propagation
 

Highlights

Revision 492013-06-18 - AnthonyMarston

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 307 to 307
 

HIFI Calibration

  • Updates to CleanDF tables
  • Update of spur table after 3b purification at higher end
Changed:
<
<
  • Ghost frames, when identified, are now removed
>
>
  • Ghost frames, where previously identified in specific observations, are now removed automatically in the HIFI pipeline
 

HIFI Pipeline

hifiPipeline task

Line: 315 to 315
 

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Changed:
<
<
  • doFold task now allow for overwrite=True
>
>
  • doFold task now allow for overwrite=True when handling frequency switch observations
 

Level 2 Pipeline

Level 2.5 Pipeline

Revision 482013-06-17 - IvanV

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 537 to 537
 
  • Spectrometer Level1 Mask Editor is available.
  • A new semiExtendedCorrector task is available for correcting point source spectra for slightly-extended sources
Changed:
<
<
  • A new "convolutionProjection" mapper is available for spectrometer data. The map maker used by the standard pipeline is still the Naive Map maker. The new convolution mapper is very similar to the HIFI gridding projection (distributing the signal from each detector across multiple pixels using a kernel), but allows a frequency dependent kernal.
>
>
  • A new "convolutionProjection" mapper is available for spectrometer data. The map maker used by the standard pipeline is still the Naive Map maker. The new convolution mapper is very similar to the HIFI gridding projection (distributing the signal from each detector across multiple pixels using a kernel), but allows a frequency dependent kernel.
 
  • Update to the SDS/SDI Explorer - now a plot is launched with a single mouse click on a detector in the footprint. A second click removes the spectrum from the plot.
  • Minor updates/corrections to useful scripts
  • spireProduct2SimpleSpectrum is now more flexible, and can combine two spectra into one SimpleSpectrum

Revision 472013-06-11 - EdwardPolehampton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 511 to 511
 

Calibration Framework

Changed:
<
<
  • The way that jiggled RSRF files are selected for spectrometer mapping observations was improved. This may affect maps made before OD1011.
>
>
  • The way that jiggled RSRF files are selected for spectrometer mapping observations was improved. This may affect (improve) maps made before OD1011.
 

Preprocessing

Line: 526 to 526
 
  • Level-1 spectra are now averaged over scans by the pipeline (although level-1 interferograms remain unaveraged). This reduces the size of the observation context. The mapping algorithm has been updated to correctly propagate the errors when averaged scans are used. The individual scans can still be examined by running the pipeline script (either from the beginning or starting with the interferograms).
  • Point source calibrated data are now included in the Level-2 product for unvignetted detectors - previously only the central detectors were included.
  • Bright mode observations are now processed using the same pipeline as nominal mode. This leads to higher accuracy in bright mode observations (although the overall change from HIPE v10 is <10%).
Changed:
<
<
  • The way that the WCS is calculated for mapping observations was optimised - a small change to the grid used for some maps (SpireWcsCreator and WcsCreator).
>
>
  • The way that the WCS is calculated for mapping observations was optimised (in SpireWcsCreator) - this means that the grid used for mapping observations is different to previous versions (although pixel sizes remain unchanged). The exact pixel position of NaN values in the final Level-2 cube does change due to the shift in the grid compared to the observed sky positions.
 
  • The temperature drift correction task was removed from the pipeline - this task made no difference to the output spectra.
  • Spectral cubes now have the correct final resolution in their metadata
  • Second level deglitching parameters were optimised for observations with greater than 30 repetitions
Line: 541 to 541
 
  • Update to the SDS/SDI Explorer - now a plot is launched with a single mouse click on a detector in the footprint. A second click removes the spectrum from the plot.
  • Minor updates/corrections to useful scripts
  • spireProduct2SimpleSpectrum is now more flexible, and can combine two spectra into one SimpleSpectrum
Added:
>
>
  • A new task to extract point sources from mapping observations has been added (specPointSourceExtractor).
  Photometer

Revision 462013-05-22 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 167 to 167
 
  • Compressed files can be opened with either double click or right click and Open With.
  • The default folder that is offered in file dialogues when opening or saving files is now customizable. The behaviour can be set in the General > Directories preferences panel.
Changed:
<
<

Data Access

>
>

Data Access & HSA

 
  • There is a new Data Access Perspective, bundling all functionality needed to get data in and out of HIPE.
Changed:
<
<
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well
>
>
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well.
  • HIPE now shows the currently logged in user on the status bar, next to a lock icon. If no user is logged in, one can double-click the icon to log in. Also, if no user is logged in and log-in information is required, rather than failing, HIPE will now pop up a log-in window, allowing the user to specify username and password.
 

Editors & Viewers

Line: 243 to 244
 
  • Added rectangular and line selection to extractRegionSpectrum
  • Several improvements in computePVmap
Deleted:
<
<

Herschel Science Archive

HIPE now shows the currently logged in user on the status bar, next to a lock icon. If no user is logged in, one can double-click the icon to log in. Also, if no user is logged in and log-in information is required, rather than failing, HIPE will now pop up a log-in window, allowing the user to specify username and password.

 

Calibration sources

Products and datasets

Revision 452013-05-20 - MarkRKidger

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 399 to 399
 

Pipeline

Added:
>
>
  • The PACS spectrometer pipeline has now been fully threaded.
    • This gives an approximately 20% improvement in processing time over the previous version.
 
  • Improvements in the multi-threaded running of tasks on slices.
    • This can now be turned on/off without needing to restart HIPE.
    • Stability improved: all tasks have been checked for thread safety.

Revision 442013-05-17 - IvanV

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 119 to 119
 
    • Bright mode processing to be done in voltage pipeline (reduces size of calibration tree)
    • Updates to the telescope model calibration product (to include recent data)
    • H+L processing - LR part of these observations to be properly dealt with by pipeline
Changed:
<
<
    • Updated instrument and telescopeRsrf calibration products (lower noise, as presented to SDAG)
>
>
    • Updated instrument and telescopeRsrf calibration products (lower noise, presentation at the Herschel Calibration Workshop, March 2013, is here)
 
    • Level-1 spectral products to be averaged (reduced size of observation context)

  • Software:

Revision 432013-05-16 - AnthonySmith

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 204 to 204
 

Other functions

Source extraction

Added:
>
>
  • sourceExtractorSimultaneous now has a region of interest (roi) parameter
 

Images

Display

Line: 233 to 234
 

Display

Analysis

  • SpectrumFitterGui has undergone some changes such as a new layout which includes a revamp of the "export" panel
Added:
>
>
  • A new Sinc-Gauss profile is available for use with the fitter. This is needed for extragalactic sources which may have partially resolved spectral lines.
 

Data cubes

Display

Line: 524 to 526
 
  • Level-1 spectra are now averaged over scans by the pipeline (although level-1 interferograms remain unaveraged). This reduces the size of the observation context. The mapping algorithm has been updated to correctly propagate the errors when averaged scans are used. The individual scans can still be examined by running the pipeline script (either from the beginning or starting with the interferograms).
  • Point source calibrated data are now included in the Level-2 product for unvignetted detectors - previously only the central detectors were included.
  • Bright mode observations are now processed using the same pipeline as nominal mode. This leads to higher accuracy in bright mode observations (although the overall change from HIPE v10 is <10%).
Changed:
<
<
  • The way that the WCS is calculated for mapping observations was optimised - a small change to the grid used for some maps.
>
>
  • The way that the WCS is calculated for mapping observations was optimised - a small change to the grid used for some maps (SpireWcsCreator and WcsCreator).
 
  • The temperature drift correction task was removed from the pipeline - this task made no difference to the output spectra.
  • Spectral cubes now have the correct final resolution in their metadata
  • Second level deglitching parameters were optimised for observations with greater than 30 repetitions
Line: 534 to 536
 Spectrometer

  • Spectrometer Level1 Mask Editor is available.
Changed:
<
<
  • Semi-extended correction tool is available for Spectrometer data
  • A new "convolution" mapper is available. The map maker used by the standard pipeline is still the Naive Map maker. The new convolution mapper is very similar to the HIFI gridding projection, but allows a frequency dependent kernal.
  • A new Sinc-Gauss profile is available for use with the fitter. This is needed for extragalactic sources which may have partially resolved spectral lines.
>
>
  • A new semiExtendedCorrector task is available for correcting point source spectra for slightly-extended sources
  • A new "convolutionProjection" mapper is available for spectrometer data. The map maker used by the standard pipeline is still the Naive Map maker. The new convolution mapper is very similar to the HIFI gridding projection (distributing the signal from each detector across multiple pixels using a kernel), but allows a frequency dependent kernal.
 
  • Update to the SDS/SDI Explorer - now a plot is launched with a single mouse click on a detector in the footprint. A second click removes the spectrum from the plot.
  • Minor updates/corrections to useful scripts
Added:
>
>
  • spireProduct2SimpleSpectrum is now more flexible, and can combine two spectra into one SimpleSpectrum

Photometer

  • convolutionMapper has a new weightKernel parameter, so that the signal from the bolometers can be distributed across multiple pixels when making a map
 

Documentation

Revision 422013-05-16 - EdwardPolehampton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 521 to 521
 

Spectrometer Pipeline

Added:
>
>
  • Level-1 spectra are now averaged over scans by the pipeline (although level-1 interferograms remain unaveraged). This reduces the size of the observation context. The mapping algorithm has been updated to correctly propagate the errors when averaged scans are used. The individual scans can still be examined by running the pipeline script (either from the beginning or starting with the interferograms).
  • Point source calibrated data are now included in the Level-2 product for unvignetted detectors - previously only the central detectors were included.
  • Bright mode observations are now processed using the same pipeline as nominal mode. This leads to higher accuracy in bright mode observations (although the overall change from HIPE v10 is <10%).
  • The way that the WCS is calculated for mapping observations was optimised - a small change to the grid used for some maps.
  • The temperature drift correction task was removed from the pipeline - this task made no difference to the output spectra.
  • Spectral cubes now have the correct final resolution in their metadata
  • Second level deglitching parameters were optimised for observations with greater than 30 repetitions
 

Interactive Analysis and Tools

Changed:
<
<
  • Spectrometer Level1 Mask Editor is available in Hipe 11.
>
>
Spectrometer

  • Spectrometer Level1 Mask Editor is available.
  • Semi-extended correction tool is available for Spectrometer data
  • A new "convolution" mapper is available. The map maker used by the standard pipeline is still the Naive Map maker. The new convolution mapper is very similar to the HIFI gridding projection, but allows a frequency dependent kernal.
  • A new Sinc-Gauss profile is available for use with the fitter. This is needed for extragalactic sources which may have partially resolved spectral lines.
  • Update to the SDS/SDI Explorer - now a plot is launched with a single mouse click on a detector in the footprint. A second click removes the spectrum from the plot.
  • Minor updates/corrections to useful scripts
 

Documentation

Revision 412013-05-14 - MarkRKidger

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

Revision 402013-05-14 - PedroGarciaLario

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 545 to 545
 

META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1355232763" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"

Revision 392013-05-13 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 308 to 308
 

HIFI Calibration

  • Updates to CleanDF tables
  • Update of spur table after 3b purification at higher end
Added:
>
>
  • Ghost frames, when identified, are now removed
 

HIFI Pipeline

hifiPipeline task

Revision 382013-05-07 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 232 to 232
 

Spectra

Display

Analysis

Added:
>
>
  • SpectrumFitterGui has undergone some changes such as a new layout which includes a revamp of the "export" panel
 

Data cubes

Display

Line: 305 to 306
 

HIFI Software Configuration and Properties

HIFI Calibration

Added:
>
>
  • Updates to CleanDF tables
  • Update of spur table after 3b purification at higher end
 

HIFI Pipeline

hifiPipeline task

Revision 372013-05-03 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 334 to 334
 
  • fitBaseline domask=2 option (automated masking) now works in non-interactive mode as well, and can be interrupted using the HIPE 'stop' button.
  • On the command line, the output is retrieved using out=fitBaseline(..) for all input types.

Deconvolution

Changed:
<
<
>
>
  • Improvements to the display of SScan browse products.
  • Improvements to the treatment of weights within deconvolution.
  • The deconvolution task can now be interrupted using the red 'stop' button in HIPE.
 

Spectral Cube creation

flagTool

  • Major change

Revision 362013-05-01 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 383 to 383
 
    • Improvements and updates to pipeline level 0 doPointing section and examples
    • Updates to HIFI Tips of the Day
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter
Added:
>
>
    • Updates to "HIFI Baseline Removal" chapter, "FitBaseline Options" section
    • Updates to "Standing Wave Removal" chapter
    • Updates to "Exporting HIFI data to CLASS" chapter
 

PACS

Revision 352013-05-01 - EdwardPolehampton

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 480 to 480
 

Calibration Products

Added:
>
>

Photometer

  • Update to flux calibration to use new Neptune model (the ESA4 model instead of the ESA2 model).
  • The temperature drift correction and extended gains calibration products are also updated to be consistent with the new flux conversion.

Spectrometer

  • The telescope and instrument RSRFs have been updated to have much higher signal-to-noise. This is due to a new method that makes it possible to increase the number of observations used to derive them. The consequence of this is that long observations have up to 20% lower noise level.
  • The beam FWHM inside the SCalSpecBeamParam product has been updated to be consistent with the 2D beam profiles contained in the SCalSpecBeamProf product, and to contain numbers taken from the beam profile paper (Makiwa et al., Applied Optics, in press 2013).
  • The telescope model correction was improved by including recent days in the derivation of the calibration product - this improves the continuum shape of recent observations of faint targets.
  • Calibration products were updated to allow bright mode observations to be processed in the same pipeline as nominal mode observations:
    • The non-linearity correction product for bright mode was updated
    • The bright mode gains calibration product was updated
    • The SCalSpecNomPcal product was removed (no longer needed as functionality incorporated into the bright gains calibration product)
    • All bright mode specific editions of the RSRFs and beam parameter file were removed - both bright and nominal pipelines now use the same products.
    • The channel time constant product was updated to allow bright mode specific time constants to be stored - this functionality is not yet used, but is ready for a future HIPE version.
 

Calibration Framework

Added:
>
>
  • The way that jiggled RSRF files are selected for spectrometer mapping observations was improved. This may affect maps made before OD1011.
 

Preprocessing

Engineering Conversion

Revision 342013-04-29 - AdwinBoogert

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 326 to 326
 

HIFI Data Processing Tools

Standing Wave Removal

  • New parameter 'resolution' used internally to speed up the fitHifiFringe task. The default is 10 MHz and should be reduced for processing of spectra with standing wave periods less than about 30 MHz (non-HIFI spectra).
Added:
>
>
  • Defaults for input parameters fitHifiFringe (nfringes, typical_period, start_period, and end_period) are automatically set to optimal values, matching standing waves in each HIFI band.
 

Baseline Removal

  • New fitBaseline parameter 'useWbs' allows subtraction of WBS polynomials from HRS spectra.
  • fitBaseline reacts much better to HIPE 'stop' button.

Revision 332013-04-26 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 381 to 381
 
    • Addition of the pipeline level 1 mkDbsRefTask definition
    • Improvements and updates to pipeline level 0 doPointing section and examples
    • Updates to HIFI Tips of the Day
Added:
>
>
    • Regular updates to the Quality Flags Table in the "Flags in HIFI data" chapter
 

PACS

Revision 322013-04-25 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 337 to 337
 

Spectral Cube creation

flagTool

* Major change
Changed:
<
<
  • flagTool can now handle rowflags
>
>
  * Improvements of the global behaviour:
Changed:
<
<
  • Each subband has a given color
>
>
    • Each subband has a given colour
 
  • Annotations are on the left-hand side of the plot
  • Better handle of compound flag names
Changed:
<
<
  • Scan the data to find flags and create the correspondings masks if necessary while launching flagTool
>
>
    • Scan the data to find flags and create the corresponding masks if necessary while launching flagTool
 
  • Improve display of the information when scanning the htp and the maskTable
  • The selection of a subband can be done with left-click in the interactive table
Line: 351 to 350
  * Improvements of the GUI:
  • Use parameter level in flagTool
  • Set dropdown menus for selecting values of some parameters
Changed:
<
<
  • rowflag is selected by choosing "category=rowflag"
  • both rowflag and channel flags can selected by choosing "category=both"
>
>
    • Rowflag is selected by choosing "category=rowflag"
    • Both rowflag and channel flags can be selected by choosing "category=both"
  * Bug fixes:
  • Crashes when deleting existing masks
  • Doesn't flag in response to mouse clicks
  • Adding a marker removes the previous one
Changed:
<
<
  • Crashes because it uses a deleted method for converting the colors of the flags
>
>
    • Crashes because it uses a deleted method for converting the colours of the flags
 
  • Fix annotation issues
  • Linemasks file not showing all masks after the first flagTool run
  • FlagTool should apply FitBaseline and FitHifiFringe only on the selected dataset row
Line: 364 to 362
 
Deleted:
<
<
 

HiClass export tool

Added:
>
>
  • Improvements of the global behaviour
    • A default filename is provided if the user forgets it
    • Append ".fits" to filename if the user forgets it

  • Improvements of the GUI
    • Add "verbose" checkbox

  • Bug fixes
    • HiClassTask accepts input and then complains
    • Inverted velocity axis when exporting from HIPE to CLASS
 

Documentation

  • Updates to the HIFI Data Reduction Guide:
Line: 491 to 496
 
<-- COMMENT BOX CODE - DO NOT EDIT -->
Changed:
<
<
<div id="disqu
>
>
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

<--  
-->
 
META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1355232763" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"

Revision 312013-04-24 - DamienRabois

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 336 to 336
 

Spectral Cube creation

flagTool

Added:
>
>
* Major change
  • flagTool can now handle rowflags

* Improvements of the global behaviour:

  • Each subband has a given color
  • Annotations are on the left-hand side of the plot
  • Better handle of compound flag names
  • Scan the data to find flags and create the correspondings masks if necessary while launching flagTool
  • Improve display of the information when scanning the htp and the maskTable
  • The selection of a subband can be done with left-click in the interactive table

* Improvements of the GUI:

  • Use parameter level in flagTool
  • Set dropdown menus for selecting values of some parameters
  • rowflag is selected by choosing "category=rowflag"
  • both rowflag and channel flags can selected by choosing "category=both"

* Bug fixes:

  • Crashes when deleting existing masks
  • Doesn't flag in response to mouse clicks
  • Adding a marker removes the previous one
  • Crashes because it uses a deleted method for converting the colors of the flags
  • Fix annotation issues
  • Linemasks file not showing all masks after the first flagTool run
  • FlagTool should apply FitBaseline and FitHifiFringe only on the selected dataset row

 

HiClass export tool

Line: 461 to 491
 
<-- COMMENT BOX CODE - DO NOT EDIT -->
Changed:
<
<
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

<--  
-->
>
>
<div id="disqu
 
META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1355232763" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"

Revision 302013-04-23 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 237 to 237
 

Display

Analysis

Added:
>
>
  • Added rectangular and line selection to extractRegionSpectrum
  • Several improvements in computePVmap
 

Herschel Science Archive

HIPE now shows the currently logged in user on the status bar, next to a lock icon. If no user is logged in, one can double-click the icon to log in. Also, if no user is logged in and log-in information is required, rather than failing, HIPE will now pop up a log-in window, allowing the user to specify username and password.

Revision 292013-04-22 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 309 to 309
 

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Added:
>
>
  • doFold task now allow for overwrite=True
 

Level 2 Pipeline

Level 2.5 Pipeline

Revision 282013-04-22 - SylvieFBeaulieu

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 334 to 335
 

HiClass export tool

Documentation

Changed:
<
<
>
>
  • Updates to the HIFI Data Reduction Guide:
    • Addition of the Mapping Mode Cookbook
    • Improvements and updates to "How to add and remove flags" chapter: flagTool in the "Setting flags interactively for many spectra" section
    • Addition of the pipeline level 1 mkDbsRefTask definition
    • Improvements and updates to pipeline level 0 doPointing section and examples
    • Updates to HIFI Tips of the Day
 

PACS

Revision 272013-04-21 - JeroenDeJong

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 338 to 339
 

PACS

Pipeline

Added:
>
>
  • Improvements in the multi-threaded running of tasks on slices.
    • This can now be turned on/off without needing to restart HIPE.
    • Stability improved: all tasks have been checked for thread safety.
    • Improved memory handling.

 

Photometry

Added:
>
>
 
  • Error estimate for Level 2.5 MADmap maps. MADmap maps now include an error estimate per map pixel. The error is computed as for the photProject pipeline, but is then modified to reflect the same relative sensitivity between the High-pass filter branch and extended emission branch as determined for HSpot. For the naivemap error is the formal error of the mean. This is unchanged. The MADmap error is formal and likely optimistic than reality in that user diligence in preprocessing PACS pipelines and subsequent execution of MADmap pipeline with proper parameters is not accounted for. These could introduce systematical errors in the maps that are significantly larger than formal errors. We will try to account for such systematics in subsequent versions of the error analysis code for HIPE 12.
Added:
>
>
  • Masked out matrix 9 after OD 1375.
  • Level 3 processing.
  • Deglitching improvements.
  • Many improvements to scanamorphous.
  • Better treatment of removal of calibration blocks.
  • Improved noise computations.
  • Improved memory handling.
 

Spectroscopy

Added:
>
>
  • Many improvements in the Chop/Nod pointing correction script.
  • Simplified fitting cubes and support projecting fitted parameters by using the new (Pacs)ParameterCube.
    • Introduced a new script for fitting and then projecting.
  • Tasks specRespCalToTelescope and specRespCalToBackground are now merged.
  • Improved extracting spectra from a cube.
  • Improved the range scan flatfielding, including better diagnostic plots and avoiding noise with new RSRF.
  • Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.
    • The level-2 product will now contain flatfielded PACS cubes.
  • Improvements to the script to combine PACS and SPIRE spectra.
  • Improved the pseudo WCS coordinates of PACS (rebinned) cubes, which contain just the row/column coordinates of their RA and Dec cubes.
  • Improved the background subtraction schemes in the unchopped pipelines.
  • Error propagation added to specProject.
  • New tool for computing flux corrections for small extended sources.
 

Calibration

Added:
>
>
 

Photometry

Added:
>
>
  • Improved cooler recycling times calibration file.
 

Spectroscopy

Added:
>
>
  • Improved telescope background calibration file.
  • New calibration files with high resolution beams per spaxel.
  • Improved telescope emissivity model calibration file.
 

Analysis tools

Added:
>
>
  • Extension to tree viewers now available for all PACS sliced products.
    This means that also the outline viewer shows information about the slice content.

 

Photometry

Added:
>
>
 

Spectroscopy

Added:
>
>
  • Display shows now properly the special pseudo WCS of PACS rebinned (5x5) cubes.
  • The PACS extensions of the Spectrum Explorer have been improved:
    • Orientation of spaxel selector in Frames panel now represents the real orientation of the cube spaxels.
    • Excluding NaNs when creating the average image for the cube selection panel.
    • Fixed some problems when multiple products are loaded in the SE.

 

Product changes

Added:
>
>
  • An observation summary has been added to the browse product of an observation context (currently only available for the spectrometer).
  • Amount of details in the product history reduced: E.g., it no longer goes back to where a calibration file has been read by its creator.
  • Meta data sliceNumber added, which is used to add a slice number to the FITS filenames.

 

Photometry

Added:
>
>
 

Spectroscopy

Added:
>
>
  • A special product for parameter cubes: PacsParameterCube extends ParameterCube.
  • New sliced products have been added all SimpleCube derived products.
    The sliced framework utilities are now for all spectral cubes available.
  • Fixed some unit labels in various products.
  • Fixed orientation of browse image (was upside down).
  • Added lineId checking and updating when adding a slice to a spectrometer sliced product, so that the lineId will never conflict with existing ranges.
 

Documentation

Added:
>
>
  • Improved MadMap documentation.
  • Improved use cases and options description for interactive pipeline scripts.
  • Improved explanation of wavelength grid parameters. * Flatfielding has been added for line scans only to the standard product generation (SPG) pipeline.

  • New section on spectrometer drizzling.
  • Better documentation on how to fit cubes and then project them.
  • Many improvements to the data reduction guides.
 

SPIRE

Calibration Products

Revision 262013-04-19 - AdwinBoogert

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 326 to 326
 
  • fitBaseline reacts much better to HIPE 'stop' button.
  • New fitBaseline parameter 'plot' allows switching plotting in non-interactive mode off or on. The default mode is False, which speeds up the task and greatly reduces memory consumption.
  • fitBaseline domask=2 option (automated masking) now works in non-interactive mode as well, and can be interrupted using the HIPE 'stop' button.
Added:
>
>
  • On the command line, the output is retrieved using out=fitBaseline(..) for all input types.
 

Deconvolution

Spectral Cube creation

flagTool

Revision 252013-04-18 - AdwinBoogert

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 320 to 320
 

HIFI Data Processing Tools

Standing Wave Removal

Added:
>
>
  • New parameter 'resolution' used internally to speed up the fitHifiFringe task. The default is 10 MHz and should be reduced for processing of spectra with standing wave periods less than about 30 MHz (non-HIFI spectra).
 

Baseline Removal

Added:
>
>
  • New fitBaseline parameter 'useWbs' allows subtraction of WBS polynomials from HRS spectra.
  • fitBaseline reacts much better to HIPE 'stop' button.
  • New fitBaseline parameter 'plot' allows switching plotting in non-interactive mode off or on. The default mode is False, which speeds up the task and greatly reduces memory consumption.
  • fitBaseline domask=2 option (automated masking) now works in non-interactive mode as well, and can be interrupted using the HIPE 'stop' button.
 

Deconvolution

Spectral Cube creation

flagTool

Revision 242013-04-18 - BrunoAltieri

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 75 to 75
 

Photometer

Changed:
<
<
  • Level 2.5 errors
>
>
  • error maps provided by madmap
 
  • Improved calblock filtering
  • Scanamorphos HIPE implementation
Changed:
<
<
  • Improvements in baseline drift correction
>
>
<--   * Improvements in baseline drift correction : removed (Bruno A.) as not coming in Hipe 11-->
 

Spectrometer

Revision 232013-04-17 - BabarAli

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 333 to 333
 

Pipeline

Photometry

Added:
>
>
  • Error estimate for Level 2.5 MADmap maps. MADmap maps now include an error estimate per map pixel. The error is computed as for the photProject pipeline, but is then modified to reflect the same relative sensitivity between the High-pass filter branch and extended emission branch as determined for HSpot. For the naivemap error is the formal error of the mean. This is unchanged. The MADmap error is formal and likely optimistic than reality in that user diligence in preprocessing PACS pipelines and subsequent execution of MADmap pipeline with proper parameters is not accounted for. These could introduce systematical errors in the maps that are significantly larger than formal errors. We will try to account for such systematics in subsequent versions of the error analysis code for HIPE 12.
 

Spectroscopy

Calibration

Revision 222013-04-17 - LijunZhang

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 366 to 366
 

Spectrometer Pipeline

Interactive Analysis and Tools

Changed:
<
<
>
>
  • Spectrometer Level1 Mask Editor is available in Hipe 11.
 

Documentation


Revision 212013-04-16 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 256 to 256
 

Developers

  • You can link to external help by providing your own URL String with documentation implementing herschel.ia.gui.kernel.parts.ExternalHelp
  • You can now mark parameters as not shown in the GUI (see TaskParameter.setHasGui)
Changed:
<
<
  • Framework now provides also a layout with just one column (one parameter per row) (see JTaskSignatureComponentNarrow and Wiki
>
>
  • Framework now provides also a layout with just one column (one parameter per row) (see JTaskSignatureComponentNarrow and Wiki )
 
  • Added more methods and classes to Task GUIs to ease alternative implementations and customisations
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator should not be applicable ever), see Task.canBeApplicable
  • Interrupted tasks now throw CancellationException (was plain RuntimeException)
Line: 276 to 276
 
  • localStoreCopier : parameters renamed, "warn" default is now True
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now gz (was gzip)
  • fitsReader & import*: Truncated (missing padding) FITS files can now be read
Changed:
<
<
  • asciiTableReader :
>
>
  • asciiTableReader : Warning, important ONGOING
 
    • Parameters renamed, descriptions improved, info log messages with configuration
    • columnType (was parserGuess) now supports (and prints) also String values (besides integers)
    • tableType: improved support for the different types of tables.
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)
Changed:
<
<
  • asciiTableWriter :
>
>
  • asciiTableWriter : Warning, important ONGOING
 
    • Parameters renamed, descriptions improved
Changed:
<
<
  • convertUnits: Converts numeric data expressed in one unit, in terms of another unit.
  • convertData : PROTOTYPE convert angle array data (strings) into numerical data
>
>
  • convertUnits: Converts numeric data expressed in one unit, in terms of another unit. Warning, important ONGOING
  • convertData : PROTOTYPE convert angle array data (strings) into numerical data, Warning, important ONGOING
 
  • decompress : Decompress task is opened when double clicking compressed files in the Navigator

Revision 202013-04-15 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 256 to 256
 

Developers

  • You can link to external help by providing your own URL String with documentation implementing herschel.ia.gui.kernel.parts.ExternalHelp
  • You can now mark parameters as not shown in the GUI (see TaskParameter.setHasGui)
Changed:
<
<
  • Task parameters can now be of type Class
>
>
  • Framework now provides also a layout with just one column (one parameter per row) (see JTaskSignatureComponentNarrow and Wiki
  • Added more methods and classes to Task GUIs to ease alternative implementations and customisations
 
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator should not be applicable ever), see Task.canBeApplicable
  • Interrupted tasks now throw CancellationException (was plain RuntimeException)
Added:
>
>
  • Task parameters can now be of type Class
  • Renamed Task.getHistory() and Task.setHistory()
  • Added methods to NameSpaceTest to test deprecation and removal of task parameters.
 

Quality control

Revision 192013-04-15 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 249 to 249
 

Product Access Layer

Tasks

Added:
>
>

Users

 
  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
  • JTask deprecated, use Task instead (just remove the J).
Added:
>
>
  • Warning message when a task shows 100% in the progress bar and stays there for a long time (bad progress reporting of the task)

Developers

  • You can link to external help by providing your own URL String with documentation implementing herschel.ia.gui.kernel.parts.ExternalHelp
  • You can now mark parameters as not shown in the GUI (see TaskParameter.setHasGui)
 
  • Task parameters can now be of type Class
Changed:
<
<
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator)
>
>
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator should not be applicable ever), see Task.canBeApplicable
  • Interrupted tasks now throw CancellationException (was plain RuntimeException)
 

Quality control

Line: 265 to 271
 
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now gz (was gzip)
  • fitsReader & import*: Truncated (missing padding) FITS files can now be read
  • asciiTableReader :
Changed:
<
<
    • Parameters renamed, descriptions improved
>
>
    • Parameters renamed, descriptions improved, info log messages with configuration
 
    • columnType (was parserGuess) now supports (and prints) also String values (besides integers)
    • tableType: improved support for the different types of tables.
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)

Revision 182013-04-15 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 175 to 175
 

Editors & Viewers

  • When opened, the Observation viewer navigates automatically to a node of the browse product, to give a first impression of the observation contents.
Added:
>
>
  • Edition of product's metadata through the GUI does not allow to remove mandatory parameters (product's attributes).
 
  • The search dialogue for text editors is now more user-fiendly:
    • It focuses the text pane once opened, so the user doesn't need to click on it.
    • It shows an info label saying how to trigger the search with the keyboard: Ctrl+Enter.

Revision 172013-04-15 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 258 to 258
 

Systematic product generation

Data input-output

Added:
>
>
  • Import View and importObservation are deprecated : use MyHSA
 
  • save and restore : extension is now ".ser", can be opened by double clicking in Navigator
  • localStoreCopier : parameters renamed, "warn" default is now True
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now gz (was gzip)
Added:
>
>
  • fitsReader & import*: Truncated (missing padding) FITS files can now be read
 
  • asciiTableReader :
    • Parameters renamed, descriptions improved
    • columnType (was parserGuess) now supports (and prints) also String values (besides integers)
    • tableType: improved support for the different types of tables.
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)
Added:
>
>
  • asciiTableWriter :
    • Parameters renamed, descriptions improved
  • convertUnits: Converts numeric data expressed in one unit, in terms of another unit.
  • convertData : PROTOTYPE convert angle array data (strings) into numerical data
  • decompress : Decompress task is opened when double clicking compressed files in the Navigator
 

Virtual Observatory

Revision 162013-04-12 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 172 to 172
 
  • There is a new Data Access Perspective, bundling all functionality needed to get data in and out of HIPE.
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well
Changed:
<
<

Virtual Observatory

>
>

Editors & Viewers

 
Changed:
<
<
HIPE now supports sending Spectrum2d objects. When sending a 2-dimensional spectrum, HIPE will send all the plain spectra in sequence.
>
>
  • When opened, the Observation viewer navigates automatically to a node of the browse product, to give a first impression of the observation contents.
  • The search dialogue for text editors is now more user-fiendly:
    • It focuses the text pane once opened, so the user doesn't need to click on it.
    • It shows an info label saying how to trigger the search with the keyboard: Ctrl+Enter.
    • It does not lose the focus, so that multiple entries can be searched with the keyboard one after the other.
    • Undo/redo is available in the search text pane, by means of the usual key combinations.

Console

Commands in the history are indexed so that the first executed command in the current session has index 0. Commands in previous sessions have negative indices.

As previously, the complete command history can be obtained by running !history, and a specific command can be recovered by its index through !<index>.

 

Plotting

TablePlotter

Line: 257 to 268
 
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)
Deleted:
<
<
 

Virtual Observatory

Added:
>
>
HIPE now supports sending Spectrum2d objects. When sending a 2-dimensional spectrum, HIPE will send all the plain spectra in sequence.
 

Installer

Documentation

Revision 152013-04-12 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 240 to 240
 
  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
  • JTask deprecated, use Task instead (just remove the J).
  • Task parameters can now be of type Class
Added:
>
>
  • Tasks can veto applicability (ex. a task whose prime input is a String but has a validator)
 

Quality control

Systematic product generation

Data input-output

Added:
>
>
  • save and restore : extension is now ".ser", can be opened by double clicking in Navigator
 
  • localStoreCopier : parameters renamed, "warn" default is now True
Added:
>
>
  • simpleFitsWriter : The default extension when one selects compression with GZIP, is now gz (was gzip)
  • asciiTableReader :
    • Parameters renamed, descriptions improved
    • columnType (was parserGuess) now supports (and prints) also String values (besides integers)
    • tableType: improved support for the different types of tables.
    • skipRows (was parserSkip): is now a Basic parameter (can be used also with tableType <> ADVANCED)
 

Virtual Observatory

Revision 142013-04-12 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 151 to 151
 

HIPE

Changed:
<
<
  • Plug-ins:
>
>

Batch mode

The hipe executable can be used as a replacement of jylaunch to run scripts in batch mode.

In HIPE 11, jylaunch will still be available, although it will print a warning informing that it shall be removed in HIPE 12.

Plug-ins

 
    • If the latest version of a plug-in is not compatible with an older version of HIPE, when running the older version of HIPE, it will not pick up an older version of the plug-in that is compatible (if available).
    • Tasks defined in plug-ins now have their source code available from the Task GUI.
Deleted:
<
<
  • New Data Access Perspective, bundling all functionality needed to get data in and out of HIPE.
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well
  • Virtual Observatory: HIPE now supports sending Spectrum2d objects. When sending a 2-dimensional spectrum, HIPE will send all the plain spectra in sequence.
 

Navigator

  • Compressed files can be opened with either double click or right click and Open With.
Added:
>
>
  • The default folder that is offered in file dialogues when opening or saving files is now customizable. The behaviour can be set in the General > Directories preferences panel.

Data Access

  • There is a new Data Access Perspective, bundling all functionality needed to get data in and out of HIPE.
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well

Virtual Observatory

HIPE now supports sending Spectrum2d objects. When sending a 2-dimensional spectrum, HIPE will send all the plain spectra in sequence.

 

Plotting

TablePlotter

OverPlotter

Deleted:
<
<

Dataset viewer

 

Astronomical utilities

Revision 132013-04-11 - PaulBalm

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 151 to 151
 

HIPE

Added:
>
>
  • Plug-ins:
    • If the latest version of a plug-in is not compatible with an older version of HIPE, when running the older version of HIPE, it will not pick up an older version of the plug-in that is compatible (if available).
    • Tasks defined in plug-ins now have their source code available from the Task GUI.
  • New Data Access Perspective, bundling all functionality needed to get data in and out of HIPE.
  • The HIPE status bar now indicates the log-in status with the HSA (logged in as...). If the connection to the HSA is lost, for example because a WiFi connection is dropped, it will be shown as well
  • Virtual Observatory: HIPE now supports sending Spectrum2d objects. When sending a 2-dimensional spectrum, HIPE will send all the plain spectra in sequence.
 

Navigator

  • Compressed files can be opened with either double click or right click and Open With.

Revision 122013-04-11 - JaimeSaiz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 151 to 151
 

HIPE

Added:
>
>

Navigator

  • Compressed files can be opened with either double click or right click and Open With.
 

Plotting

TablePlotter

OverPlotter

Revision 112013-04-11 - WimDeMeester

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 171 to 171
 

Images

Display

Added:
>
>
  • Speed improvements.
  • A lot of bug fixes.
  • Getting the distance between two points can be done using left mouse click, combined with SHIFT (and CONTROL).
  • Contour drag and drop also shows the color settings on the console.
  • photApertureCorrectionPointSource can be drawn on an Image.
  • Coordinates can be shown as decimal degrees.
  • It is possible to show extra datasets added to the image or the cube in Display.
  • It is possible to select which flags should be overlayed on the display.
  • Match Wcs has improved.
 

Analysis

Added:
>
>
  • Bug fixes in Wcs handling of SimpleImage and SimpleCube.
  • Support of extensions of Wcs.
  • Exporting and importing a session does no longer fail when there are ImageContours.
  • herschel.ia.dataset.image is thoroughly tested.
  • Mosaic task can convert to equatorial, ecliptic or galactic coordinates (when the input wcs is different than the wcs of the input images).
  • Improvements in reading fits files.
  • It is possible to open the the image analysis gui's without selecting an image.
  • Corrections in the SkyAperturePhotometry tasks.
  • Mosaic task can work with all sort of Lists.
  • Centroiding in aperture photometry tools should work more robust.
 

Spectra

Display

Revision 102013-04-10 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 203 to 203
 

Data input-output

  • localStoreCopier : parameters renamed, "warn" default is now True
Deleted:
<
<
  • simpleFitsWriter : "warn" default is now True
 

Virtual Observatory

Revision 92013-04-09 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 203 to 203
 

Data input-output

  • localStoreCopier : parameters renamed, "warn" default is now True
Added:
>
>
  • simpleFitsWriter : "warn" default is now True
 

Virtual Observatory

Revision 82013-04-03 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 194 to 194
 

Tasks

  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
Changed:
<
<
  • JTask deprecated, use Task instead (just remove the J).
  • parameters can now be of type Class
  • LocalStoreCopier: it will ask confirmation if overwriting by default (warn default to True), some parameters have been renamed
>
>
  • JTask deprecated, use Task instead (just remove the J).
  • Task parameters can now be of type Class
 

Quality control

Systematic product generation

Data input-output

Added:
>
>
  • localStoreCopier : parameters renamed, "warn" default is now True
 

Virtual Observatory

Revision 72013-03-12 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 196 to 196
 
  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
  • JTask deprecated, use Task instead (just remove the J).
  • parameters can now be of type Class
Added:
>
>
  • LocalStoreCopier: it will ask confirmation if overwriting by default (warn default to True), some parameters have been renamed
 

Quality control

Revision 62013-03-11 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 195 to 195
 

Tasks

  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
  • JTask deprecated, use Task instead (just remove the J).
Added:
>
>
  • parameters can now be of type Class
 

Quality control

Revision 52013-03-01 - StephanOtt

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 13 to 13
 
Added:
>
>

Planned work

HIPE

  • Star tracker distortion (2nd level of pointing correction)
  • move to Java 7 (with the exception of Versant)
  • Upgrade to lucene 4.1
  • Restructuring of ACMS to support improved pointing reconstruction
  • Framework to generate level 2.5 and level 3 products (systematic and on-demand)
  • improvement of SPG interface for DP TAs to ease future reprocessing exercises
  • reduction of start-up time for HIPE
  • improvements to ASCII tables reading and writing
  • improvements to task registration and management
  • batch mode for HIPE (instead of jylaunch)
  • removal of ia_toolbox_spectrum_gui (old spectrum explorer)
  • replacement of HSA perspective by data access perspective
  • improvements in user-friendliness (GUI layout, tooltips, harmonisation of Python syntax in HIPE)
  • Completion of CalSDB interface into HIPE
  • Pagination of HSA query results to improve response time for users (avoiding a long response time for HIPE)
  • Editing functionality of table and array datasets, including insertion of changed product into observation context and history recording of the changes
  • Irregular grid 2-d interpolation
  • Bug fixes for table explorer
  • documentation improvements for Binstruct
  • Display
    • Various bug fixes
    • aperture photometry improvements
    • design error and warnings reports fixes
    • test coverage improvements (drastic)
    • WCS matching of images
    • sourcefitting errors
    • import of rgb images
  • CSAT
    • Improve the moment algorithm for computeVelocityMap
    • Support for the new ParameterCube product (viewer)
    • Add rectangular selection
    • GUI improvements
  • Fixing the outstanding SxRs for the PDD
  • Addressing performance issues in PAL

HIFI

  • Investigation of performance issues for HIFI pipeline
  • HIFI uplink product
  • Update of spur-finder to improve data quality
  • Update of calibration table
  • Move to Java 7
  • Improvements to HEB standing wave mitigation prototype tool
  • Improvements to sideband ratio

PACS

general

  • Package / code cleanup
  • Search for further memory leaks / reduction/optimisation of memory use
  • Test harness coverage improvements
  • move to Java 7

Photometer

  • Level 2.5 errors
  • Improved calblock filtering
  • Scanamorphos HIPE implementation
  • Improvements in baseline drift correction

Spectrometer

  • ipipe script high flux pointing loss correction
  • Background subtraction improvements
  • specProject/drizzle improvements
  • Flatfielding improvements
  • Product improvements
  • Calibration improvements
  • general Ipipe improvements
  • User scripts: mapping of line fit parameters

SPIRE

general

  • move to Java 7

Photometer

  • New definition of Level 2.5 and Level 3 products in the archive Level 2.5 follows PACS list and contains single pairs of nominal and orthogonal SPIRE destriped parallel maps (Homogenization with PACS) Level 3 will be any overlapping region from a given program using the absolute calibrated maps from the Planck zero point

  • New extended calibration framework
    • Improved Calibration Scheme for extended sources taking into account the changing size of the beam across the band, including the colour corrections for point and extended sources for a given spectral index
    • Correction coefficients in the form of a Calibration table
  • Improved cross-calibration with Planck (TBC)
  • Map Projections for Na´ve Mapper: Implementation of different WCS and pixel minimization into map maker
  • Source Extraction
    • maintenance and improvements
    • Development of source subtractor
  • CInteractive Level-2 deglitcher tool

Spectrometer

  • Top level
    • Bright mode processing to be done in voltage pipeline (reduces size of calibration tree)
    • Updates to the telescope model calibration product (to include recent data)
    • H+L processing - LR part of these observations to be properly dealt with by pipeline
    • Updated instrument and telescopeRsrf calibration products (lower noise, as presented to SDAG)
    • Level-1 spectral products to be averaged (reduced size of observation context)

  • Software:
    • Wavelet deglitcher - tuning of spectrometer parameters
    • Remove temperature drift correction task from pipeline script (it makes no difference to the output!)
    • Minor updates/corrections to useful scripts
    • Add the final resolution used in the processing to the observation context metadata
    • Viewing teleModel calibration products in SDS Explorer
    • Update MAD deglitching (2nd level deglitching) parameters for obs. with >30 reps
    • Improve memory usage when threading
    • Semi-extended tool improvements (including documentation in the DRG)
    • Sinc-Gauss function for the fitter
    • Updates to the mouse click procedure used for SDS Explorer
    • Convolution Mapper
    • WCS handling updates
    • Naive mapper algorithm updated for error propagation
 

Highlights

HIPE

Revision 42013-02-19 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 69 to 69
 

Product Access Layer

Tasks

Added:
>
>
  • Jython code with calls to tasks with multiple outputs must be updated: see User manual.
 
  • JTask deprecated, use Task instead (just remove the J).

Quality control

Revision 32013-01-14 - PaulBalm

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 59 to 59
 

Herschel Science Archive

Added:
>
>
HIPE now shows the currently logged in user on the status bar, next to a lock icon. If no user is logged in, one can double-click the icon to log in. Also, if no user is logged in and log-in information is required, rather than failing, HIPE will now pop up a log-in window, allowing the user to specify username and password.
 

Calibration sources

Products and datasets

Revision 22012-12-11 - JavierDiaz

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->
Line: 67 to 67
 

Product Access Layer

Tasks

Added:
>
>
  • JTask deprecated, use Task instead (just remove the J).
 

Quality control

Revision 12012-12-11 - DavideRizzo

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="HipeWhatsNew"
<-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->

What's coming up in HIPE 11

PDF Version Click here

Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.

See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.

Highlights

HIPE

HIFI

PACS

SPIRE

Core system

HIPE

Plotting

TablePlotter

OverPlotter

Dataset viewer

Astronomical utilities

Numeric routines

Data fitting

Data interpolation

Random numbers

Statistics

Trend analysis

Mapping

Other functions

Source extraction

Images

Display

Analysis

Spectra

Display

Analysis

Data cubes

Display

Analysis

Herschel Science Archive

Calibration sources

Products and datasets

Observation context

Product Access Layer

Tasks

Quality control

Systematic product generation

Data input-output

Virtual Observatory

Installer

Documentation

HIFI

HIFI Software Configuration and Properties

HIFI Calibration

HIFI Pipeline

hifiPipeline task

Level 0 Pipeline

WBS Pipeline

HRS Pipeline

Level 1 Pipeline

Level 2 Pipeline

Level 2.5 Pipeline

HIFI Products

HIFI Spectrum Toolbox

Spectrum Explorer (HIFI specifics)

Spectrum tasks (HIFI specifics)

HIFI Data Processing Tools

Standing Wave Removal

Baseline Removal

Deconvolution

Spectral Cube creation

flagTool

HiClass export tool

Documentation

PACS

Pipeline

Photometry

Spectroscopy

Calibration

Photometry

Spectroscopy

Analysis tools

Photometry

Spectroscopy

Product changes

Photometry

Spectroscopy

Documentation

SPIRE

Calibration Products

Calibration Framework

Preprocessing

Engineering Conversion

Common Pipeline

Photometer Pipeline

Spectrometer Pipeline

Interactive Analysis and Tools

Documentation


<-- COMMENT BOX CODE - DO NOT EDIT -->
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->

<--  
-->

META FILEATTACHMENT attachment="GoogleAnalytics.txt" attr="h" comment="Script for Google Analytics" date="1355232763" name="GoogleAnalytics.txt" path="GoogleAnalytics.txt" size="549" stream="GoogleAnalytics.txt" user="Main.DavideRizzo" version="1"
 
This site is powered by the TWiki collaboration platform Powered by Perl