HipeWhatsNew51 < Public

Public Web>HipeWhatsNew>HipeWhatsNew5x>HipeWhatsNew51 (2012-10-30, DavideRizzo) (raw view)
<!-- ANALYTICS CODE - DO NOT EDIT -->
%INCLUDE{"%ATTACHURL%/GoogleAnalytics.txt" raw="on"}%
<!-- END OF ANALYTICS CODE -->
| *PDF Version* | [[%SCRIPTURLPATH%/genpdf%SCRIPTSUFFIX%/%WEB%/%TOPIC%?pdforientation=portrait&pdftoclevels=0][Click here]] |

| %ICON{"help"}% *Interested in what's new for other versions of HIPE? See [[HipeWhatsNew][this page]] for links to all the What's New documents from HIPE 4.0 onwards.* |

---+ Changes between HIPE 5.0 and 5.1

---++ Core system

   * New ==loadObs== task to open in HIPE an observation downloaded from the Herschel Archive. <!-- HCSS-11395 -->
   * New Level 2.5 added to Observation Context for PACS/SPIRE data. Mentioned in the [[http://herschel.esac.esa.int/hcss-doc-5.0/index.jsp?mark=pdd:observationprods][Products Definitions Document]]. <!-- HCSS-11197, HCSS-11870 -->
   * Pipelines can now process multiple observations at once (for instance, scan and cross-scan data). The results of this so-called _extended processing_ are stored in the new Level 2.5 data. <!-- HCSS-9361 -->
   * You can now specify the local store directory in the _Preferences_ window (_Data Access --> Local Store_). <!-- HCSS-11424 -->
   * Fixed a problem in the _Save Products to Pools_ view. Entering the name of a new pool would not create the pool. <!-- HCSS-11911 -->
   * Fixed a problem with the handling of serialised pools in the _Storages &amp; Pools_ section of the HIPE preferences window. Serialised pool definitions would not be removed when pressing _Restore Defaults_, and would not be restores when pressing _Cancel_ after _Delete_. <!-- HCSS-11590 -->
   * The ==LocalStoreWriter== task now creates new local pools in the default ==$HOME/.hcss/lstore== directory. <!-- HCSS-11051 -->
   * Fixed a problem that would prevent HIPE from starting when the list of local pool names, separated by commas, exceeded 8096 characters. <!-- HCSS-11645 -->
   * Pools created with ==localStoreWriter== when saving a product now appear in the _Storages &amp; Pools_ configuration panel. <!-- HCSS-11330 -->
   * Improved the Product Access Layer performance by a more efficient loading of descriptors. <!-- HCSS-10993 -->
   * Fixed a problem that would cause errors with multi-user access to local pools, due to lock files not being properly removed. In the unlikely case that lock files for a local pool are still not cleaned (for example after a software crash) you can remove them manually with the command ==herschel.ia.pal.pool.lstore.LStoreMaintenanceUtil.clearLocks(localPool)==, where ==poolName== is a variable repreenting the local pool. <!-- HCSS-11774 -->
   * Improved error message when trying to import partial observation from the Herschel Archive. <!-- HCSS-11522 -->
   * Fixed a problem with the ==saveObservation==, which would fail to save an Observation Context to a pool with default settings. <!-- HCSS-11746 -->
   * Fixed a problem with ==imageSubtract==, which would give wrong results when used with WCS. <!-- HCSS-11605 -->
   * Zooming on an image no longer causes HIPE to hang. Zooming is also much faster. <!-- HCSS-10920, HCSS-11471 -->
   * Fixed a problem with the ==NearestNeighbourProjectionTask== task, which creates a spectral cube from three-dimensional data. The task would fail to create a target grid out of a set of target grids. A command such as ==targetGrid = nearestNeighbourProjection.targetGrid([tg1,tg2,tg3])== would fail with an ==IllegalArgumentException==. <!-- HCSS-9991 -->
   * The ==Wcs.getCrota2()== method now returns CROTA2 in degrees instead of radians. <!-- HCSS-11616 -->
   * Fixed a problem with FITS generation that would cut AOR labels containing a single quote character. <!-- HCSS-11815 -->
   * Fixed a problem with loading FITS files. Datasets with long class names (requiring a ==CONTINUE== card) would cause an error in some cases. <!-- HCSS-11669 -->
   * Many stability improvements to the plugin framework. <!-- HCSS-11601, HCSS-11570 -->
   * Improved HIPE performance when creating, changing or deleting many variables. <!-- HCSS-11575 -->
   * Fixed a problem that caused deleted variables not to be removed from the _Variables_ view in some cases. <!-- HCSS-11326, HCSS-11118 -->
   * Improved the _Startup &amp; Shutdown_ section of the HIPE preferences window. <!-- HCSS-11134 -->
   * Product history now records the value of small arrays. <!-- HCSS-11054 -->
   * The default value of the ==var.hcss.workdir== configuration property has been changed from ==${java.io.tmpdir}/hcss/${user.name}== to ==${java.io.tmpdir}/${user.name}/hcss==. <!-- HCSS-10701 -->
   * The _Help --> About_ dialogue window now shows the user release version in addition to the build number. <!-- HCSS-11791 -->
   * The HIPE _Help_ menu now include entries for instrument data reduction manuals. <!-- HCSS-11028 -->
   * The HIPE _Help_ menu now contains a link to the Herschel Science Centre Helpdesk. <!-- HCSS-11086 -->
   * HIPE can now send crash reports to the Herschel Science Centre for analysis. <!-- HCSS-11107 -->
   * The _HIPE Owner's Guide_ and _Data Analysis Guide_ have been updated with all the new HIPE features. <!-- HCSS-11091, HCSS-11450, HCSS-11925, HCSS-11646 -->
   * The _Quick Start Guide_ now clarifies that the described data access method is for quick inspection rather than full data retrieval. <!-- HCSS-9740 -->
   * Many improvements in the [[http://herschel.esac.esa.int/hcss-doc-5.0/index.jsp?mark=hcss_urm:urm.categories][categorised view of commands]] in the core User's Reference Manual. The remaining glitches are being fixed for HCSS 6.0. <!-- HCSS-6559 -->
   * New [[http://herschel.esac.esa.int/hcss-doc-5.0/index.jsp?mark=howtos:Dag.DataIO.StepByStep][step-by-step guide]] for getting data out of the Herschel Science Archive and into HIPE. <-- HCSS-11635 -->
   * Updated SPIRE tables in the Products Definitions Document. <!-- HCSS-11060 -->
   * Appendix A of the _Scripting and Data Mining_ guide, about advanced Product Access Layer usage, has been completely revised. <!-- HCSS-11144 -->
   * Many references to the old JIDE application have been removed from the documentation. A warning has been added in the User's Reference Manual, where JIDE is still referred to, especially in example titles. Any remaining references to JIDE can be safely applied to HIPE. <!-- HCSS-10869, HCSS-11263, HCSS-11264 -->
   * Instrument manual names have been changed to be more consistent. <!-- HCSS-11891 -->
   * Fixed hyperlinks among manuals in core and instrument documentation. Note that links between core and instrument manuals are not yet implemented. <-- HCSS-10907 -->
   
---++ SPIRE

   * The ==signalJumpDetector== task is now initialised at HIPE startup <!-- SPIRE-2956 -->
   * Fixed a problem with ==AbstractMapperTask==, which might treat incorrectly a Wcs provided as input. When the input Wcs was defined using the ==CDELTi== keywords, the result was correct, but when the pixels were defined with the ==CDi_j== keywords, these were translated into ==CDELTi== and ==CROTA2== keywords. <!-- SPIRE-2950 -->
   * Fixed a problem with ==AbstractMapperTask==. There was a bug in the generation of tod files which could result in an ==ArrayIndexOutOfBoundsException== at the map generation. <!-- SPIRE-2949 -->
   * Fixed an example of spectrometer map making using Naive Projection in the Data Reduction Guide. <-- SPIRE-2985-->
   * The ==concurrentGlitchDeglitcher== entries in all scan map pipeline scripts now explicitly mention all inputs. <!-- SPIRE-2877 -->
   * All the parameters of the ==concurrentGlitchDeglitcher== task are now explained in the Pipeline Specification Manual. <!-- SPIRE-2878 -->
   * Fixed a problem with the spectrum explorer for ==SpectrometerDetectorSpectrum== objects. Units would always be displayed as _Flux [V.cm]_ even after being changed to W/(m².Hz.sr). <!-- SPIRE-2843 -->
   * The ==spireCal== task now raises an error if the input pool does not exist, instead of creating an empty calibration context. <!-- SPIRE-2968 -->
   * Updated spectrometer user scripts to clarify that option G has only effect for observations in "High+Low" mode. <!-- SPIRE-2973 -->
   * More helpful error message in case a pipeline stops because the latest calibration tree is not available. <!-- SPIRE-3061 -->
   * Fixed a problem with the ==TelescopeCorrection== task, which would always use the forward scan in the ==TeleRsrf== calibration product. <-- SPIRE-3043 -->

---++ HIFI

   * New task ==convertKtoJy== to convert HIFI Data from K to Jy. <!-- HIFI-2773 -->
   * New task ==convertSingleHifiSpectrum== to convert final HIFI ==Spectrum1d== datasets to ==SimpleSpectrum== products. <!-- HIFI-3730 -->
   * Fixed a problem with ==fitBaseline==, which could crash on fully spur-flagged subbands. <!-- HIFI-3832 -->
   * The ==fitBaseline== task now saves intermediate results when quitting. <!-- HIFI-3792 -->
   * Ra/Dec coordinates in data cube meta-data are no longer incorrect. <!-- HIFI-3778 -->
   * Fixed a problem with ==PolarPair==, which would return the first dataset supplied to it because the tolerance level was too low by default (five channels of difference in frequency between the two polarisations). The default tolerance was raised to 100 channels of difference. <!-- HIFI-3659 -->
   * The ==HiClass== task has been updated to export the source velocity as provided in the AOR into new FITS header keywords, closely resemble the usual keywords for transporting the velocity information. The ==PVELTYPE== keyword tells the type of velocity. <!-- HIFI-3645 -->
| *Reference frame* | *Usual keyword* | *HiClass keyword* |
| topocentric | VELO-OBS | PVEL-OBS |
| geocentric | VELO-GEO | PVEL-GEO |
| heliocentric | VELO-HEL | PVEL-HEL |
| LSRk | VELO-LSR | PVEL-LSR |
| LSRd | VELO-LSR | PVEL-LSR |
| LSR | VELO-LSR | PVEL-LSR |
| galactocentric | VELO-GAL | PVEL-GAL |
| source | VELOREST | PVELREST |
| unknown | VELOCITY | PVELCITY |

   * Fixes to the User Manual: <!-- HIFI-3810 -->
      * Updates to pipeline chapters:
         * Documented the functionality to pass a list of obsids to the pipeline.
         * Corrected the pipeline options upToLevel and fromLevel, which were wrongly written as !UpToLevel and !FromLevel.
         * Documented how to get H and V pointing.
         * Clarified how to process with new calibration.
      * Updates to doGridding chapter:
         * Corrected references to half-beam and Nyquist sampling are correct.
      * Updates to plotting Chapter:
         * Noted how to create a variable for a ==HifiSpectrumDataset== so that example can be followed.
   
---++ PACS

   * New ==maskInfo(slicedProduct)== function to print an overview of the mask status in a sliced product. <!-- PACS-3114 -->
   * Obsolete scripts were removed from the HIPE Pipeline menu. <!-- PACS-3130 -->
   * Several improvements to the single-obsid ==photProject== pipeline scripts, which now produces much better results. <!-- PACS-3110 -->
   * Several improvements to the documentation of the pipeline scripts found in the HIPE Pipeline menu. <!-- PACS-2882 -->
   * Fixed a problem in ==L1_pointSource.py== script where sources could be interpreted as glitches. <!-- PACS-3166 -->
   * Fixed a problem with ==HighPassFilter== that could cause the pipeline to crash. <!-- PACS-3179 -->
   * Fixed a problem with the unchopped mode raster observation pipeline, which would fail at ==SpecWaveRebinTask==. <!-- PACS-3187 -->
   * Fixed a problem in the ==findBlocks== task, which would not propagate metadata. <!-- PACS-3152 -->
   * Updated map pipeline scripts: ==scanmap_BrightPointsource.py== and ==scanmap_Deep_Survey_miniscan_Pointsource.py==. <!-- PACS-2883 -->
   * Fixed a problem with ==FindBlocksTask==, which would give an error when creating a ==ListContext==. <!-- PACS-3112 -->
   * In the ==photProjectPointSource== task, the ==calibration = false== mode has been deprecated because it is not flux conserving. <!-- PACS-2232 -->
   * Included !MadMap documentation in the Data Reduction Guide. <!-- PACS-2370 -->
   * Several improvements to the spectrum extraction documentation at http://herschel.esac.esa.int/twiki/pub/Pacs/SpectrumExtractionTask/prototypeSpectrumExtraction.pdf. <!-- PACS-2949 -->

<!--
   * Set ALLOWTOPICCHANGE = Main.RegisteredUsersGroup, Main.TWikiAdminGroup
-->
Topic revision: r2 - 2012-10-30 - DavideRizzo
Public
Webs
Public
TWiki