Difference: HipeWhatsNew14x (49 vs. 50)

Revision 502015-12-21 - IvanV

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"
Changed:
<
<
<-- ANALYTICS CODE - DO NOT EDIT -->

<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<-- END OF ANALYTICS CODE -->
>
>
<!-- ANALYTICS CODE - DO NOT EDIT -->
<-- Google Analytics script BEGIN -->
<-- Google Analytics script END -->

<!-- END OF ANALYTICS CODE -->

 

What's new in HIPE 14

PDF Version Click here
Changed:
<
<
Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.
>
>
Help Interested in what's new for other versions of HIPE? See this page for links to all the What's New documents from HIPE 4.0 onwards.
 See also the HIPE known issues and the Data products known issues pages for last-minute information on known problems.
Changed:
<
<

>
>

 

Highlights

Line: 20 to 20
 
  • SVV resets and STR switch-overs handled by auxiliary processors in the generation of the pointing product.

HIFI

Changed:
<
<
  • Update of sideband ratio in bands 1 to 4 - note that this will imply changes in the intensities in all concerned bands
  • Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget
>
>
  • Update of sideband ratio in bands 1 to 4 - note that this will imply changes in the intensities in all concerned bands
  • Introduction of a new calibration output providing a frequency-dependent intensity calibration uncertainty budget
 
  • Provision of spur channel flags for all modes (was limited to spectral scan up to HIPE 13)
  • Changes to the output of the Deconvolution task.
  • New parameters for the removal tasks and updated functionality for *identifyLines.
Line: 38 to 38
 
  • A new task runPacsSpg has been introduced, with which users can run the full PACS SPG pipeline from within HIPE.

SPIRE

Changed:
<
<
  • FTS
    • Two new tasks and corresponding calibration products have been introduced for SPIRE FTS data. One task corrects for artefacts in low resolution point source calibrated spectra. The other corrects the level of all extended source calibrated data in or to get better agreement between the SPIRE Spectrometer and Photometer.
>
>
  • Major impact: SPIRE Spectrometer extended source calibrated spectra are corrected for the far-field feedhorn efficiency. The correction leads to systematic ~40% higher intensities for SSW and ~40-100% for SLW. All extended source calibration products - spectra or spectral cubes - are affected by this significant effect. With this correction the extended source calibrated SPIRE Photometer and Spectrometer products are in good agreement.
  • Correction for artefacts in SPIRE Spectrometer Low Resolution (LR) point source calibrated spectra.
  • The default SPIRE Spectrometer spectral cubes are now produced with the convolution projection (CP) method: the browse images/thumbnails and standalone browse products are now the CP cubes.
 

Core system

Line: 79 to 80
  would open HIPE with three viewers: one for the image, a spectrum explorer for the cube, and a dataset viewer for the CSV table.
Changed:
<
<

ALERT! Note:
>
>

ALERT! Note:
  Passing a Jython script as the first argument will still behave as running HIPE in batch mode:
bash> hipe myScript.py arg1 arg2
Line: 272 to 273
 
    • The JScanam ipipe script scanmap_JScanam_multiplePairs is designed to process multiple pairs of obsIDs and it has been upgraded by introducing the scanamorphosAlignFrames Task. This task aligns the Frames signal levels, belonging to every observation, to a common offset level, by exploiting the overlapping sky regions. This new capability is particulary useful for recovering a common background level over observations that are partially or slightly overlapping.
    • The script scanmap_Unimap_memory_optimized has been added to the Pipelines menu. This allows one to run the Unimap release located on the userís computer while using the minimum amount of memory. It is particularly useful for processing large observations or/and if several obsIDs should be processed all together in a single run.
    • The script photextended_pipeline_L3 is now available in the Pipelines menu. This can be used to generate mosaics of Unimap and Jscanam Level2.5 maps.
Changed:
<
<
  • Unimap : Unimap 6.2.0 is spawned by the Standard Product Generator (SPG) to create Level2.5 products. See the Photometer Data Reduction Guide and the offical Unimap webpages (http://infocom.uniroma1.it/unimap/) to know What's New about the 6.2.0 Unimap release.
>
>
  • Unimap : Unimap 6.2.0 is spawned by the Standard Product Generator (SPG) to create Level2.5 products. See the Photometer Data Reduction Guide and the offical Unimap webpages (http://infocom.uniroma1.it/unimap/) to know What's New about the 6.2.0 Unimap release.
 

Spectroscopy

  • Level 2/2.5 extracted spectra tables:
    • A new product is provided at Level 2 for all (line, range, chopNod, unchopped) pointed observations, and also at Level 2.5 for the subset of unchopped, rangeScan observations. This table, HPSSPEC[R|B], contains the extracted spectrum of the central spaxel, and the point source calibrated spectra "c1" and "c129" from the pipeline task extractCentralSpectrum. Since the point-source calibrated spectra are taken from the centre of the cube, it is necessary that the source is located within spaxel 2,2 (the central one). However, we make no determination that the target of the observation actually is a point source - that is up to the end-user to establish. These tables are also provided as standalone browse products.
Line: 295 to 296
 

Spectroscopy

Changed:
<
<
  • The extended-source calibrated rebinned cubes (level2) contain now a correction that accounts for the non-uniform illumination of the PACS IFU field-of-view. It stems from the fact that the 9.4"x9.4" spaxel edges are less responsive than their centres, translating into a spaxel active area of approximately 8"x8" where the response is flat. This effect is more severe at shorter wavelengths, and affects (very) extended emission, as well as off-centred point sources and any source that has a size between a point and a very extended. All Level 2/2.5 cubes for these types of sources will be affected, whether pointed or mapping.
    Hence, for centred point source extracted with the task extractCentralSpectrum, no change to the spectra are expected in this version of HIPE because of this effect. For very extended sources, we have developed a new Extended Source Correction calibration file (ExtendedSourceLoss, applied in the pipeline tasks specRespCal and specRespCalToTelescope), and this incorporates the necessary correction as part of the spatial flatfielding for the PACS spectrometer. For these sources, the fluxes of the spectra will differ to what was obtained in previous versions of HIPE. For intermediate sources, a more complex analysis is necessary to estimate the flux loss, and a task to do this will be provided in HIPE 15.
    The fluxes of the spaxels of all cubes will be increased by ~30% in the blue to ~5% in the red. The calibration file can be inspected to extract the curve:
    w = calTree.spectrometer.extendedSourceLoss["wavelength"].data
    f = calTree.spectrometer.extendedSourceLoss["fraction"].data
    p=PlotXY(w, 1./f)
    After such a correction, a source of flat surface brightness within the field of view of a single pointing will be well calibrated at the level of the rebinned cubes (i.e. level2).The flux loss between the detectors was already accounted for in the point-source calibration correction in the correspondent calibration file, therefore, point-source calibrated spectra of centred point sources are not affected. For this reason, in HIPE 14, the extractCentralSpectrum task checks and removes the extendedSourceLoss correction from the level2 cubes, in case it has been applied, before extracting the final point source corrected spectrum. However, if working with off-centred point sources and using the tasks extractSpaxelSpectrum and pointSourceLossCorrection, this correction is not taken out, and hence the results will be incorrect. An extra task/function is necessary: to get this, raise a helpdesk ticket.
>
>
  • The extended-source calibrated rebinned cubes (level2) contain now a correction that accounts for the non-uniform illumination of the PACS IFU field-of-view. It stems from the fact that the 9.4"x9.4" spaxel edges are less responsive than their centres, translating into a spaxel active area of approximately 8"x8" where the response is flat. This effect is more severe at shorter wavelengths, and affects (very) extended emission, as well as off-centred point sources and any source that has a size between a point and a very extended. All Level 2/2.5 cubes for these types of sources will be affected, whether pointed or mapping.
    Hence, for centred point source extracted with the task extractCentralSpectrum, no change to the spectra are expected in this version of HIPE because of this effect. For very extended sources, we have developed a new Extended Source Correction calibration file (ExtendedSourceLoss, applied in the pipeline tasks specRespCal and specRespCalToTelescope), and this incorporates the necessary correction as part of the spatial flatfielding for the PACS spectrometer. For these sources, the fluxes of the spectra will differ to what was obtained in previous versions of HIPE. For intermediate sources, a more complex analysis is necessary to estimate the flux loss, and a task to do this will be provided in HIPE 15.
    The fluxes of the spaxels of all cubes will be increased by ~30% in the blue to ~5% in the red. The calibration file can be inspected to extract the curve:
    w = calTree.spectrometer.extendedSourceLoss["wavelength"].data
    f = calTree.spectrometer.extendedSourceLoss["fraction"].data
    p=PlotXY(w, 1./f)
    After such a correction, a source of flat surface brightness within the field of view of a single pointing will be well calibrated at the level of the rebinned cubes (i.e. level2).The flux loss between the detectors was already accounted for in the point-source calibration correction in the correspondent calibration file, therefore, point-source calibrated spectra of centred point sources are not affected. For this reason, in HIPE 14, the extractCentralSpectrum task checks and removes the extendedSourceLoss correction from the level2 cubes, in case it has been applied, before extracting the final point source corrected spectrum. However, if working with off-centred point sources and using the tasks extractSpaxelSpectrum and pointSourceLossCorrection, this correction is not taken out, and hence the results will be incorrect. An extra task/function is necessary: to get this, raise a helpdesk ticket.
 
  • New beam calibration files have been delivered, differing from the previous files only in the way they are normalised. These will be used in a new task being developed in HIPE 15, and do not impact on HIPE 14 or SPG 14 in any way.
    • In the spatial domain, they are normalised such that the sum of all spaxels is 1 when a point source of flux 1 is observed at the peak position of the central spaxel;
Line: 333 to 334
 

Calibration Products

  • Spectrometer
Changed:
<
<
    • A new calibration product SCalSpecLrCorr has been added, containing correction curves for point-source calibrated LR data.
    • A new calibration product SCalSpecExtCorr has been added, containing polynomial coefficients that are used to generate correction curves for extended source calibrated data.
    • A new calibration product SCalSpecOpdCorr has been added, it is currently neither used in the pipelines nor in user scripts.
>
>
    • A new calibration product SCalSpecLrCorr has been added, containing correction curves for point-source calibrated LR data.
    • A new calibration product SCalSpecExtCorr has been added, containing polynomial coefficients that are used to generate correction curves for extended source calibrated data.
    • A new calibration product SCalSpecOpdCorr has been added, it is currently neither used in the pipelines nor in user scripts.
 
  • Photometer
Changed:
<
<
    • Updates to the photometer beams: SCalPhotBeamProf and SCalPhotRadialCorrBeam affecting most colour correction parameters.
>
>
 

Calibration Framework

Line: 362 to 363
 

Documentation


Changed:
<
<
<-- COMMENT BOX CODE - DO NOT EDIT -->
>
>
<!-- COMMENT BOX CODE - DO NOT EDIT -->
 
Changed:
<
<
blog comments powered by Disqus
<-- END OF COMMENT BOX CODE -->
>
>
<script type="text/javascript">
<br />var disqus_shortname = 'herscheltwiki'; // required: replace example with your forum shortname<br /><br />(function() {<br />var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;<br />dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';<br />(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);<br />})();<br /></script> <noscript>Please enable JavaScript to view the comments powered by Disqus.</noscript> blog comments powered by Disqus <!-- END OF COMMENT BOX CODE -->
 
Changed:
<
<
<--
* Set ALLOWTOPICCHANGE = RegisteredUsersGroup, TWikiAdminGroup
-->
>
>
<!--<br />* Set ALLOWTOPICCHANGE = RegisteredUsersGroup, TWikiAdminGroup <br />-->
  -- AlvarGarcia - 24 Nov 2014

Editors & Viewers

 
This site is powered by the TWiki collaboration platform Powered by Perl