Difference: HipeWhatsNew8x (65 vs. 66)

Revision 662011-12-05 - DavideRizzo

Line: 1 to 1
 
META TOPICPARENT name="HipeWhatsNew"

What's coming up in HIPE 8

Line: 425 to 425
 
    • The SCalPhotChanNoise product has been updated to improve the flux calibration for MadMap (this is only used for MadMap).
  • Spectrometer:
    • The "extended" calibration in SCalSpecTeleRsrf is now derived from a mean of many observations, reducing the noise level in the RSRF. In addition, RSRFs have been added for the Bright Source mode, and the units have been updated to be in GHz.
Changed:
<
<
    • The "point-source" calibration in _SCalSpecBeamParam! has been updated, Bright Source mode factors added and units updated to GHz. The internal structure of the product has been updated to allow the point-source conversion factors for other off-axis detectors to be added in future, and the "beam area" column has been removed (as this was misleading, and the beam area is better calculated from the diameter, assuming a Gaussian shape).
>
>
    • The "point-source" calibration in SCalSpecBeamParam has been updated, Bright Source mode factors added and units updated to GHz. The internal structure of the product has been updated to allow the point-source conversion factors for other off-axis detectors to be added in future, and the "beam area" column has been removed (as this was misleading, and the beam area is better calculated from the diameter, assuming a Gaussian shape).
 
    • The Instrument RSRF in SCalSpecInstRsrf has been updated, Bright Source mode RSRFs added and units updated to GHz
    • The OPD limits in SCalSpecOpdLimits have been changed such that the interferograms for calibration observations (resolution CR) are cut to have the same limits as high resolution science observations (HR).
    • The spectral band edges in SCalSpecBandEdges have been made slightly narrower to avoid spikes at the edges. They have also been converted to GHz.
Line: 451 to 451
 

Photometer Pipeline

Extended Emission Calibration Using the Relative Detector Gains

Changed:
<
<
A new optional module in the User Pipelines that takes into account the fact that the SPIRE detectors do not all have exactly the same beamshape
  • The Flag applyExtendedEmissionGains needs to be set to True
>
>
A new optional module in the User Pipelines that takes into account the fact that the SPIRE detectors do not all have exactly the same beamshape.
  • The Flag applyExtendedEmissionGains needs to be set to True.
 

Include Turnaround Data for Maps

Changed:
<
<
Extra area / coverage can be obtained by including the scan line turnarounds in the processing
  • The Flag includeTurnaround needs to be set to True
>
>
Extra area / coverage can be obtained by including the scan line turnarounds in the processing.
  • The Flag includeTurnaround needs to be set to True.
 

Spectrometer Pipeline

Spectral Unit and Unit-Flexibility

Changed:
<
<
The standard spectral unit used in the pipeline is now frequency in GHz rather than wavenumber in cm-1. In addition the band limits have been slightly reduced so that instrumental spikes at the edges are not included.
>
>
The standard spectral unit used in the pipeline is now frequency in GHz rather than wavenumber in cm-1. In addition the band limits have been slightly reduced so that instrumental spikes at the edges are not included.
  For interactive processing, it is now possible to specify the desired spectral unit in the Fourier Transform module. This accepts an optional spectralUnit string parameter to specify the output spectral unit. For example, if spectralUnit='GHz', then the output spectra will be in units of V/GHz versus GHz. If no unit is specified, the output spectra will be in units of V/(1/OPD_UNIT) versus 1/OPD_UNIT (the OPD unit is typically cm).
Line: 473 to 473
 The Average Spectra module no longer supports the bandEdge parameter. This parameter was used only for the module's defunct outlier rejection functionality, and so it is no longer needed. Please ensure that your scripts do not use this parameter.

Spectrum Flux Calibration

Changed:
<
<
The Flux Calibration module has been replaced by two modules, the Point Source Flux Calibration module and the Extended Source Flux Calibration module. References to SpecFluxConversionTask should be replaced with SpecPointFluxConversionTask or SpecExtendedFluxConversionTask. Read more in the pipeline specification manual at Spectrum Point Source Flux Calibration and Spectrum Extended Source Flux Calibration.
>
>
The Flux Calibration module has been replaced by two modules, the Point Source Flux Calibration module and the Extended Source Flux Calibration module. References to SpecFluxConversionTask should be replaced with SpecPointFluxConversionTask or SpecExtendedFluxConversionTask. Read more in the pipeline specification manual at Spectrum Point Source Flux Calibration and Spectrum Extended Source Flux Calibration.
 

Bright Source Mode

Line: 499 to 499
 
    • residualPhaseSLW/SSW gives the maximum absolute phase value (in units of degree) inside the phase correction limits in any of the nominal SLW/SSW detectors.

Create SDI from SDS

Changed:
<
<
  • InverseFourierTransformTask has been created to transform SDS objects into SDI objects by applying the inverse Fourier transform:
>
>
  • inverseFourierTransform has been created to transform SDS objects into SDI objects by applying the inverse Fourier transform:
 
sdi = inverseFourierTransform(sds = sds)
Changed:
<
<
  • InverseFourierTransformTask is not the inverse of the FourierTransformTask because it does not remove zeropadding from the output interferograms. The already existing makeSameOpds can be used to remove zero-padding.
>
>
  • inverseFourierTransform is not the inverse of the fourierTransform task because it does not remove zeropadding from the output interferograms. The already existing makeSameOpds can be used to remove zero-padding.
 

Improved pre-processed cube product

Changed:
<
<
The "preCube" product which contains the collection of spectra to be gridded into the final cube has been improved and now contains a dataset in Spectrum2d format, that can easily be viewed with Herschel viewers.
>
>
The "preCube" product which contains the collection of spectra to be gridded into the final cube has been improved and now contains a dataset in Spectrum2d format, that can easily be viewed with Herschel viewers.
 

Convenience task for spectral cube creation

SpireProjectionTask has been created to provide a convenient single API for creating spectral cubes. The task can make spectral cubes using any of the following algorithms:
Changed:
<
<
  • Naive projection (cf. SPIRE photometer)
  • Nearest neighbour projection
  • Gridding projection (cf. HIFI OTF gridding)
>
>
  • Naive projection (cf. SPIRE photometer).
  • Nearest neighbour projection.
  • Gridding projection (cf. HIFI OTF gridding).
 

Interactive Analysis and Tools

Useful Scripts

Changed:
<
<
A new menu item, Scripts has been added on the HIPE toolbar to contain "useful" scripts. Scripts have been added for the Photometer and Spectrometer (see below).
>
>
A new menu item, Scripts has been added to HIPE to contain "useful" scripts. Scripts have been added for the Photometer and Spectrometer (see below).
 
Photometer Destriper
Changed:
<
<
THe Destriper example use is now contained in a new Useful Script accessed from the top Scripts menu within HIPE The following new features are introduced in Hipe 8:
>
>
THe Destriper example use is now contained in a new Useful Script accessed from the top Scripts menu within HIPE. The following new features are introduced in HIPE 8:
 
  • Level 2 deglitching is available through setting l2DeglitchRepeat parameter.
  • The 5 individual output parameters are combined to one ArrayList parameter where each of 5 parameter can be retrieved base on its position.
  • The new diagnostic product is introduced which provides with useful diagnostic information.
Changed:
<
<
  • Both Tod and TodBuffer are acceptable input for Tod parameter.
  • The input parameter "array" now is MANDATORY.
  • Pixel size can be changed through setting pixelSize parameter.
  • brightSource parameter is changed to boolean.
  • A boolean parameter, "fitWithWeight" is introduced.
  • Interruption is added so that the destriper can be terminated at the user's request.
  • Tod files stored in temporary directory are available until Hipe is terminated.
  • The destriper speed is increased 30%.
  • The input parameter name "Level1" changed to "level1".
  • The input parameter name "Tod" changed to "tod".
  • The input parameter name "L2DeglitchRepeat" changed to "l2DeglitchRepeat".
>
>
  • Both Tod and TodBuffer are acceptable input for the tod parameter.
  • The input parameter array now is MANDATORY.
  • Pixel size can be changed through setting pixelSize parameter.
  • The brightSource parameter is changed to boolean.
  • The boolean fitWithWeight parameter was introduced.
  • Interruption is added so that the destriper can be terminated at your request.
  • Tod files stored in temporary directory are available until HIPE is terminated.
  • The destriper speed increased by 30%.
  • The input parameter name Level1 was changed to level1.
  • The input parameter name Tod was changed to tod.
  • The input parameter name L2DeglitchRepeat was changed to l2DeglitchRepeat.
 
Photometer Baseline Removal
Changed:
<
<
THe Median and Polynomial Baseline Removal example use is now contained in a new Useful Script accessed from the top Scripts menu within HIPE
  • New "roi" (region of interest) parameter for baselineRemoval* tasks, specifying the region of the sky to be used in estimating the baseline
  • Removed "doInterpolation" task parameter
  • Minor changes and bug fixes (for example, the tasks now do ignore masked data samples when a TodBuffer is used internally)
>
>
The Median and Polynomial Baseline Removal example use is now contained in a new script accessed from the top Scripts menu within HIPE.
  • New roi (region of interest) parameter for baselineRemoval* tasks, specifying the region of the sky to be used in estimating the baseline.
  • Removed doInterpolation task parameter.
  • Minor changes and bug fixes (for example, the tasks now do ignore masked data samples when a TodBuffer is used internally).
 
Photometer Moving Object Correction Script
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
  • Takes a SSO observation and corrects the map to be in the moving object frame
  • i.e. target is no longer a streak on a stable background.
>
>
A new script accessed from the top Scripts menu within HIPE:
  • Takes a SSO observation and corrects the map to be in the moving object frame.
  • For example, target is no longer a streak on a stable background.
 
Photometer SPIRE Astrometry Alignment
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
  • Takes a reference SPIRE map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former
  • Takes a reference SPIRE map and a list of SPIRE maps to be corrected and aligns the astrometry of the latter to the former
  • Takes a reference ancillary map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former
  • Takes a referencesource list (as a sourceListProduct) and a SPIRE map to be corrected and aligns the astrometry of the latter to the former
  • In all cases both the Level 2 map astrometry and Level 1 timelines are corrected
>
>
A new script accessed from the top Scripts menu within HIPE:
  • Takes a reference SPIRE map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former.
  • Takes a reference SPIRE map and a list of SPIRE maps to be corrected and aligns the astrometry of the latter to the former.
  • Takes a reference ancillary map and a SPIRE map to be corrected and aligns the astrometry of the latter to the former .
  • Takes a reference source list (as a SourceListProduct) and a SPIRE map to be corrected and aligns the astrometry of the latter to the former.
  • In all cases both the Level 2 map astrometry and Level 1 timelines are corrected.
 
Spectrometer Array Footprint Plot
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
>
>
A new script accessed from the top Scripts menu within HIPE:
 
  • Plots the locations of the detectors on top of an image of the source.

Spectrometer Background Subtraction
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
>
>
A new script accessed from the top Scripts menu within HIPE:
 
  • Provides two methods to subtract residual background from the final spectrum:
Changed:
<
<
    • using the daily dark observation
    • using off-axis detectors
>
>
    • using the daily dark observation.
    • using off-axis detectors.
 This is particularly useful for faint sources.

Spectrometer Line Fitting
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
  • Allows simultaneous fitting of lines and continuum in the central detectors using the HIPE SpectrumFitter
  • CO lines are fitted with a polynomial baseline and results are printed for each line, including the error estimate for the line flux
>
>
A new script accessed from the top Scripts menu within HIPE:
  • Allows simultaneous fitting of lines and continuum in the central detectors using the HIPE SpectrumFitter.
  • CO lines are fitted with a polynomial baseline and results are printed for each line, including the error estimate for the line flux.
 
Spectrometer Thumbnail Mosaic Plot
Changed:
<
<
A new Useful Script accessed from the top Scripts menu within HIPE:
>
>
A new script accessed from the top Scripts menu within HIPE:
 
  • Gives several examples of plotting the spectra from each detector as a thumbnail arranged as the detectors appear in the array.

SDI/SDS Explorer

Changed:
<
<
The SDI and SDS Explorer tools have been updated to:
  • Ability to plot errors as a shaded region on the spectrum added
>
>
The SDI and SDS Explorer tools have been updated with the following features:
  • Added ability to plot errors as a shaded region on the spectrum.
 
  • Right click options added for each detector in the array footprint, including Open With, Send To and Create Variable.
  • Zooming is now permitted in the thumbnail view.

Documentation

Changed:
<
<
  • New SPIRE Launch Pads to give Users an overview of the SPIRE processing, whats available, and quick link jumps into the documentation.
>
>
  • New SPIRE Launch Pads to give you an overview of the SPIRE processing, what's available, and quick link jumps into the documentation.
 
  • A major revision of the SPIRE Data Reduction Guide for both Photometer and Spectrometer Chapters.
Changed:
<
<
  • SPIRE Data Reduction Guide restructured to be "recipe" orientated
  • Includes description of new Useful Scripts accessed from the Scripts menu in HIPE
  • SPIRE Data Reduction Guide includes the manual for mapmaking with the SPIRE Photometer Interactive Analysis (SPIA) plug-in
>
>
  • SPIRE Data Reduction Guide restructured to be "recipe" orientated.
  • Includes description of new scripts accessed from the Scripts menu in HIPE.
  • SPIRE Data Reduction Guide includes the manual for mapmaking with the SPIRE Photometer Interactive Analysis (SPIA) plug-in.
 
 
This site is powered by the TWiki collaboration platform Powered by Perl