(r118) SpireCalibrationWeb < Public

Public Web>SpireCalibrationWeb (revision 118) (raw view)~~EditAttach~~
<!--
   * Set CURRENT_DOC_BUILD = hcss-doc-12.0
 -->

---+ SPIRE instrument and calibration web pages 

%TOC{depth="3"}%

[[http://herschel.esac.esa.int/twiki/bin/view/Public/WebHome][Back to main Herschel Public TWiki page]]

---++ *Introduction* 
This page provides up-to-date information about using the SPIRE instrument: from preparing observations to reducing your data. This page also provides you with the latest calibration accuracies and known SPIRE calibration issues. 


---++ *Documents explaining SPIRE*

<!--The most up to date information on instrument calibration and performance is given in the SPIRE Observers' Manual. This is the reference document used by all the rest of the SPIRE user guides (eg data reduction guide, cookbooks etc). Sometimes it may happen that outdated values are quoted in some of the documents. In such a case use the values given in the SPIRE Observers' Manual. -->

   *  *[[http://herschel.esac.esa.int/Docs/SPIRE/spire_handbook.pdf][The SPIRE Handbook (PDF only)]]*, previously known as the _SPIRE Observers' Manual_. <BR/>

   * A quick guide to the SPIRE instrument: *[[http://herschel.esac.esa.int/Docs/Flyers/SPIRE_flyer_20May2010.pdf][SPIRE fact sheet]]*

   *  *Summary papers from the A&A Special Issue, volume 518 (2010):* 
      * %ICON{"warning"}% Some values on the performance are now outdated. Please consult the SDRG or the SPIRE Handbook for most up to date information.
      *  [[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/aa14519-10.pdf][The Herschel-SPIRE instrument and its in-flight performance]], Griffin et al., 2010, A&A, 518, L3
      *  [[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/aa14605-10.pdf][In-flight calibration of the Herschel-SPIRE instrument]]: Swinyard et al., 2010, A&A, 518, L4, %ICON{"warning"}% superseded by  [[http://ukads.nottingham.ac.uk/abs/2014MNRAS.440.3658S][Swinyard et al., 2014, MNRAS, 440, 3658]]

   * *Detailed documents describing the pipeline algorithms:*
      *  The *[[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/Pipe_Description_2.1.pdf][SPIRE pipeline description document]]* provides an overview of the pipeline structure, listing every module and the details of its purpose, inputs, outputs and algorithms
      *  The *[[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/Phot_Pipeline_Issue7.pdf][SPIRE Analogue Signal Chain and Photometer Detector Data Processing Pipeline]]*  sets out the general bolometer processing and Photometer pipeline algorithms in much more detail.
      *  The *[[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/SPIRE-BSS-DOC-002966_SPIRE_Spectrometer_pipeline_description_Issue_4_0_1.pdf][SPIRE Spectrometer Pipeline Description]]*  sets out the Spectrometer pipeline algorithms in detail. 

   * *Documents with relevance to the SPIRE flux calibration:*
      * [[%ATTACHURL%/SPIRE_Detector_Parameter_Sensitivity_Issue_1_Nov_14_2007.pdf][Sensitivity of the SPIRE Detectors to Operating Parameters]], Griffin M., 2007, SPIRE-UCF-DOC-002901
      * [[http://ukads.nottingham.ac.uk/abs/2013MNRAS.434..992G][Flux Calibration of Broadband Far Infrared and Submillimetre Photometric Instruments: Theory and Application to Herschel-SPIRE]], Griffin et al., 2013, MNRAS, 434, 992
      * [[http://ukads.nottingham.ac.uk/abs/2013MNRAS.433.3062B][Flux calibration of the Herschel-SPIRE photometer]], Bendo et al., 2013, MNRAS, 433, 3062
      * [[http://ukads.nottingham.ac.uk/abs/2013A%26A...556A.116W][Observing extended sources with the Herschel SPIRE Fourier Transform Spectrometer]], Wu et al., 2013, A&A, 556, 116
      * [[http://ukads.nottingham.ac.uk/abs/2013ApOpt..52.3864M][Beam profile for the Herschel-SPIRE Fourier transform spectrometer]], Makiwa et al., 2013, Applied Optics, 52, 3864
      * %ICON{"new"}%[[http://ukads.nottingham.ac.uk/abs/2014MNRAS.440.3658S][Calibration of the Herschel SPIRE Fourier Transform Spectrometer]], Swinyard et al., 2014, MNRAS, 440, 3658

----+++ AOT release notes

|  *Photometer* | |
| Photometer point source mode | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_PointSource_AOT_ReleaseNote_30Apr2010.pdf][SPIRE photometer point source release note (30 April 2010)]]  |
| Photometer scan map mode | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_ScanMap_ReleaseNote_20Oct2009.pdf][SPIRE scan map release note (20 October 2009)]], [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_ScanMap_ReleaseNote_Addendum_02Jun2010.pdf][ADDENDUM to scan map mode (2 June 2010)]]  |
| Photometer small scan map mode | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_Small_ScanMap_ReleaseNote_17Mar2010.pdf][SPIRE small scan map mode (17 March 2010)]] |

| *Spectrometer* | |
| FTS point source mode (sparse) | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_Spectrometer_PointSource_ReleaseNote_21May2010.pdf][Spectrometer point source mode release note (21 May 2010)]]  |
| FTS mapping mode (intermediate, full) | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_Spectrometer_Mapping_ReleaseNote_30Apr2010.pdf][Spectrometer mapping mode release note (30 April 2010))]] |
| FTS bright source modes | [[http://herschel.esac.esa.int/Docs/AOTsReleaseStatus/SPIRE_Spectrometer_BrightMode_ReleaseNote_07Sep2010.pdf][Spectrometer bright source release note (7 September 2010)]]  |


---++ *Reducing SPIRE data*

----+++ Software and documentation

   *  *HIPE (Herschel Interactive Processing Environment)*: The latest User Release HCSS version that you should use for reducing SPIRE data can be downloaded from: http://herschel.esac.esa.int/HIPE_download.shtml.

   *  We also provide access to the latest stable developer build (latest stable CIB).
      * *Beware* _These developer builds do not undergo the same in-depth testing as the user releases do._ The latest developer build can be found [[http://herschel.esac.esa.int/CIB_disclaimer.html][here]]. <br/>%ICON{"info"}% Please contact the _Herschel_ helpdesk if you plan to use a developer build as there may be some additional information needed in order for you to properly make use of it.

   * Within HIPE you can access all the SPIRE data reduction and HIPE-user documentation. The *SPIRE Data Reduction Guide (SDRG)* follows the user pipeline scripts and also explains the details of pipeline processing and data analysis. It is also available online here:
      * [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/][HIPE-user documentation for latest released version (html)]]
      * [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/print/spire_drg/spire_drg.pdf#spire_drg][SDRG PDF format]] 

   * *SPIA*: The SPIRE Photometer Interactive Analysis (SPIA) package is available in HIPE (previously it was a plugin). SPIA provides a structured GUI based access to the more intricate parts of the scan map photometer pipeline for SPIRE without the immediate need to resort to scripts. More information can be found in the SDRG or on the  [[https://nhscsci.ipac.caltech.edu/sc/index.php/Spire/SPIA][SPIA web page]]
      * %ICON{"info"}% Note: A bug that renders two deglitchers in the task spiaLevel1 unusable was found only recently. We have prepared a quick fix that will work on a standard HIPE 12.1 installation. Please see the [[https://nhscsci.ipac.caltech.edu/sc/index.php/Spire/SPIA][SPIA web page]] for more information.

----+++ The SPIRE Launch Pads

   *  The *SPIRE Launch Pads* are single sheet quick entries (like a cheat sheet) into SPIRE data reduction and providing quick references to the relevant sections in the SPIRE Data Reduction Guide. There are launch pads for [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drg/html/spire-launchpad.html#data_launchpad][Data Access]], [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drg/html/photometer_launchpad.html][SPIRE Photometer]] and  [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drg/html/spec_launchpad.html][Spectrometer data reduction]].

<!--
%TABLE{tablewidth="60%" valign="top" headerrows="1" sort="off" initsort="1" initdirection="down"}%
| *Document* |   *Version* |
| [[%ATTACHURL%/SPIRE_DataLaunchPad_v1.6.pdf][SPIRE Data Launch Pad]] | version 1.6 |
| [[%ATTACHURL%/SPIRE_PhotometerLaunchPad_v1.7.pdf][SPIRE Photometer Launch Pad]] | version 1.7 |
| [[%ATTACHURL%/SPIRE_SpectrometerLaunchPad_v1.7.pdf][SPIRE Spectrometer Launch Pad]] | version 1.7 |
-->


----++ *Spectrometer data reduction*

The best source of information for reducing SPIRE Spectrometer data is the *SPIRE Data Reduction Guide* available through the HIPE help. This runs through the User Pipeline scripts step by step, describes several other Useful Scripts, and offers advice for specific types of sources:

   * Faint (<10 Jy) and medium (<100 Jy) strength sources
   * Bright sources (>500 Jy)
   * Semi-extended sources
   * Spectral mapping observations
   * Observations with few repetitions

For faint sources, the subtraction of instrument, telescope and background emission is particularly important. Optimum subtraction can be performed in several ways (read the *SPIRE Data Reduction Guide* for details):

   1. Subtract the Dark Sky spectrum closest to your observation (use the "Background Subtraction" script in HIPE)
   2. Subtract the spectrum of surrounding detectors (use the "Background Subtraction" script in HIPE)

Dark Sky observations are observed on every SPIRE Spectrometer OD, and are all public in the Archive. 

[[http://herschel.esac.esa.int/twiki/bin/view/Public/SpireDailyDarkObservations][A listing of the available *Dark Sky observations* can be found here]].


<!--
----++++ Spectral Cube Analysis

*Spectral cubes* are produced by the Spectrometer pipeline for mapping observations. Some tips, suggestions and examples of spectral cube analysis for SPIRE data are provided [[FtsCubeSection9][here]].

-->



----++ *Photometer data reduction*

----+++ Overview
The best source of information for reducing SPIRE Photometer data is the [[http://herschel.esac.esa.int/hcss-doc-12.0/load/spire_drg/html/spire_drg.html][SPIRE Data Reduction Guide]] available as a standalone hyperlink document as well as through the HIPE help. This runs through the User Pipeline scripts step by step, describes several other Useful Scripts, and offers advice for specific issues that might be encountered.


----+++ Data Processing Issues

The main issues that you might find in your data are: _undetected glitches_, _thermistor or detector jumps_, and _bad baseline removal_.

   * *Stripes in PSW, PMW and/or PLW (Level 2) maps*
      * All SPIRE Photometer pipelines now use the destriper by default, which improves the issue of stripes in Level 2 maps. There should be noticeable improvements in that respect from HIPE version 9 onwards. The destriper documentation can be found on the [[https://nhscsci.ipac.caltech.edu/sc/index.php/Spire/PhotScanMapDestriper][NHSC website]]

   * *De-glitcher masks faint sources*
      *  For data taken in Parallel Mode in particular (sampling at 10Hz, at high speed 60"/s), the de-glitcher may flag very faint sources as glitches when it is run with standard parameters. Faint sources may have a "delta function" shape due to the low sampling rate, which looks similar to a small glitch. Try modifying the "correlation parameter" to 0.95: this will decrease the number of detected glitches - it may be better to have a limited detection rate in first level deglitching and defer to Level 2 deglitching.

   * *Cooler temperature variations (Cooler Burps)*
      * The SPIRE cooler is recycled after 48 hours. Between 6 to 7h after the cooler recycle ends, its temperature rises steeply and reaches the stable _plateau_. Observations taken during such times may exhibit stripes in the final maps. An option to correct for this effect is now available in the User Pipelines (See the SPIRE DRG for details).

   * *NaN pixels present in the PSW, PMW and/or PLW (Level 2) maps*
      * This effect, related to data masking or poor coverage, is more evident in single fast-scan Parallel Mode maps. To avoid !NaNs, increase the pixel size (i.e., decrease the map's resolution).
      * This effect can also occur with destriped maps. In this case check if increasing the sigma parameter or switching off the Level 2 deglitcher helps. 

   * *Quality flags in the quality context*
      * Currently, the quality flags at the quality context inside the observation context are just meant for HSC/ICC internal evaluation of the quality of the products and not for the users. In case the data had some serious quality problem, the PI of the program has been contacted about it. Otherwise, only information in the quality summary, when available, should concern the observers. 


----+++ Known Issues in ODs 1304 & 1305

For (yet) unknown reasons, the three detectors PSW-B5, PSW-E9 and PSW-F8 - that use to behave well during the entire mission - were noisy during the two operational days 1304 and 1305. The result are stripes visible in the final PSW map which the current (HIPE 11) pipeline is not able to correct. The solution is to mask and exclude these detectors from the analysis. This could be done in 2 ways:
   1. You can use the =SpireMaskEditor= GUI as described in Sec. 8.4 of the [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drg/html/SPIRE-Masks.html][SPIRE Data Reduction Guide]]: write-click on your observation context variable and then select =Level1_SpireMaskEditor= and set to =Master= all samples in all scans (listed as BBID) for the detectors mentioned above.
   2. Alternatively, you can use [[%ATTACHURL%/correct_od1304_1305.py.txt][these lines of code]]

   * After either of those cases, you must then re-run level 1 to 2 steps on the newly modified level1 product. If your observation has been already re-reduced with HIPE 11, original and new level1s are already destriped, so you can directly run the naive map-maker on the new level1. Otherwise, you must run the destriper step: check the pipeline script for details.


----+++ Planck-HFI & Herschel-SPIRE cross calibration: absolute offset re-processing

As of HCSS 11, a new task named ==zeroPointCorrection== is available to the users: this task calculates the absolute offset for a SPIRE map based on cross-calibration with HFI-545 and HFI-857 maps, colour-correcting HFI to SPIRE wavebands assuming a grey body function with fixed beta. 

Details on how to run the task are available in [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drg/html/ch06s08.html][the SPIRE Data Reduction Guide, Section 6.8]]

<!-- Herschel-SPIRE detectors are only sensitive to relative variations, and so as a consequence, the absolute brightness of the observed region is unknown and maps are constructed such that they have zero median. The Planck-HFI detectors are similar to the SPIRE ones, but the Planck observing strategy allowed it to (almost) observe a great circle on the sky every minute (having a 1 rpm spinning rate). By comparing the sky brightness as measured by COBE-FIRAS at the galactic poles (where the dust emission is lower), HFI is capable of setting an absolute offset to its maps. SPIRE and HFI share two channels with overlapping wavebands: SPIRE-PMW and HFI-857 have a similar filter profile, while SPIRE-PLW and HFI-545 are shifted by ~10%.
-->

<!-- To run the task, you will need to download the 2 Planck maps [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/SPIRE/PHOT/HFI_Maps/DX9_map_545_smooth_8arcmin.fits][HFI-545]] and [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/SPIRE/PHOT/HFI_Maps/DX9_map_857_smooth_8arcmin.fits][HFI-857]] maps from the [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/SPIRE/PHOT/HFI_Maps][HSC/SPIRE FTP area]] as they are not included in the HIPE distribution. These maps are derived from the ones available in the Planck Legacy Archive, but convolved with an 8 arcmin Gaussian beam in order to _circularize_ the effective map beams, plus the maps absolute offset as estimated by the Planck-HFI team via cross-calibration with FIRAS (see Planck Collaboration VIII. 2013, In preparation)
--> 

<!-- The offsets are computed on extdPxW maps, calibrated for extended emission, with extended gain correction applied and in units of MJy/sr (as explained in the [[http://herschel.esac.esa.int/hcss-doc-11.0/load/spire_drg/html/Herschel-Planck-Cross-Calibration.html][section 4.10 of the SPIRE Data Reduction Guide]]). Hence, the re-processing will start from a level-1 context (which may be the result of merging multiple observations, see e.g. the ==Photometry Map Merging== scirpt available in HIPE under the menu ==Scripts== &rarr; ==SPIRE Useful script==) and then executing the ==zeroPointCorrection== task with one of the following methods:
   1. Run the [[%ATTACHURL%/zeroPointCorr_HIPE11.py.txt][zeroPointCorr_HIPE11.py script]]. It assumes that *the observation has been reduced with HIPE 11* or later versions. It also sets the location of the two Planck maps by the ==zeroPointCorrection== task: *please modify the ==PATH_TO_FILE== accordingly to your set-up*.
   1. Alternatively, run the correction using the SPIA interface ([[https://nhscsci.ipac.caltech.edu/sc/index.php/Spire/SPIA][SPIRE Photometer Interactive Analysis]]). In order to be able to run the ==zeroPointCorrection== task, the ==user.props== file present (by default) in you ==$HOME/.hcss== directory must be modified and the following lines added (*please modify the ==PATH_TO_FILE== accordingly to your set-up*):
      * ==spire.spg.hfi.545map = PATH_TO_FILE/DX9_map_545_smooth_8arcmin.fits==
      * ==spire.spg.hfi.857map = PATH_TO_FILE/DX9_map_857_smooth_8arcmin.fits==
-->
<!--
A detailed descirption of the algorithm used for the cross-calibration with Planck and implemented in the ==zeroPointCorrection== is described in the [[http://herschel.esac.esa.int/hcss-doc-11.0/index.jsp#spire_drg:Herschel-Planck-Cross-Calibration][HIPE 11 SPIRE Data Reduction Guide, sec. 4.10]].
-->

----+++ Source Extraction and Photometry

   * The current recommended method for photometry =sourceExtractorTimeline= task (formerly known as the Timeline Fitter) which works on the detector timelines. The Map based algorithm  =sourceExtractorSussex= (SUSSEXtractor) providers good results and is useful on larger maps where the  =sourceExtractorTimeline= will be significantly slower. =sourceExtractorDaophot= (DAOphot) also provides a reasonable estimate of the source flux but may require an aperture correction.

   * Photometry on single direction fast scan parallel mode maps: The photometry on single scan direction fast parallel mode results in higher photometric errors of up to 5 percent for aperture photometry compared to nominal speed and cross linked maps. The best results are obtained using the Timeline Fitter. Wherever possible orthogonal and nominal direction parallel scans should be merged.

   * Between HIPE11 and HIPE12 default size of the PRF used by SUSSEXtractor was changes from a 5x5 PRF to a 13x13 PRF to allow a more complete coverage of the PRF edges. Note that this change has an effect on the resulting flux densities measured by SUSSEXtractor with the HIPE 12 results being systematically higher by about 10 % compared to Timeline Fitter. Caution is advised using SUSSEXtractor with HIPE12. The original HIPE11 results can be replicated by [[%ATTACHURL%/SUSSEXTractorHIPE11.py.txt][this script ]]

----+++ SPIRE report from the January 2013 HSC Map Making Workshop

   * The official release of the report of SPIRE map-making test campaign (2013) can be [[https://nhscsci.ipac.caltech.edu//spire/docs/report_main_v5.pdf][downloaded as a PDF]].
   * A dedicated webpage to this matter is available at the [[https://nhscsci.ipac.caltech.edu/sc/index.php/Spire/SPIREMap-MakingTest2013][NHSC website]]



---++ *Cookbooks* 

Cookbooks are provided inside the SPIRE Data Reduction Guide (see above).

The standalone "Photometry Cookbook", is no longer maintained - it is being incorporated into the SPIRE DRG - please see the SDRG  for photometry cookbook information, and raise a [[http://herschel.esac.esa.int/esupport/][Helpdesk]] ticket if you find  something missing.



---++ *SPIRE calibration file versions*

The available calibration trees for SPIRE are listed below (with the current operational version at the top).

%TABLE{ tablewidth="100%" valign="top" headerrows="1" sort="off" initsort="2" initdirection="up"}%
| *SPIRE Calibration Tree (& release note)* | *Release Date* | *Applicable HIPE Version* | *Comment* | 
| *[[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_12_3.html][SPIRE_CAL_12_3]]*  | *May 2014* | *HIPE v12.1* | *Calibration tree currently used in operations*  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_12_2.html][SPIRE_CAL_12_2]]  | March 2014 | HIPE v12 |  |
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_11_0.html][SPIRE_CAL_11_0]] | July 2013 | HIPE v11 | Final v11 cal tree  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_10_1.html][SPIRE_CAL_10_1]] | Jan 2013 | HIPE v10 | Final v10 cal tree  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_9_1.html][SPIRE_CAL_9_1]] | July 2012 | HIPE v9 | Final v9 cal tree  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_8_1.html][SPIRE_CAL_8_1]] | Dec 2011 | HIPE v8 | Final v8 cal tree  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_7_0.html][SPIRE_CAL_7_0]] | May 2011 | HIPE v7 | Final v7 cal tree.  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_6_1.html][SPIRE_CAL_6_1]] | Feb 2011 | HIPE v6   | Final v6 cal tree  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_6_0.html][(SPIRE_CAL_6_0)]] | Feb 2011 | HIPE v6  | Spec major update  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_5_2.html][SPIRE_CAL_5_2]] | Feb 2011 | HIPE v5 | Final v5 cal tree | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_5_1.html][(SPIRE_CAL_5_1)]] | Jan 2011 | HIPE v5 |  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_5_0.html][(SPIRE_CAL_5_0)]] | Nov 2010 | HIPE v5  | Phot flux conv. based on Neptune. Spec major update  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_4_0.html][SPIRE_CAL_4_0]] | July 2010 | HIPE v4  | Spec point source flux conv based on Uranus | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_3_2.html][SPIRE_CAL_3_2]] | June 2010 | HIPE v3 |  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_3_1.html][(SPIRE_CAL_3_1)]] | Mar 2010 | HIPE v3 |  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_3_0.html][(SPIRE_CAL_3_0)]] | Mar 2010 | HIPE v3  |  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_2_1.html][SPIRE_CAL_2_1]] | Jan 2010 | HIPE v2  | Spec point source flux conv based on Vesta | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_2_0.html][(SPIRE_CAL_2_0)]] | Jan 2010 | HIPE v2 |  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_1_2.html][SPIRE_CAL_1_2]] | Oct 2009 | HIPE v1  | Phot flux conv based on Ceres  | 
| [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/load/spire_drm/spire/release/cal/spire_cal_1_1.html][(SPIRE_CAL_1_1)]] | July 2009 | HIPE v1 | Pre-launch dummy values | 

Details of individual calibration products can be found [[SpireCalibrationProducts][here]].

   * Any of the calibration trees can be retrieved in HIPE from the HSA using (e.g.) =cal = spireCal(calTree="spire_cal_12_3")= etc. The default (applicable to the HIPE version in use) can be obtained with =cal = spireCal(calTree="spire_cal")=. It can then be saved to a local pool right-clicking on the =cal= variable and then selecting from the context menu _Send To -> Local Pool_.
   * Alternatively, the latest calibration tree for SPIRE can be obtained as a jar file from [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/latest_cal_tree/][Latest calibration trees]]. Then, you have to possibilities to read and save:
      1. The jar file can be load directly into HIPE with the command: =cal = spireCal(jarFile="PATH_TO_FILE/spire_cal_12_3.jar")=. To save it to a local pool, proceed as described above, right-clicking on the =cal= variable and then selecting from the context menu _Send To -> Local Pool_.
      2. The jar file can also be saved directly to a local pool without opening HIPE, running the following command in the terminal command line: =cal_import PATH_TO_FILE/spire_cal_12_3.jar=. Then, to load the calibration tree in HIPE, simply type: =cal = spireCal(pool="spire_cal_12_3")=

See [[http://herschel.esac.esa.int/%CURRENT_DOC_BUILD%/][the SPIRE Data Reduction Guide]] for more details. 


---++ *SPIRE calibration and performance* 

----+++ Photometer calibration

   * *SPIRE Photometer Calibration:* <br/>Full details of the SPIRE calibration can be found in the [[http://herschel.esac.esa.int/Docs/SPIRE/spire_handbook.pdf][SPIRE Handbook]] and in dedicated publications: the calibration scheme is described in  [[http://ukads.nottingham.ac.uk/abs/2013MNRAS.434..992G][Griffin et al. (2013)]] and the implementation using Neptune as the primary calibration standard, is described in [[http://ukads.nottingham.ac.uk/abs/2013MNRAS.433.3062B][Bendo et al. (2013)]].
      * Calibration uncertainties, which should be included in addition to the statistical errors of any measurement, are as follows:
         * ± 4% absolute from Neptune model (this uncertainty is systematic and correlated across the three bands)
         * ± 1.5% (random) from Neptune photometry
      * Extended emission calibration
         * In addition to the above uncertainties, there is an additional ±4% uncertainty due to the current uncertainty in the measured beam area
 <!--     * Additionally repeatability of measured photometry to flux densities >100mJy ~ 2% -->

   * *SPIRE Photometer Beams:* 
      * These are available in the SPIRE calibration context, at the standard map pixel size of (6,10,14) arcsec/pixel for (250,350,500) µm bands, and can be accessed in HIPE after a calibration context has been loaded (see above).
      * %ICON{"new"}% A new more detailed analysis of the SPIRE beam profile data was undertaken in 2012, leading to revised values for beam profile solid angles and derivation of a semi empirical wavelength dependent beam profile model. The results at a scale of 1 arcsec/pixel as well as the data needed for the model are available for [[SpirePhotometerBeamProfile][download]]. A detailed [[SpirePhotometerBeamProfileAnalysis][description of the analysis]] is given as well.
<!--      * %ICON{tip}% The observed beams at much finer scale of 1 arcsec/pixel, as well as the theoretical ones, are available from [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/SPIRE/PHOT/Beams/][here]] . Please read the [[http://herschel.esac.esa.int/twiki/pub/Public/SpireCalibrationWeb/beam_release_note_v1-1.pdf][release note]] for more details. -->
   * *SPIRE Photometer filter transmission curves:* 
      * These are also available in the SPIRE calibration context (photRsrf) and can be accessed in HIPE after a calibration context has been loaded (See above).

   * *Neptune and Uranus models used for the SPIRE photometer flux calibration:* 
      * The ESA2 models  used up to HIPE v10 and =spire_cal_10_1=, are available [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/PlanetaryModels/ESA2/][here]]. 
      * %ICON{"new"}% The ESA4 models used from HIPE v11 and =spire_cal_11_0=, are available [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/PlanetaryModels/ESA4/][here]]. 

----+++ Spectrometer calibration

   * *SPIRE Spectrometer Calibration:* <br/>Full details of the SPIRE FTS calibration can be found in the [[http://herschel.esac.esa.int/Docs/SPIRE/spire_handbook.pdf][SPIRE Handbook]] and in [[http://ukads.nottingham.ac.uk/abs/2014MNRAS.440.3658S][Swinyard et al., 2014]]
      * Calibration uncertainties, which should be included in addition to the statistical errors of any measurement from *HIPE v11* onwards, are as follows:
         *  *Point sources observed on the centre detectors* (SSWD4 and SLWC3): the measured repeatability is 6%, with the following contributions: (i) absolute systematic uncertainty in the models from comparison of Uranus and Neptune - determined to be ±3%;  (i) the statistical repeatability determined from observations of Uranus and Neptune, with pointing corrected - estimated at ±1% (excluding the edges of the bands); (iii) the uncertainties in the instrument and telescope model, which lead to an additive continuum offset error of 0.4 Jy for SLW and 0.3 Jy for SSW and (iv) the effect of the _Herschel_ APE.
         * *Sparse observations of significantly extended sources:* 
            * the absolute uncertainty in intensity for a reasonably bright, fully extended object, observed in the central detectors is, in theory, ±1%, with the following contributions: (i) the systematic uncertainty in telescope model of 0.06%; (ii) the statistical repeatability estimated at ±1% and (iii) an additive continuum offset of 3.4x10<sup>-20</sup> W/m<sup>2</sup>/Hz/sr for SLW and 1.1x10<sup>-19</sup> W/m<sup>2</sup>/Hz/sr for SSW.
            * In practice, truly extended sources tend to be faint and the uncertainty is therefore dominated by the additive offsets. When the source extent is larger than the main beam size, but not fully extended, or if there is structure inside the beam, then the uncertainties are dominated by the source-beam coupling ([[http://adsabs.harvard.edu/abs/2013A%26A...556A.116W][see Wu et al. 2013]] ) and are significantly greater than 1%.
         * *Mapping mode:* the variations between detectors becomes important and the overall repeatability has been measured as ±7% (see Benielli et al. 2013, submitted, for a full discussion of mapping mode observations). The off-axis detectors are less well calibrated, especially outside the unvignetted part of the field.

   * *Uranus model used for the SPIRE FTS point-source flux calibration:* 
      * The ESA4 model, used from HIPE v10 onwards, is available [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/PlanetaryModels/ESA4/][here]]. 

---++ *Interest groups and scripts*

   * The following interest groups relate to processing of observations taken with SPIRE. The links provided allow subscription to these interest groups.
      * [[http://www.sciops.esa.int/mailman/listinfo/herschel_dp_spirephot/][subscribe]] to the SPIRE Photometer interest group
      * [[http://www.sciops.esa.int/mailman/listinfo/herschel_dp_parallel/][subscribe]] to the SPIRE and PACS parallel mode large map and point source extraction interest group 
      * [[http://www.sciops.esa.int/mailman/listinfo/herschel_dp_spirespec/][subscribe]] to the SPIRE Spectrometer interest group
      * [[http://www.sciops.esa.int/mailman/listinfo/herschel_dp_specmap/][subscribe]] to the PACS, SPIRE and HIFI spectral maps interest group
   * User contributed scripts: Users are welcome to submit scripts and software that they believe could be of general interest to the community to the Herschel [[http://herschel.esac.esa.int/esupport/Helpdesk]].

---++ *Further information*

Contact the [[http://herschel.esac.esa.int/esupport/][Helpdesk]]
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	Offset_Estimation_Description.pdf	r1	manage	2352.7 K	2013-06-13 - 15:09	LucaConversi
pdf	Phot_Pipeline_Issue7.pdf	r1	manage	453.9 K	2011-05-06 - 11:07	LucaConversi
pdf	Pipe_Description_2.1.pdf	r1	manage	2078.9 K	2011-05-06 - 11:06	LucaConversi
pdf	SPIRE-BSS-DOC-002966_SPIRE_Spectrometer_pipeline_description_Issue_4_0_1.pdf	r1	manage	793.5 K	2012-02-28 - 09:49	EdwardPolehampton
pdf	SPIRE_DataLaunchPad_v1.6.pdf	r1	manage	200.4 K	2012-08-24 - 13:57	ChrisPearson	SPIRE Data Launch Pad v1.6
pdf	SPIRE_Detector_Parameter_Sensitivity_Issue_1_Nov_14_2007.pdf	r1	manage	185.0 K	2013-05-21 - 08:17	IvanV	Sensitivity of the SPIRE Detectors to Operating Parameters
pdf	SPIRE_PhotometerLaunchPad_v1.7.pdf	r1	manage	205.4 K	2012-08-24 - 13:58	ChrisPearson	SPIRE Photometer Launch Pad v1.7
pdf	SPIRE_SpectrometerLaunchPad_v1.7.pdf	r1	manage	190.6 K	2012-08-24 - 13:57	ChrisPearson	SPIRE Spectrometer Launch Pad v1.7
txt	SUSSEXTractorHIPE11.py.txt	r1	manage	0.5 K	2014-07-01 - 14:48	ChrisPearson	Script to recover HIPE11 SUSSEXtractor behaviour
fits	SpireHfiColourCorrTab_v1.1.fits	r1	manage	19.7 K	2013-06-04 - 11:09	LucaConversi
pdf	aa14519-10.pdf	r1	manage	1321.5 K	2011-01-24 - 09:51	AnthonyMarston	SPIRE A&A paper, Griifin et al 2010
pdf	aa14605-10.pdf	r1	manage	264.1 K	2011-01-24 - 16:48	IvanV	SPIRE in-flight calibration
pdf	beam_release_note_v1-1.pdf	r1	manage	4044.5 K	2011-05-11 - 09:44	LucaConversi
txt	correct_od1304_1305.py.txt	r1	manage	0.6 K	2013-07-26 - 10:04	EdwardPolehampton	Script to correct photometer data in ODs 1304/1305
txt	zeroPointCorr.py.txt	r1	manage	2.9 K	2013-06-10 - 08:53	LucaConversi
txt	zeroPointCorr_HIPE10.py.txt	r1	manage	2.7 K	2013-08-12 - 14:08	LucaConversi
txt	zeroPointCorr_HIPE11.py.txt	r1	manage	2.7 K	2013-08-12 - 14:09	LucaConversi
Topic revision: r118 - 2014-07-23 - BernhardSchulz
Public
Webs
Public
TWiki