Difference: PacsCalibrationWeb (105 vs. 106)

Revision 1062014-03-17 - BrunoAltieri

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

PACS instrument and calibration web pages

Line: 56 to 56
 

Brief explanation

A brief introduction to reducing PACS data in HIPE. You can consult the PACS Data Reduction Guides (photometry and spectroscopy) for more detail.
  • PACS data are reduced with pipeline scripts which are a set of command-line tasks that process the data from Level 0 (raw) to Level 2/2.5 (science-ready). There is more than one flavour of pipeline script, tailored to different types of science target, AOT, and observing plan (e.g. mapping or single pointing for spectroscopy). These 'interactive' pipeline scripts are provided in HIPE and explained in the data reduction guides.
Changed:
<
<
  • The data you get from the the HSA will have been processed by the 'SPG' (Standard Product Generator), meaning that they are processed with a tailored version of the latest pipeline scripts from the User Release. For example, when HIPE User Release 11.0 is released, soon after all the Herschel data are processed with the SPG pipeline scripts of version 11.0, and so on for each User Release.
>
>
  • The data you get from the the HSA will have been processed by the 'SPG' (Standard Product Generator), meaning that they are processed with a tailored version of the latest pipeline scripts from the User Release. For example, when HIPE User Release 11.0 was released, soon after all the Herschel data are processed with the SPG pipeline scripts of version 11.0, and so on for each User Release.
 
  • These SPG scripts are a copy of one flavour of interactive pipeline scripts, differing only on the AOT type. The SPG scripts include all the stable pipeline tasks with settings that correspond to the most common type of science target for each AOT. But some pipeline tasks can only be run via the interactive pipeline scripts, and to modify the important parameter settings for pipeline tasks also requires you re-run the pipeline. The Launch Pads (see below) include a guide to understanding the pipeline scripts and how to decide which to run.
  • The SPG results a good starting point to look at your PACS data, but in most cases you can improve the results at least somewhat by reducing the data yourself.

HIPE and data reduction documentation

Changed:
<
<
  • HIPE (Herschel Interactive Processing Environment) is the tool used to inspect, reduce, and analyse Herschel data. The latest User Release HCSS (Herschel common science system) version that you should use for reducing PACS data is HIPE v11.1 It can be downloaded from: http://herschel.esac.esa.int/HIPE_download.shtml. In the CIB (continuous integration build) this version corresponds to Track 11, build 3010. (The CIB is the continuously bug-fixed/upgraded/improved version of HIPE, which every X months becomes a stable User Release. The CIB has the latest software in it, but it will not be bug-free.)
>
>
  • HIPE (Herschel Interactive Processing Environment) is the tool used to inspect, reduce, and analyse Herschel data. The latest User Release HCSS (Herschel common science system) version that you should use for reducing PACS data is HIPE v12.0 It can be downloaded from: http://herschel.esac.esa.int/HIPE_download.shtml. In the CIB (continuous integration build) this version corresponds to Track 12, build 2603. (The CIB is the continuously bug-fixed/upgraded/improved version of HIPE, which every X months becomes a stable User Release. The CIB has the latest software in it, but it will not be bug-free.)
 
Changed:
<
<
  • Within HIPE you can access all the PACS data reduction documentation and the general HCSS and HIPE user documentation for Track 11. The documentation provided via HIPE opens in a web browser, but for those of you who prefer PDF, we include the PACS Data Reduction Guides as PDF files here (note that within the standalone pdf versions, external links will not work):
>
>
  • Within HIPE you can access all the PACS data reduction documentation and the general HCSS and HIPE user documentation for Track 12. The documentation provided via HIPE opens in a web browser, but for those of you who prefer PDF, we include the PACS Data Reduction Guides as PDF files here (note that within the standalone pdf versions, external links will not work):
 
Changed:
<
<
>
>
 
Added:
>
>
<--  
-->
 
  • The full documentation-set provided via HIPE includes the following:
    • The PACS (HIFI and SPIRE) DRGs. The main function of the PACS DRGs (photometry and spectroscopy) is to take you through reducing your data with the interactive pipeline, explaining the steps and the individual tasks in more detail and showing you how to inspect your results. This makes them rather long documents, and they should be read along with the pipeline scripts rather than on their own. They also show you how to quick-look at the SPG products you get from the HSA, what to consider before and after reducing your data, and explain what is contained in the PACS data products you get from the HSA.
Line: 76 to 79
 
    • The Scripting Guide: the language of HIPE is 'HIPE's version of jython', and it is a full scripting environment in which you can manipulate data, do mathematics, and view data in various ways. The 'SG' is a guide to scripting in HIPE. It is not necessary, but it does help, if you are already comfortable with scripting before embarking on scripting in HIPE.
    • Reference manuals. For most of the tasks that you can run in HIPE the description of what they do and listings of all the parameters can be found in the 'User's Reference Manual'. To learn more about the various HIPE product classes you can read the JAVA docs (APIs) a.k.a. the 'Developer's Reference Manual'. These tell you e.g. how to manipulate spectra and images directly by querying on the product, rather than using a pre-provided task.

Changed:
<
<
  • The what's new in HIPE 11 page lists the changes in HIPE version 11.1 with respect to the 10.x series, provides a detailed lists of updated functionalities and calibration aspects.
>
>
  • The what's new in HIPE 12 page lists the changes in HIPE version 12.0 with respect to the 11.x series, provides a detailed lists of updated functionalities and calibration aspects.
 
Line: 149 to 152
 

Photometer map-makers

Changed:
<
<
Three fundamentally different map-makers are offered in Hipe 11 with ipipe scripts, starting from level 1 on pairs of obsids :
>
>
Three fundamentally different map-makers are offered in Hipe 12 with ipipe scripts, starting from level 1 on pairs of obsids :
 
  • highpass filtering branch, where the bolometer timelines are highpass filtered to remove the 1/f noise at the expense of extended emission. It provides optimum sensitivity to point-sources
  • MADmap, a GLS (generalized least square) map-maker, that allows to preserve extended emission at all scale
  • JyScanam, a Java-version of the IDL Scanamorphos map-maker
Line: 160 to 163
  A report of the map-making working group compiled by Roberta Paladini is available: PACS map-making tools: analysis and benchmarking, 1 Nov. 2013.
Changed:
<
<
The optical field distortion is not applied in level 1, as this calibration is applied by the native photProject task. As a result, external map-makers starting from level 1 have a systematic flux overestimate of 6-7% in the red channel and a lower underestimate (~2%) in the blue channel of the flux scale. This will be corrected for MADmap in Hipe12/SPG12 by introducing the new task convertToFixedPixelSize() at the end of level1. The flux difference come from the fact that the mean values of the optical flat are significantly different from 1, in other words it cannot be assumed by external map-makers that the pixel sizes is constant of the field of view at 3.2"/6.4 in the blue/red channel respectively.
>
>
The optical field distortion is not applied in level 1, as this calibration is applied by the native photProject task. As a result, external map-makers starting from level 1 have a systematic flux overestimate of 6-7% in the red channel and a lower underestimate (~2%) in the blue channel of the flux scale. This is corrected for MADmap in Hipe12 by introducing the new task convertToFixedPixelSize() at the end of level1. The flux difference come from the fact that the mean values of the optical flat are significantly different from 1, in other words it cannot be assumed by external map-makers that the pixel sizes is constant of the field of view at 3.2"/6.4 in the blue/red channel respectively.
  Scanamorphos and Unimap are also affected, but not JScanam that makes use of photProject.
Line: 204 to 207
  to build maps from scan observations made with bolometer arrays, in particular with the PACS and SPIRE photometers.
Added:
>
>
 
META FILEATTACHMENT attr="" autoattached="1" comment="Raw measurements PACS beams - central spaxel only" date="1362764493" name="SpecSpatial_BeamEfficiency_central_spaxel_tables_v1.tar.gz" path="SpecSpatial_BeamEfficiency_central_spaxel_tables_v1.tar.gz" size="123836" user="Main.BartVandenbussche" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="PDRG Spectroscopy from May 2012" date="1337955024" name="PDRG_Spec_May12.pdf" path="PDRG_Spec_May12.pdf" size="2554752" user="Main.KatrinaExter" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="Mueller exp. astr. paper 2013" date="1383609091" name="ExpAstr_PrimeAsteroids_revision1.pdf" path="ExpAstr_PrimeAsteroids_revision1.pdf" size="950563" user="Main.BrunoAltieri" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1288887824" name="aa14535-10.pdf" path="aa14535-10.pdf" size="1608742" user="Main.BrunoAltieri" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="PACS Data Redction Guide for Hipe 12" date="1395078644" name="pacs_phot_Hipe12.pdf" path="pacs_phot_Hipe12.pdf" size="5257340" user="Main.BrunoAltieri" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1288974438" name="bolopsfv1.01.pdf" path="bolopsfv1.01.pdf" size="5794753" user="Main.BrunoAltieri" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="PACS photometer point spread function, v2.0" date="1334076050" name="bolopsf_20.pdf" path="bolopsf_20.pdf" size="9866553" user="Main.BrunoAltieri" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="Spectroscopy" date="1337956107" name="PACS_LaunchPads_May2012_S.pdf" path="PACS_LaunchPads_May2012_S.pdf" size="140968" user="Main.KatrinaExter" version="1"
 
This site is powered by the TWiki collaboration platform Powered by Perl