TWiki> Public Web>OT1DataProcessingWorkshop (revision 68)EditAttach

Herschel Open Time Cycle-1 Data Processing Workshop, 14-18 March 2011


  • Departure time on Thursday 17 March 2011 from ESAC to Hotel NH Alberto Aguilera: 18:30h
  • Departure time on Friday 18 March 2011 from Hotel NH Alberto Aguilera to ESAC: 08:15h (sharp!!)
  • On Friday 18 March we will arrange taxis for you to go either to the Airport or the hotel in Madrid. Just let us know your wishes at the workshop desk, if possible before lunch time tomorrow, preferentially during the morning cofffee break.

Final Agendas

Sessions will start on Monday 14 March at 09:30 and at 09:00 on the rest of the days of the workshop. The PACS instrument part of the workshop will end at around 13:30h on Wednesday while the HIFI & SPIRE sessions will start at 14:30h on the same day. The workshop will end on Friday at 16:15h.

List of participants


Monday 14 March 2011

Tuesday 15 March 2011

Wednesday 16 March 2011

Thursday, 17 March 2011

Time Presentation Presenter Notes, Scripts etc.
09:15 SPIRE Observing Modes AOT reminder and SPIRE status C. Pearson  
09.35 SPIRE User Documentation B. O'Halloran  
09:45 Reveiw of SPIRE set up for Workshop C. Pearson script
10:00 Tour of SPIRE data products and Quick-Look Tools in HIPE C. Pearson DRG Chapter 2
11:30 SPIRE calibration trees I. Valtchanov DRG Chapter 3
11:50 SPIRE Photometer Pipeline (Do I need to re-process my data?) C. Pearson  
12:20 SPIRE Spectrometer Pipeline (Do I need to re-process my data?) E. Polehampton  
14:30 SPIRE demo: how to get data into SpectrumExplorer E. Polehampton  
15:30 Line fitting in SpectrumExplorer using a script E. Polehampton script and line list

Friday, 18 March 2011

Time Presentation Presenter Notes, Scripts etc.
09:00 Reprocessing your photometer data with SPIA C. Pearson SPIA standard processing video tutorial
11:00 SPIRE Photometer Mapping Troubleshooting and Tips C. Pearson script; DRG Section 5.1.3
11:45 SPIRE Photometer deglitching, mask editing L. Conversi script; DRG Section 4.3
12:30 SPIRE Source Extraction & Aperture Photometry B. O'Halloran script; DRG Section 5.4
13:15 Considerations for Parallel Mode L. Conversi script
14:30 Spectrometer reprocessing scenarios for (weak/medium strength) point sources N. Lu DRG Section
15:15 Spectrometer reprocessing scenarios for extended sources I. Valtchanov DRG Section

Data sets

To download the data sets that will be used during the workshop demos/hands-on sessions, please follow the instructions below:

Name: anonymous
Password: your email address
cd /pub/hsc_wshop

Then, change to the directory you are interested in and write:

mget *

You can also go to with your favorite FTP compatible web browser.

You can place the downloaded data sets in any folder of your choice. You do not need to unzip or untar the files for the moment. We will later provide information at the workshop on how to move these zipped and tarred files into the appropriate area for HIPE to recognize them.


If you are to participate in the PACS hands-on sessions you will need to start up HIPE 6.0 to allow the software to update and construct automatically the calibration files. Earlier versions of HIPE handle the calibration files differently, so this step is very important. When the software is started up for the first time it will ask you to update the calibration. You should accept the update and allow some time for the calibration files to be copied to your system. Once this is done, you may close HIPE. It is mandatory to perform this step the first time HIPE 6.0 is launched.


ALL HIFI/SPIRE workshop participants should download

HIFI data 1342205474_map_dbs_1b.tgz


SPIRE data spireSpec1342189124_NGC7027.tgz

These datasets will be used in the joint HIFI/SPIRE spectral Tools session and are placed in the corresponding HIFI or SPIRE directories in the ftp repository above mentioned.

PACS Data sets

PACS Photometry

NOTE: for the RCW120 observations only the red band can be processed on a 4 GB RAM laptop. All public data in the archive (Total size= 0.77GB)

OBSIDs Target description
1342185553 RCW120 scan map
1342185554 RCW120 scan map
1342185575 Sh104 scan map
1342185576 Sh104 scan map
1342189191 delta Dra mini-scan map
1342189192 delta Dra mini-scan map
1342195466 HIP99240 mini-scan map
1342195467 HIP99240 mini-scan map

PACS Spectroscopy

OBSIDs TargetSorted ascending description
1342191353 AFGL490 Line spectroscopy
1342204332 Ceres SED
1342204333 Ceres SED
1342197899 Neptune B2A OFF Unchopped SED
1342197898 Neptune B2A ON Unchopped SED
1342197901 Neptune B2B OFF Unchopped SED
1342197900 Neptune B2B ON Unchopped SED
1342209696 NGC6543 Unchopped Line spectroscopy
1342209695 NGC6543 Unchopped Line spectroscopy

HIFI Data sets

NOTE: Total size: 4.28GB

OBSIDs AOR Label Note Pool name used in scripts
1342180473 Aot2_P_FSw_1b_H2O_557_AFGL2591_deep   1342180473_point_fsw_1b
1342180551 Aot2_P_LChopNoRef_3a_CH+_DR21   1342180551_point_lchop_3a_noref
1342181161 Aot2_S_DBS_1b_full_R4_LDN1157B1   1342181161_sscan_dbs_1b_r4
1342190183 Aot2_P_FastDBS_1b_CO5-4_LDN1157   1342190183_point_fastdbs_1b
1342191505 SDP_HOP - HScan - O2 - 487.3GHz - Orion S   1342191505_sscan_mini_dbs_1a_r12
1342191649 SDP_HEXOS-orikl-hifiss-b4b   1342191649_sscan_dbs_4b_r6
1342205481 Aot3_M_DBS_3x3_7b_CII_S140 Engineering mode 1342205481_map_dbs_7b
1342205474 Aot3_M_DBS_3x3_1b_CO_5_4_S140 Engineering mode 1342205474_map_dbs_1b
1342210099 Aot3_M_OTF_1b_CO5-4_IRC10216   1342210099_map_otf_1b
1342210097 Aot3_M_OTF_1b_CO5-4_IRC10216_halfbeam   1342210097_map_otf_1b_halfbeam

SPIRE Data sets

OBSIDs Description Source Pool Name
1342210941 Small Map of planetary nebula BD303639 spirephot_bd303639
1342211401 Small Map of “dark region” Dark Sky spirephot_dark_od587
1342195871 Small Map of secondary calibration star GammaDra spirephot_gammadra_rp
1342187440 Large Map of Neptune, OD 202 Neptune spirephot_neptune_beams_rp
1342183475 Large Map of planetary nebula NGC 5315 spirephot_ngc5315_rp
1342183046 Parallel Mode maps of bright galaxy (orthogonal direction only) NGC 6946 spirephot_ngc6946_ort_rp
1342183047 Parallel Mode maps of bright galaxy (nominal direction only) NGC 6946 spirephot_ngc6946_norm_rp
1342189124 Carbon star NGC7027 (OD240, 17 reps, HR mode) NGC 7027 spireSpec1342189124_NGC7027
1342189120 Dark sky (OD240, 40 reps, CR mode) Dark Sky spireSpec1342189120_DarkSky
1342187893 Mrk 231 (OD209, 50 reps, HR mode) Mrk 231 spireSpec1342187893_Mrk231
1342187890 Dark sky (OD209, 50 reps, CR mode) Dark Sky spireSpec1342187890_DarkSky
1342192180 NGC7023 (OD302, 4 reps, MR, Raster, Intermediate sampling) NGC 7023 spireSpec1342192180_NGC7023

The spectrometer reprocessing demos will also make use of the following two calibration files (already in the ftp delivery above):

  • SCalSpecTeleRsrf_0x50002972_HR_UNAPOD_v6_1.fits
  • SCalSpecTeleRsrf_0x50002E40_HR_UNAPOD_v6_1.fits



  • Scripts to load the test data for this DP workshop:

  • Other demo scripts and needed auxiliary files:




Hands-on Sessions

PACS photometer:

PACS spectrometer:

SPIRE photometer:

SPIRE spectrometer:



On Thursday March 17 (16:45h) a presentation of the CASSIS software package as a HIPE Plugin will be given by Sandrine Bottinelli. On Friday March 18 (12h-13h, room B65), a hands-on session on CASSIS supervised by Jean-Michel Glorian (CASSIS developer), Sandrine Bottinelli and Emmanuel Caux (CASSIS Scientists) is organized. This hands-on session will make use of the HIFI, PACS and SPIRE data provided for the workshop.

The CASSIS Plug-in can be installed in your HIPE 6.0.3. CASSIS is a spectral analysis tool-set containing:

• Line Identification Tool (via a CASSIS internal database containing the JPL, CDMS and NIST databases) • Prediction of spectra (HIFI only at this time) • Powerful line/baseline fitting • Comparison of telescope or laboratory data with a wide variety of models • Tools to determine the physical parameters of the sources

See the cassis web-site for details (

The plug-in makes these functionalities available directly in HIPE.

To install the CASSIS plugin, select "Plug-ins" from the HIPE Tools menu. Click "Install new plug-in" and enter the following URL:

The plugin has been successfully tested with HIPE 6.0.3 within the following environments :

- Mac OSX 10.6 Snow Leopard - Windows XP and Windows 7 - Linux and Unix

It would be better for the users who plan to attend the CASSIS hands-on to come to the workshop with the CASSIS plugin installed on their laptops in HIPE 6.0.3 as the download and install of the plugin can take a while if done simultaneously from ESAC (~350 Mb to download).


Video Tutorials

Feedback form

We want to improve! Please send us your feedback using the form below:


Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf 2011_March_DP_workshop_phot_calibration.pdf r1 manage 7862.6 K 2011-03-15 - 12:00 BrunoAltieri PACS photometer calibration
PDFpdf 2011_March_DP_workshop_phot_level0_1.pdf r1 manage 8591.7 K 2011-03-14 - 13:20 BrunoAltieri PACS photo from level0 to level1
PowerPointppt 2011_March_DP_workshop_phot_level0_1.ppt r1 manage 2805.0 K 2011-03-14 - 13:18 BrunoAltieri PACS photo from level0 to level1
PDFpdf 2011_March_DP_workshop_phot_level1_2.pdf r1 manage 8218.6 K 2011-03-14 - 14:53 BrunoAltieri PACS photo from level1 to level2
PDFpdf Day1_Data_access_Verdugo.pdf r1 manage 788.9 K 2011-03-17 - 12:14 PedroGarciaLario  
PDFpdf Day1_HUI_Verdugo.pdf r1 manage 953.5 K 2011-03-17 - 12:13 PedroGarciaLario  
PDFpdf Day1_overview_DP_Ott.pdf r1 manage 4112.4 K 2011-03-14 - 08:48 PedroGarciaLario  
PDFpdf Day1_overview_DP_Ott_v2.pdf r1 manage 4112.4 K 2011-03-14 - 22:20 PedroGarciaLario  
PDFpdf Day1_overview_Herschel_Pilbratt.pdf r1 manage 12791.6 K 2011-03-14 - 22:29 PedroGarciaLario  
PDFpdf Day1_overview_instr_Marston.pdf r1 manage 666.6 K 2011-03-14 - 08:47 PedroGarciaLario  
PDFpdf Day2_PACS-MADmap.pdf r1 manage 2207.0 K 2011-03-15 - 00:05 PedroGarciaLario  
PDFpdf Day2_PACS_Spectrometer_Products.pdf r1 manage 7445.8 K 2011-03-16 - 08:24 RolandVavrek PACS Spectrometer products
PDFpdf Day3_OT1_ESAC_DPwksp_Cassis.pdf r1 manage 12377.6 K 2011-03-17 - 15:04 PedroGarciaLario  
PDFpdf Day3_overview_DP_Ott.pdf r1 manage 1669.6 K 2011-03-16 - 16:27 PedroGarciaLario  
PDFpdf DpWorkshop2011_Notes.pdf r1 manage 3851.5 K 2011-03-14 - 09:27 DavideRizzo HIPE documentation presentation
Texttxt r5 r4 r3 r2 r1 manage 8.8 K 2011-03-14 - 10:33 BrunoAltieri MADmap script for crossed maps
Texttxt r1 manage 10.0 K 2011-03-15 - 10:30 PedroGarciaLario  
PDFpdf OT1_DPWorkshop_PACS_draft_agenda.pdf r2 r1 manage 70.5 K 2011-03-11 - 11:30 PedroGarciaLario  
PDFpdf OT1_DPWorkshop_participants.pdf r4 r3 r2 r1 manage 12.3 K 2011-03-17 - 09:30 JeanMatagne  
PDFpdf OT1_HIFI_SPIRE_DPWorkshop_final_agenda.pdf r2 r1 manage 14.8 K 2011-03-17 - 09:03 PedroGarciaLario  
PDFpdf OT1_PACS_DPWorkshop_draft_agenda.pdf r1 manage 70.5 K 2011-03-11 - 11:18 PedroGarciaLario  
PDFpdf OT1_PACS_DPWorkshop_final_agenda.pdf r1 manage 14.0 K 2011-03-15 - 00:49 PedroGarciaLario  
PDFpdf PACS_Phot_Deglitching.pdf r1 manage 5515.0 K 2011-03-15 - 11:54 BrunoAltieri Deglitching PACS photometry data
PDFpdf PACS_Photometer_MSauvage.pdf r1 manage 16370.7 K 2011-03-15 - 14:39 PedroGarciaLario  
PDFpdf PacsSpectroscopyWorkshopEsac20110315.pdf r1 manage 9047.5 K 2011-03-15 - 11:25 BartVandenbussche PACS spectrometer introduction (Bart Vandenbussche)
PDFpdf SPIRE-DP_Feb2011_SPIAdemo.pdf r1 manage 369.1 K 2011-03-16 - 09:22 EdwardPolehampton SPIRE SPIA demo presentation
PDFpdf SPIRE-DP_mar2011_spectrometer_demo.pdf r1 manage 630.9 K 2011-03-16 - 09:22 EdwardPolehampton SPIRE spectrometer single pointed demo presentation
PDFpdf SPIRE-ESAC-Mar2011_AOT.pdf r1 manage 2786.3 K 2011-03-16 - 09:11 EdwardPolehampton SPIRE AOT reminder
PDFpdf SPIRE-ESAC-Mar2011_DataWalkaround.pdf r2 r1 manage 1645.9 K 2011-03-16 - 14:15 ChrisPearson SPIRE data walkaround
PDFpdf SPIRE-ESAC-Mar2011_SPIRE_setup.pdf r3 r2 r1 manage 559.0 K 2011-03-16 - 15:47 ChrisPearson SPIRE setup presentation
PDFpdf SPIRE-ESAC-Mar2011_ScanPipeline.pdf r1 manage 3174.5 K 2011-03-16 - 14:20 ChrisPearson SPIRE Photometer Pipeline
PDFpdf SPIRE-ESAC-Mar2011_ScanTroubleshooting_Pearson.pdf r1 manage 1504.2 K 2011-03-16 - 13:35 ChrisPearson Scan Map Processing Tips
PDFpdf SPIRE_DP_Mar2011workshop_documentation.pdf r1 manage 271.2 K 2011-03-16 - 09:09 EdwardPolehampton SPIRE Documentation presentation
PDFpdf SPIRE_DP_Mar2011workshop_documentation_v3.pdf r1 manage 283.3 K 2011-03-16 - 10:40 BrianOHalloran SPIRE Documentation presentation
PDFpdf SPIRE_DP_Mar2011workshop_documentation_v4.pdf r1 manage 433.0 K 2011-03-16 - 14:16 BrianOHalloran SPIRE Documentation presentation
PDFpdf SPIRE_DP_Mar2011workshop_documentation_v5.pdf r1 manage 433.1 K 2011-03-16 - 14:55 BrianOHalloran SPIRE Documentation presentation
PDFpdf SPIRE_DP_Mar2011workshop_source_extraction.pdf r1 manage 490.0 K 2011-03-16 - 09:20 EdwardPolehampton SPIRE Source extraction presentation
PDFpdf SPIRE_DP_Workshop_Deglitching.pdf r1 manage 1650.7 K 2011-03-16 - 09:21 EdwardPolehampton SPIRE Deglitching presentation
PDFpdf SPIRE_FTS_pipeline.pdf r1 manage 904.7 K 2011-03-16 - 09:09 EdwardPolehampton SPIRE FTS Pipeline presentation
PDFpdf SPIRE_HSC-DP-ftsmaps.pdf r1 manage 3653.8 K 2011-03-16 - 09:21 EdwardPolehampton SPIRE FTS mapping demo presentation
PDFpdf SPIRE_HSC-DP-spirecal.pdf r1 manage 5692.6 K 2011-03-16 - 09:10 EdwardPolehampton SPIRE Calibration presentation
PDFpdf SPIRE_OT1_DP_Workshop_PMode.pdf r1 manage 1732.5 K 2011-03-16 - 09:21 EdwardPolehampton SPIRE Parallel mode presentation
Texttxt r1 manage 2.6 K 2011-03-16 - 09:02 EdwardPolehampton SPIRE Source extraction script
PDFpdf SPIRE_specExplorer.pdf r1 manage 538.1 K 2011-03-16 - 09:10 EdwardPolehampton SPIRE: reading data into SpectrumExplorer
PDFpdf SPIRE_spectrumFitter.pdf r1 manage 182.1 K 2011-03-16 - 09:10 EdwardPolehampton SPIRE: SpectrumFitter scripting
Texttxt r1 manage 14.6 K 2011-03-14 - 08:49 BrunoAltieri Multiple obsid's mini-scan map point-source
Texttxt r1 manage 14.1 K 2011-03-14 - 08:51 BrunoAltieri Multiple obsid's scan map extended source
Texttxt r1 manage 1.4 K 2011-03-14 - 08:57 BrunoAltieri plot scan path
PDFpdf scanamorphos_workshop_mar11.pdf r1 manage 3530.9 K 2011-03-16 - 07:06 PedroGarciaLario  
Texttxt r1 manage 41.7 K 2011-03-14 - 08:47 BrunoAltieri scan map deep survey mini-scan point-source
Texttxt r1 manage 39.4 K 2011-03-14 - 08:50 BrunoAltieri Extended source scan map
Texttxt r1 manage 2.5 K 2011-03-16 - 09:15 EdwardPolehampton SPIRE unpacking script
Edit | Attach | Watch | Print version | History: r78 | r70 < r69 < r68 < r67 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r68 - 2011-03-17 - PedroGarciaLario
This site is powered by the TWiki collaboration platform Powered by Perl