TWiki> Public Web>DataProcessingWorkshop2013 (revision 31)EditAttach

Herschel Data Processing Workshop for Newcomers, 24-27 June 2013




The workshop will be held at the European Space Astronomy Centre (ESAC) (Rooms B3/B5) situated near Villanueva de la Cañada, about 30kms North-West of Madrid.

How to get to ESAC

Maps and driving directions to ESAC from Madrid airport (Barajas) and Madrid city centre can be found here.

Transportation & Accommodation

A shuttle mini-bus will depart from the entrance gate of Hotel NH Alberto Aguilera at 08:15h sharp every morning to bring the workshop participants from Madrid to ESAC. The same shuttle service will also take the participants from ESAC to the hotel in Madrid at the end of the afternoon sessions from Monday to Wednesday.

On Thursday afternoon taxis will be arranged to go from ESAC to the airport (no mini-bus service will be available).

Participants need to make their own reservations directly with the hotel. Below is a list of recommended hotels in Madrid.

   Hotel NH Alberto Aguilera ***
   Calle Alberto Aguilera, 18
   28015 Madrid
   Tel: +34 91 4460900 
   Fax: +34 91 4460904 

   Hotel Celuisma Florida Norte ****
   Paseo de la Florida, 5
   28008 Madrid
   Tel: +34 91 5428300
   Fax: +34 91 5477833
   Holiday Inn - Madrid - Piramides ***
   Paseo de las Acacias, 40  
   28005 Madrid
   Tel: +34 91 5171828 
   Fax: +34 91 5170090 
   Tryp Gran Vía ***
   Gran Vía, 25
   28013 Madrid
   Tel: +34 91 5221121
   Fax: +34 91 5212424 

Useful Links

Download the latest HIPE User Release Candidate (HIPE 11.0.0 RC2)

What is HIPE?

HIPE stands for 'Herschel Interactive Processing Environment'. This is the software for browsing, analyzing and reprocessing Herschel data.

Which version of HIPE do I need?

The latest version of HIPE 11 (Release Candidate #2) will be the version of HIPE that will be used during the workshop. This version of HIPE (11.0.0 RC2) can be downloaded from the links below. Please install HIPE on your personal laptop (minimum requirements: RAM 4GB) in advance to the start of the workshop following the installation instructions given below for the different operating systems. Report any problems during the installation process through the HSC Helpdesk.

Important note: You have to keep your internet connection on during the process as you download all the necessary components during the installation.

Note that this is an advanced version of HIPE 11 which is still undergoing the final acceptance tests before it becomes an official user release, something that we anticipate will happen in July.

Release candidates (RCs) are made available for internal use only. Do not distribute this software!.

The available installers for Windows and Linux come with a 32 or a 64 bit virtual machine (VM). The available installer for Mac OS X does not come with a virtual machine but will use the one available at your system.

Download HIPE 11.0.0 RC2

Platform With Java 32 bit VM With Java 64 bit VM Without Java VM
Windows Download HIPE 11.0.0 RC2 Download HIPE 11.0.0 RC2
MacOSX     Download HIPE 11.0.0 RC2
Linux Download HIPE 11.0.0 RC2 Download HIPE 11.0.0 RC2

HIPE Installation Instructions

  • Windows Instructions:
    • After downloading, double-click HIPE_11_0_0_RC2_INSTALLER.exe

  • Linux Instructions:
    • To download the linux installer you should do a right click and then "save link as"
    • After downloading open a terminal and, cd to the directory where you downloaded the installer.
    • At the prompt type: sh ./HIPE_11_0_0_RC2_INSTALLER.bin

  • Mac OS X Instructions:
    • After downloading, double-click HIPE_11_0_0_RC2_INSTALLER

  • In the eventual case of problems with these GUI-based installers, you can always use the command line installer following the instructions below:

    • 2.- unzip the file

    • 3.- and from the command line type >./hcss.installer hcss 11.0 2825, this installs the exact same software as the graphical installer.

    • 4.- Once it is installed, you can run the application by calling hcss-11.0.2825/bin/hipe

Calibration contexts applicable for HIPE v11

In order to process data with HIPE v11 you may also need to download the corresponding calibration tree.

  • SPIRE calibration tree, spire_cal_11_0 is available from here. More details on how to get and install the latest calibration are provided here.

HIPE Users' Documentation

Please have a look at the on-line HIPE 11 documentation clicking on the link below.

Draft Agenda

PDF Version Click here

Herschel Data Processing Workshop for Newcomers, 24-27 June 2013

Draft Agenda

Monday 24 June 2013


09:15-09:30: Welcome, local set-up and start of webex session
09:30-09:45: Welcome to Herschel Data Processing S.Ott
09:45-10:00: Welcome to the Herschel Science Archive P.García-Lario
10:00-10:30: An introduction to the HSA User Interface E.Verdugo
10:30-11:00: An introduction to HIPE B.Merín
11:00-11:30: Coffee break
11:30-11:45: Q&A on HSA/HIPE general issues
11:45-12:15: Data Handling in HIPE E.Verdugo
12:15-13:00: Quick inspection of Herschel data products B.Merín
13:00-13:30: Q&A on HSA/HIPE data handling and quick inspection of products

13:30-14:30: Lunch break

14:30-16:00 Hands-on session - Part I (HSA/data access/data handling)
16:00-16:30 Coffee break
16:30-18:00 Hands-on session - Part II (HIPE general issues/quick inspection of products)

Tuesday 25 June 2013

PACS (@ Room B3)

Spectrometer Session I: Overview of PACS Spectroscopy data and their outlook in HIPE

09:00 Introduction to PACS Spectrometer and observing modes R. Vavrek
09:30 Demo 1: Accessing and inspecting PACS Products in HIPE K. Exter

Spectrometer Session II: Processing data for scientific use

10:30 Calibration and data processing pipeline overview R. Vavrek
11:00 - 11:30 Coffee break
11:30 Demo 2: Interactive reduction of a Line Spectroscopy observation R. Vavrek
12:00 Demo 3: Line fitting and flux extraction for mapping observations K. Exter
12:30 Hands-on session

PACS Spectroscopy tutorials

13:30 - 14:30 Lunch break

14:30 Quick introduction to PACS photometer products and data processing B.Altieri
15:00 PACS photometry pipelines B.Altieri
15:15 PACS photometer calibration (photometric calibration/PSF) Z.Balog
15:30 PACS point source photometry (aperture and PSF photometry, correlated noise and errors) Z.Balog

16:00 - 16:30 Coffee break

16:30 PACS photometry:mapping algorithms for extended emission V.Doublier-Pritchard/B.Altieri
17:00 PACS photometry: ipipes tutorials / Hands-on session B.Altieri

Wednesday 26 June 2013

SPIRE (@ Room B3)

09:00-09:30: Quick introduction to SPIRE photometer products and data processing Luca Conversi
09:30-11:00: SPIRE Photometry Tutorials Luca Conversi
11:00-11:30: Coffee break  
11:30-12:00: Q&A on SPIRE Photometry Luca Conversi
12:00-12:30: Quick introduction to SPIRE FTS products and data processing Ivan Valtchanov
12:30-13:10: SPIRE Spectroscopy Tutorial Ivan Valtchanov
13:10-13:30: Q&A on SPIRE Spectroscopy Ivan Valtchanov
13:30-14:30: Lunch break  
14:30-15:00 Quick introduction to photometry with SPIRE Luca Conversi
15:00-16:00 Hands-on session - Part I (SPIRE Photometry) Luca Conversi
16:00-16:30 Coffee break  
16:30-18:00 Hands-on session - Part II (SPIRE Spectroscopy) Ivan Valtchanov

Thursday 27 June 2013

HIFI (@ Room B3)

09:00-10:00: HIFI observing modes and associated data processing products Anthony Marston
10:00-10:30: Running HIFI pipelines - general and alternatives: Tutorial 1 Anthony Marston
10:30-11:00: Q&A on HIFI Tutorial 1
11:00-11:30: Coffee break
11:30-12:15 Remaining issues: Handling HIFI electrical and optical standing waves, tutorial 2 Elena Puga
12:15-13:00 Basic HIFI data analysis and data export, tutorial 3 Anthony Marston
13:00-13:30: Q&A on HIFI Tutorials 2 and 3

13:30-14:30: Lunch break

14:30-16:00 Hands-on session - Part I (HIFI), point source modes
16:00-16:30 Coffee break
16:30-18:00 Hands-on session - Part II (HIFI), maps and spectral scans

Sample Datasets

These are some OBSIDs that you can use for your tests with the sysyem. Enjoy Herschel data! The PACS Range Spectroscopy ones will be used during the demos tomorrow.

PACS Phot: 1342215720 and 1342215721 GX 339-4 Point-like source
PACS Phot: 1342185575 and 1342185576 Sh104 Extended source
PACS Phot: 1342185553 and 1342185554 RCW120 Extended source - but requires more memory!
SPIRE Phot: 1342183678 RCW 120  
HIFI Single Point: 1342242856 W28A  
PACS Line Spec: 1342182002 NGC 5315  
PACS Range Spec: 1342231295 NGC 2440 will be used in demo
PACS Range Spec: 1342197795 R Dor will be used in demo
PACS Line Spec: 1342191294 NGC1365 will be used in demo
SPIRE Spec: 1342256105 IRC+10216 Nice spectrum
  1342214831 NGC6240 will be used in demo
  1342214832 dark sky for NGC6240 will be used in demo
  1342203586 SPIRE Photo map of NGC6240 will be used in demo
  1342265845 SPIRE Spectral map of Orion Bar (HD37041) will be used in hands-on
SPIRE PACS Parallel: 1342186121, 1342186122 Rosette Nebula Nice image

Additional workshop material

PACS Spectroscopy tutorials

PACS Photometry tutorials

SPIRE Photometry tutorials

(NOTE: you may need to remove the .txt from the filenames associated to the python scripts above so that these files can be recognized as python scripts by HIPE - the .txt suffix is added automatically by the twiki for security reasons)

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf DP_workshop_PACS_Products.pdf r1 manage 15086.8 K 2013-06-25 - 14:22 PedroGarciaLario  
PDFpdf Herschel_DP_Welcome_Ott.pdf r1 manage 2635.0 K 2013-06-24 - 22:33 PedroGarciaLario  
PDFpdf Herschel_PGL_Newcomers.pdf r1 manage 12289.2 K 2013-06-24 - 23:34 PedroGarciaLario  
Texttxt r1 manage 5.6 K 2013-06-25 - 15:29 LucaConversi  
PDFpdf PACSspec_demo_kexter_v2.pdf r1 manage 1670.3 K 2013-06-25 - 11:10 PedroGarciaLario  
Texttxt r1 manage 11.6 K 2013-06-25 - 11:27 PedroGarciaLario  
Texttxt r1 manage 8.6 K 2013-06-25 - 21:59 PedroGarciaLario  
Texttxt r1 manage 14.8 K 2013-06-25 - 15:29 LucaConversi  
Texttxt r1 manage 11.8 K 2013-06-25 - 15:29 LucaConversi  
PDFpdf SPIRE_Photometry.pdf r1 manage 3380.8 K 2013-06-25 - 15:58 LucaConversi  
PDFpdf SPIRE_Pipeline.pdf r1 manage 9296.6 K 2013-06-25 - 15:58 LucaConversi  
PDFpdf pacsSpectroInstrument.pdf r1 manage 9612.2 K 2013-06-25 - 13:15 PedroGarciaLario  
PDFpdf pacsSpectroPipelines.pdf r1 manage 1004.7 K 2013-06-25 - 13:15 PedroGarciaLario  
Edit | Attach | Watch | Print version | History: r46 | r33 < r32 < r31 < r30 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r31 - 2013-06-25 - PedroGarciaLario
This site is powered by the TWiki collaboration platform Powered by Perl