(r28) DataProcessingWorkshop2013 < Public

Public Web>DataProcessingWorkshop2013 (revision 28) (raw view)~~EditAttach~~
---+!! Herschel Data Processing Workshop for Newcomers, 24-27 June 2013 

*TABLE OF CONTENTS*
%TOC%

---++ Participants

   * [[http://herschel.esac.esa.int/DPforNewcomers2013/DPWS2013_Participants.pdf][List of participants (PDF)]]
 
---++ Venue

The workshop will be held at the <a target="_new" class="red" href="http://www.esa.int/SPECIALS/ESAC/index.html">European Space Astronomy Centre (ESAC)</a> (Rooms B3/B5) situated near Villanueva de la Ca&ntilde;ada, about 30kms North-West of Madrid.

<a target="_new" class="red" href="http://www.esa.int/SPECIALS/ESAC/SEMQFW5Y3EE_0.html"><img alt="How to get to ESAC" title="How to get to ESAC" src="http://herschel.esac.esa.int/OT1DataProcessingWorkshop/ESAC_location.jpg"></a>

Maps and driving directions to ESAC from Madrid airport (Barajas) and Madrid city centre can be found <a target="_new" class="red" href="http://www.esa.int/SPECIALS/ESAC/SEMQFW5Y3EE_0.html">here</a>.





----++ Transportation &amp; Accommodation

A shuttle mini-bus will depart <b>from the entrance gate of Hotel NH Alberto Aguilera  at 08:15h sharp every morning</b> to bring the workshop participants from Madrid to ESAC. The same shuttle service will also take the participants from ESAC to the hotel in Madrid at the end of the afternoon sessions from Monday to Wednesday.

On Thursday afternoon taxis will be arranged to go from ESAC to the airport (no mini-bus service will be available).

Participants need to make their own reservations directly with the hotel. Below is a list of recommended hotels in Madrid. 

<pre>
   <a target="_new" class="red" href="http://www.nh-hotels.com/nh/en/hotels/spain/madrid/nh-alberto-aguilera.html">Hotel NH Alberto Aguilera</a> ***
   Calle Alberto Aguilera, 18
   28015 Madrid
   Tel: +34 91 4460900 
   Fax: +34 91 4460904 
   E-mail:  nhalbertoaguilera@nh-hotels.com
</pre>

<p>
<table>
<tr>
<td>
<pre>
   <a target="_new" class="red" href="http://www.celuisma.com/en/info-hotel-celuisma-florida-norte">Hotel Celuisma Florida Norte</a> ****
   Paseo de la Florida, 5
   28008 Madrid
   Tel: +34 91 5428300
   Fax: +34 91 5477833
</pre>
</td>
 
<td>
<pre>
   <a target="_new" class="red" href="http://www.ihg.com/holidayinn/hotels/us/en/madrid/madmp/hoteldetail?cm_mmc=GoogleMaps-_-hi-_-ESEN-_-madmp">Holiday Inn - Madrid - Piramides</a> ***
   Paseo de las Acacias, 40  
   28005 Madrid
   Tel: +34 91 5171828 
   Fax: +34 91 5170090 
</pre>
</td>


<td>
<pre>
   <a target="_new" class="red" href="http://es.melia.com/hoteles/espana/madrid/tryp-madrid-gran-via-hotel/index.html">Tryp Gran V&iacute;a</a> ***
   Gran V&iacute;a, 25
   28013 Madrid
   Tel: +34 91 5221121
   Fax: +34 91 5212424 
</pre>
</td>

</tr>

</table>

---++ Useful Links

<ul>
<li><a class="red" TARGET="_new" HREF="http://www.aena-aeropuertos.es/csee/Satellite/Aeropuerto-Madrid-Barajas/en/Home.html">Madrid/Barajas Airport</a> (Courtesy of the <a class="red" TARGET="_new" HREF="http://www.aena.es/csee/Satellite/Home/en/Page/1166792871783/">Aeropuertos Espa&ntilde;oles y Navegaci&oacute;n A&eacute;rea - AENA</a>)

<li><a class="red" TARGET="_new" HREF="http://www.ctm-madrid.es/como_ir_a/madrid/como_ir_a_madrid1.jsp?CODPANTALLA=0&CODBOTON=201">Transport Information System of Madrid</a> (Courtesy of the <a class="red" TARGET="_new" HREF="http://www.ctm-madrid.es/">Consorcio de Transportes de Madrid</a>)

<li><a class="red" TARGET="_new" HREF="http://www.metromadrid.es/export/sites/metro/comun/documentos/planos/Planomayo2013.pdf">The Madrid Metro Map</a> (Courtesy of the <a class="red" TARGET="_new" HREF="http://www.metromadrid.es/">Metro de Madrid</a>)

<li><a class="red" TARGET="_new" HREF="http://www.aemet.es/en/eltiempo/prediccion/municipios/madrid-id28079">Weather forecast (Madrid)</a> (Courtesy of the <a class="red" TARGET="_new" HREF="http://www.aemet.es/en/portada">Agencia Estatal de Meteorolog&iacute;a -AEMET</a>)
</ul>

---++ Download the latest HIPE User Release Candidate (HIPE 11.0.0 RC2)

*What is HIPE?*

HIPE stands for 'Herschel Interactive Processing Environment'. This is the software for browsing, analyzing and reprocessing Herschel data.

*Which version of HIPE do I need?*

The latest version of HIPE 11 (Release Candidate #2) will be the version of HIPE that will be used during the workshop. This version of HIPE (11.0.0 RC2) can be downloaded from the links below.  Please install HIPE on your personal laptop (minimum requirements: RAM 4GB) in advance to the start of the workshop  following the installation instructions given below for the different operating systems. Report any problems during the installation process through the [[http://herschel.esac.esa.int/esupport][HSC Helpdesk]]. 

Important note: You have to keep your internet connection on during the process as you download all the necessary components during the installation. 

Note that this is an advanced version of HIPE 11 which is still undergoing the final acceptance tests before it becomes an official user release, something that we anticipate will happen in July. 

%BLUE%Release candidates (RCs) are made available for internal use only. *Do not distribute this software!*. %ENDCOLOR%

%BLUE%The available installers for Windows and Linux come with a 32 or a 64 bit virtual machine (VM). The available installer for Mac OS X does not come with a virtual machine but will use the one available at your system.  %ENDCOLOR%

*Download HIPE 11.0.0 RC2*

| *Platform* | *With Java 32 bit VM* | *With Java 64 bit VM* | *Without Java VM* | 
| *Windows* | [[http://herschel.esac.esa.int/hipe/installers/v11.0.0_RC2/Windows32/VM/HIPE_11_0_0_RC2_INSTALLER.exe][Download HIPE 11.0.0 RC2]] | [[http://herschel.esac.esa.int/hipe/installers/v11.0.0_RC2/Windows64/VM/HIPE_11_0_0_RC2_INSTALLER.exe][Download HIPE 11.0.0 RC2]] | 
| *MacOSX* | | | [[http://herschel.esac.esa.int/hipe/installers/v11.0.0_RC2/MacOSX/HIPE_11_0_0_RC2_INSTALLER.zip][Download  HIPE 11.0.0 RC2]] | 
| *Linux* | [[http://herschel.esac.esa.int/hipe/installers/v11.0.0_RC2/Linux32/VM/HIPE_11_0_0_RC2_INSTALLER.bin][Download HIPE 11.0.0 RC2]] | [[http://herschel.esac.esa.int/hipe/installers/v11.0.0_RC2/Linux64/VM/HIPE_11_0_0_RC2_INSTALLER.bin][Download HIPE 11.0.0 RC2]]  | 


*HIPE Installation Instructions*

   * Windows Instructions:
      * After downloading, double-click HIPE_11_0_0_RC2_INSTALLER.exe 

   * Linux Instructions:
      * To download the linux installer you should do a right click and then "save link as"
      * After downloading open a terminal and,  cd to the directory where you downloaded the installer.
      * At the prompt type:  sh ./HIPE_11_0_0_RC2_INSTALLER.bin 

   * Mac OS X Instructions:
      * After downloading, double-click HIPE_11_0_0_RC2_INSTALLER 

   * In the eventual case of problems with these GUI-based installers, you can always use the command line installer following the instructions below:

      * 1.- retrieve the hcss.installer.zip file from http://herschel.esac.esa.int/hcss/install.php

      * 2.- unzip the file

      * 3.- and from the command line type >./hcss.installer hcss 11.0 2825, this installs the exact same software as the graphical installer.

      * 4.- Once it is installed, you can run the application by calling hcss-11.0.2825/bin/hipe

---+++ Calibration contexts applicable for HIPE v11

In order to process data with HIPE v11 you may also need to download the corresponding calibration tree.
   * SPIRE calibration tree, =spire_cal_11_0= is available from [[ftp://ftp.sciops.esa.int/pub/hsc-calibration/latest_cal_tree][here]]. More details on how to get and install the latest calibration are provided [[http://herschel.esac.esa.int/twiki/bin/view/Public/SpireCalibrationWeb#SPIRE_calibration_file_versions][here]].


----++ HIPE Users' Documentation

Please have a look at the on-line HIPE 11 documentation clicking on the link below. 

   * [[http://herschel.esac.esa.int/hcss-doc-11.0/][HIPE 11 on-line documentation]]


---++ Draft Agenda


| *PDF Version* | [[%SCRIPTURLPATH%/genpdf%SCRIPTSUFFIX%/%WEB%/%TOPIC%?pdftoclevels=0&pdfrecursive=on?pdforientation=portrait][Click here]] | 

 <!-- PDFSTART -->


---+++!! Herschel Data Processing Workshop for Newcomers, 24-27 June 2013

---+++!! Draft Agenda

---+++ Monday 24 June 2013 

*GENERAL ISSUES*  (@ Room B3)

      |09:15-09:30:| Welcome, local set-up and start of webex session|| 
      |09:30-09:45:|[[%ATTACHURL%/Herschel_DP_Welcome_Ott.pdf][Welcome to Herschel Data Processing]]|S.Ott|
      |09:45-10:00:|[[%ATTACHURL%/Herschel_PGL_Newcomers.pdf][Welcome to the Herschel Science Archive]]|P.García-Lario|
      |10:00-10:30:| An introduction to the HSA User Interface|E.Verdugo|
      |10:30-11:00:| An introduction to HIPE|B.Merín|
      |11:00-11:30:| Coffee break |
      |11:30-11:45:| Q&A on HSA/HIPE general issues||
      |11:45-12:15:| Data Handling in HIPE|E.Verdugo|
      |12:15-13:00:| Quick inspection of Herschel data products|B.Merín| 
      |13:00-13:30:| Q&A on HSA/HIPE data handling and quick inspection of products||

      |13:30-14:30:| Lunch break|
 
      |14:30-16:00| Hands-on session - Part I (HSA/data access/data handling)|
      |16:00-16:30| Coffee break|
      |16:30-18:00| Hands-on session - Part II (HIPE general issues/quick inspection of products)|

---+++ Tuesday 25 June 2013

*PACS* (@ Room B3)

Spectrometer Session I: Overview of PACS Spectroscopy data and their outlook in HIPE

    | 09:00 | [[%ATTACHURL%/pacsSpectroInstrument.pdf][Introduction to PACS Spectrometer and observing modes]] |R. Vavrek| 
    | 09:30 | Demo 1: Accessing and inspecting PACS Products in HIPE |K. Exter|


Spectrometer Session II: Processing data for scientific use 

    | 10:30 | [[%ATTACHURL%/pacsSpectroPipelines.pdf][Calibration and data processing pipeline overview]] |R. Vavrek| 
    | 11:00 - 11:30 | Coffee break |
    | 11:30 | Demo 2: Interactive reduction of a Line Spectroscopy observation |R. Vavrek| 
    | 12:00 | Demo 3: Line fitting and flux extraction for mapping observations |K. Exter| 
    | 12:30 | Hands-on session |

    | 13:30 - 14:30 | Lunch break |

    | 14:30 | Quick introduction to PACS photometer products and data processing|B.Altieri|
    | 15:00 | PACS photometry pipelines|B.Altieri|
    | 15:15 | PACS photometer calibration (photometric calibration/PSF)|Z.Balog|
    | 15:30 | PACS point source photometry (aperture and PSF photometry, correlated noise and errors)|Z.Balog|

    |16:00 - 16:30 | Coffee break |

    |16:30  | PACS photometry:mapping algorithms for extended emission|V.Doublier-Pritchard/B.Altieri|
    |17:00  | PACS photometry: ipipes tutorials / Hands-on session |B.Altieri|

---+++ Wednesday 26 June 2013 
 
*SPIRE* (@ Room B3)

      |09:00-09:30:| Quick introduction to SPIRE photometer products and data processing |
      |09:30-11:00:| SPIRE Photometry Tutorials|
      |11:00-11:30:| Coffee break|
      |11:30-12:00:| Q&A on SPIRE Photometry|
      |12:00-12:30:| Quick introduction to SPIRE FTS products and data processing| Ivan Valtchanov |
      |12:30-13:10:| SPIRE Spectroscopy Tutorial| Ivan Valtchanov |
      |13:10-13:30:| Q&A on SPIRE Spectroscopy| Ivan Valtchanov |

      |13:30-14:30:| Lunch break|
 
      |14:30-16:00| Hands-on session - Part I (SPIRE Photometry) |
      |16:00-16:30| Coffee break|
      |16:30-18:00| Hands-on session - Part II (SPIRE Spectroscopy)| Ivan Valtchanov |


---+++ Thursday 27 June 2013

 *HIFI* (@ Room B3)

      |09:00-10:00:| HIFI observing modes and associated data processing products |  Anthony Marston |
      |10:00-10:30:| Running HIFI pipelines - general and alternatives: Tutorial 1 |  Anthony Marston |
      |10:30-11:00:| Q&A on HIFI Tutorial 1 |
      |11:00-11:30:| Coffee break |
      |11:30-12:15 | Remaining issues: Handling HIFI electrical and optical standing waves, tutorial 2 |  Elena Puga |
      |12:15-13:00 | Basic HIFI data analysis and data export, tutorial 3  | Anthony Marston |
      |13:00-13:30:| Q&A on HIFI Tutorials 2 and 3 |

      |13:30-14:30:| Lunch break|
 
      |14:30-16:00| Hands-on session - Part I (HIFI), point source modes |
      |16:00-16:30| Coffee break |
      |16:30-18:00| Hands-on session - Part II (HIFI), maps and spectral scans |

 <!-- PDFSTOP -->

---+++ Sample Datasets

These are some OBSIDs that you can use for your tests with the sysyem. Enjoy Herschel data! The PACS Range Spectroscopy ones will be used during the demos tomorrow.

|PACS Phot:| 1342215720 and 1342215721 | GX 339-4 | Point-like source |
|PACS Phot:|1342185575 and 1342185576| Sh104 | Extended source|
|PACS Phot:|1342185553 and 1342185554| RCW120 | Extended source - but requires more memory!|
|SPIRE Phot:| 1342183678 | RCW 120 | |
|HIFI Single Point:| 1342242856 | W28A | |
|PACS Line Spec:| 1342182002| NGC 5315| |
|PACS Range Spec:| 1342231295| NGC 2440| will be used in demo|
|PACS Range Spec:| 1342197795| R Dor |will be used in demo|
|PACS Line Spec:|1342191294 | NGC1365 |will be used in demo|
|SPIRE Spec:|1342256105|IRC+10216|Nice spectrum|
| |1342214831|NGC6240|will be used in demo|
| |1342214832|dark sky for NGC6240 |will be used in demo|
| |1342203586|SPIRE Photo map of NGC6240 |will be used in demo|
| |1342265845| SPIRE Spectral map of Orion Bar (HD37041) | will be used in hands-on|
|SPIRE PACS Parallel:| 1342186121, 1342186122|Rosette Nebula|Nice image|

---+++ Additional workshop  material

   * [[%ATTACHURL%/PACSspec_demo_kexter_v2.pdf][PACSspec_demo_kexter_v2.pdf]]: PACSspec_demo_kexter_v2.pdf

   * [[%ATTACHURL%/PACSspec_demo_kexter_v2.py.txt][PACSspec_demo_kexter_v2.py.txt]]: PACSspec_demo_kexter_v2.py.txt 

    (NOTE: you  may need to remove the .txt from the filename above so that the file can be recognized as a  python script by HIPE - the .txt suffix is added automatically by the twiki for security reasons)


<!--
   * Set ALLOWTOPICCHANGE = %MAINWEB%.PublicWebEditorsGroup
-->
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who
pdf	Herschel_DP_Welcome_Ott.pdf	r1	manage	2635.0 K	2013-06-24 - 22:33	PedroGarciaLario
pdf	Herschel_PGL_Newcomers.pdf	r1	manage	12289.2 K	2013-06-24 - 23:34	PedroGarciaLario
pdf	PACSspec_demo_kexter_v2.pdf	r1	manage	1670.3 K	2013-06-25 - 11:10	PedroGarciaLario
txt	PACSspec_demo_kexter_v2.py.txt	r1	manage	11.6 K	2013-06-25 - 11:27	PedroGarciaLario
pdf	pacsSpectroInstrument.pdf	r1	manage	9612.2 K	2013-06-25 - 13:15	PedroGarciaLario
pdf	pacsSpectroPipelines.pdf	r1	manage	1004.7 K	2013-06-25 - 13:15	PedroGarciaLario
Topic revision: r28 - 2013-06-25 - PedroGarciaLario
Public
Webs
Public
TWiki