(r35) OT1DataProcessingWorkshop < Public

Public Web>OT1DataProcessingWorkshop (revision 35) (raw view)~~EditAttach~~

---+ Herschel Open Time Cycle-1 Data Processing Workshop, 14-18 March 2011

 %TOC%


%RED%
*BUS TRANSPORTATION:*  Departure time on Tuesday 15 March 2011 from Hotel NH Alberto Aguilera: 08:15 sharp!! 
%ENDCOLOR%

---++  Final Agendas

 Sessions will start on Monday 14 March at 09:30 and at 09:00 on the rest of the days of the workshop. The PACS instrument part of the workshop will end at around 13:30h on Wednesday while the HIFI & SPIRE sessions will start at 14:30h on the same day. The workshop will end on Friday at 16:15h.

   * [[%ATTACHURL%/OT1_PACS_DPWorkshop_final_agenda.pdf][OT1_PACS_DPWorkshop_final_agenda.pdf]]: OT1_PACS_DPWorkshop_final_agenda.pdf
   * [[%ATTACHURL%/OT1_HIFI_SPIRE_DPWorkshop_final_agenda.pdf][OT1_HIFI_SPIRE_DPWorkshop_final_agenda.pdf]]: OT1_HIFI_SPIRE_DPWorkshop_final_agenda.pdf
 
---++ List of participants

   * [[%ATTACHURL%/OT1_DPWorkshop_participants.pdf][List of Participants]] (PDF)

---++ Presentations

*Monday 14 March 2011*

   * [[%ATTACHURL%/Day1_overview_Herschel_Pilbratt.pdf][Day1_overview_Herschel_Pilbratt.pdf]]: (G. Pilbratt)

   * [[%ATTACHURL%/Day1_overview_instr_Marston.pdf][Day1_overview_instr_Marston.pdf]]: (A. Marston)

   * [[%ATTACHURL%/Day1_overview_DP_Ott_v2.pdf][Day1_overview_DP_Ott_v2.pdf]]: (S. Ott)

   * Day1_DataHandling_Verdugo.pdf: (E. Verdugo)

   * [[%ATTACHURL%/Introduction_to_HIPE.pdf][Introduction_to_HIPE.pdf]]: (B. Merín)

   * [[%ATTACHURL%/Introduction_to_HIPE_D.Shupe_NHSC_DPWS.pdf][Introduction_to_HIPE_D.Shupe_NHSC_DPWS.pdf]]: (D. Shupe)

   * [[%ATTACHURL%/DpWorkshop2011_Notes.pdf][HIPE documentation]] (D. Rizzo)

   * Day1_PACS_Photometer.pdf: (M. Sauvage)

   * [[%ATTACHURL%/2011_March_DP_workshop_phot_level0_1.pdf][2011_March_DP_workshop_phot_level0_1.pdf]]: PACS photo from level0 to level1 (B. Altieri)

   * [[%ATTACHURL%/2011_March_DP_workshop_phot_level1_2.pdf][2011_March_DP_workshop_phot_level1_2.pdf]]: PACS photo from level1 to level2 (B. Altieri)

   * Day1_PACS_deglitching.pdf (N. Billot)


*Tuesday 15 March 2011*

   * [[%ATTACHURL%/Day2_PACS-MADmap.pdf][Day2_PACS-MADmap.pdf]]: (M. Sauvage)

*Wednesday 16 March 2011*

   * [[%ATTACHURL%/HIFI_Presentations.tgz][HIFI_Presentations.tgz]]: HIFI_Presentations.tgz


---++ Data sets 

To download the data sets that will be used during the workshop demos/hands-on sessions, please follow the instructions below:

ftp ftp.sciops.esa.int <br>
Name: anonymous <br>
Password: your email address <br>
cd /pub/hsc_wshop <br>
prompt <br>
bin <br>
dir <br>

Then, change to the directory you are interested in and write: <br>

mget *

You can also go to ftp://ftp.sciops.esa.int/pub/hsc_wshop/ with your favorite FTP compatible web browser.

You can place the downloaded data sets in any folder of your choice. You do not need
to unzip or untar the files for the moment. We will later provide information
at the workshop on how to move these zipped and tarred files into the
appropriate area for HIPE to recognize them.

*IMPORTANT INSTRUCTIONS FOR PACS SESSIONS PARTICIPANTS*

If you are to participate in the PACS hands-on sessions you will need to
start up HIPE 6.0 to allow the software to update and construct
automatically the calibration files. Earlier versions of HIPE handle
the calibration files differently, so this step is very important.  When
the software is started up for the first time it will ask you to update the
calibration.  You should accept the update and allow some time for the
calibration files to be copied to your system. Once this is done, you may
close HIPE. It is mandatory to perform this step the first time HIPE 6.0 is
launched.

*IMPORTANT INSTRUCTIONS FOR HIFI/SPIRE SESSIONS PARTICIPANTS*

 ALL HIFI/SPIRE workshop participants should download

HIFI data 1342205474_map_dbs_1b.tgz

  and

SPIRE data spireSpec1342189124_NGC7027.tgz

These datasets will be used in the joint HIFI/SPIRE spectral Tools session and are
placed in the corresponding HIFI or SPIRE directories in the ftp repository above mentioned.

---+++ PACS Data sets

*PACS Photometry*

NOTE: for the RCW120 observations only the red band can be processed on a 4 GB RAM laptop. All public data in the archive (Total size= 0.77GB)


| *OBSIDs*| *Target* | *description* |
| 1342185553 |  RCW120  | scan map |
| 1342185554 |  RCW120  | scan map |
| 1342185575 |  Sh104  | scan map |
| 1342185576 |  Sh104  | scan map |
| 1342189191 | delta Dra | mini-scan map |
| 1342189192 | delta Dra | mini-scan map |
| 1342195466 | HIP99240 |  mini-scan map |
| 1342195467  | HIP99240 | mini-scan map |

*PACS Spectroscopy*

| *OBSIDs*| *Target* | *description* |
| 1342191353 | AFGL490  | Line spectroscopy |
| 1342204332 | Ceres | SED |
| 1342204333 | Ceres | SED |
| 1342197900 | Neptune B2B ON | Unchopped SED |
| 1342197901 | Neptune B2B OFF | Unchopped SED |
| 1342197898 | Neptune B2A ON | Unchopped SED |
| 1342197899 | Neptune B2A OFF | Unchopped SED |
| 1342209696 | NGC6543 | Unchopped Line spectroscopy |
| 1342209695 | NGC6543 | Unchopped Line spectroscopy |
     

---+++ HIFI Data sets 

NOTE: Total size: 4.28GB

|OBSIDs|AOR Label| Note | Pool name used in scripts | 
|1342180473|  Aot2_P_FSw_1b_H2O_557_AFGL2591_deep |  | 1342180473_point_fsw_1b| 
|1342180551| Aot2_P_LChopNoRef_3a_CH+_DR21| | 1342180551_point_lchop_3a_noref |
|1342181161| Aot2_S_DBS_1b_full_R4_LDN1157B1| | 1342181161_sscan_dbs_1b_r4 | 
|1342190183| Aot2_P_FastDBS_1b_CO5-4_LDN1157| | 1342190183_point_fastdbs_1b |
|1342191505| SDP_HOP - HScan - O2 - 487.3GHz - Orion S | | 1342191505_sscan_mini_dbs_1a_r12 |
|1342191649| SDP_HEXOS-orikl-hifiss-b4b | | 1342191649_sscan_dbs_4b_r6 | 
|1342205481| Aot3_M_DBS_3x3_7b_CII_S140| Engineering mode| 1342205481_map_dbs_7b |
|1342205474| Aot3_M_DBS_3x3_1b_CO_5_4_S140| Engineering mode| 1342205474_map_dbs_1b |
|1342210099| Aot3_M_OTF_1b_CO5-4_IRC10216| | 1342210099_map_otf_1b |
|1342210097| Aot3_M_OTF_1b_CO5-4_IRC10216_halfbeam| | 1342210097_map_otf_1b_halfbeam |


---+++ SPIRE Data sets



   * Description of the SPIRE Data Pools: [[%ATTACHURL%/SPIREDataPools.pdf][SPIREDataPools.pdf]]


| *OBSIDs* | *Description* | *Source* | *Pool Name* |
| 1342210941 | Small Map of planetary nebula |BD303639 | spirephot_bd303639 |
| 1342211401 | Small Map of &#8220;dark region&#8221;  | Dark Sky | spirephot_dark_od587 |
| 1342195871 | Small Map of secondary calibration  star | !GammaDra | spirephot_gammadra_rp |
| 1342187440 | Large Map of Neptune, OD 202 | Neptune | spirephot_neptune_beams_rp |
| 1342183475 | Large Map of planetary nebula | NGC 5315 | spirephot_ngc5315_rp |
| 1342183046 | Parallel Mode maps of bright galaxy (orthogonal direction only) | NGC 6946 | spirephot_ngc6946_ort_rp |
| 1342183047 | Parallel Mode maps of bright galaxy (nominal direction only) | NGC 6946 | spirephot_ngc6946_norm_rp |
| 1342189124 | Carbon star NGC7027 (OD240, 17 reps, HR mode) | NGC 7027 | spireSpec1342189124_NGC7027 |
| 1342189120 | Dark sky (OD240, 40 reps, CR mode) | Dark Sky | spireSpec1342189120_DarkSky |
| 1342187893 | Mrk 231 (OD209, 50 reps, HR mode) | Mrk 231 | spireSpec1342187893_Mrk231 |
| 1342187890 | Dark sky (OD209, 50 reps, CR mode) | Dark Sky | spireSpec1342187890_DarkSky |
| 1342192180 | NGC7023 (OD302, 4 reps, MR, Raster, Intermediate sampling) | NGC 7023 | spireSpec1342192180_NGC7023 |

The spectrometer reprocessing demos will also make use of the following two calibration files (already in the ftp delivery above):

   * SCalSpecTeleRsrf_0x50002972_HR_UNAPOD_v6_1.fits
   * SCalSpecTeleRsrf_0x50002E40_HR_UNAPOD_v6_1.fits


---++ Scripts

---++++ General (these in particular unpacks the data for this workshop)

   * [[%ATTACHURL%/tgzfiles_to_lstore_pacsphot.py.txt][tgzfiles_to_lstore_pacsphot.py.txt]]: tgzfiles_to_lstore_pacsphot.py.txt

   * [[%ATTACHURL%/tgzfiles_to_lstore_pacsspec.py.txt][tgzfiles_to_lstore_pacsspec.py.txt]]: tgzfiles_to_lstore_pacsspec.py.txt

---++++ PACS

   * [[%ATTACHURL%/scanmap_Deep_Survey_miniscan_Pointsource.py.txt][scanmap_Deep_Survey_miniscan_Pointsource.py.txt]]: scan map deep survey mini-scan point-source
   * [[%ATTACHURL%/multiple_obsid_scanmap_Deep_survey_miniscan_Pointsource.py.txt][multiple_obsid_scanmap_Deep_survey_miniscan_Pointsource.py.txt]]: Multiple obsid's mini-scan map point-source

   * [[%ATTACHURL%/scanmap_Extended_emission_PhotProject.py.txt][scanmap_Extended_emission_PhotProject.py.txt]]: Extended source scan map
   * [[%ATTACHURL%/multiple_obsid_scanmap_Extended_emission.py.txt][multiple_obsid_scanmap_Extended_emission.py.txt]]: Multiple obsid's scan map extended source

   * [[%ATTACHURL%/L25_scanMapMadMap.py.txt][L25_scanMapMadMap.py.txt]]: MADmap script for crossed maps

   * [[%ATTACHURL%/plotscanpath.py.txt][plotscanpath.py.txt]]: plot scan path


---++++ SPIRE

   * [[%ATTACHURL%/SPIRE_photometer_baseline.py.txt][SPIRE_photometer_baseline.py.txt]]: SPIRE_photometer_baseline.py.txt

   * [[%ATTACHURL%/spirelines.dat.txt][spirelines.dat.txt]]: spirelines.dat.txt

   * [[%ATTACHURL%/SpireSpectrumFitterDemo.py.txt][SpireSpectrumFitterDemo.py.txt]]: SpireSpectrumFitterDemo.py.txt

   * [[%ATTACHURL%/OT1_Workshop_SPHOT_combine_obs.py.txt][OT1_Workshop_SPHOT_combine_obs.py.txt]]: OT1_Workshop_SPHOT_combine_obs.py.txt

   * [[%ATTACHURL%/OT1_Workshop_SPHOT_remove_glitches.py.txt][OT1_Workshop_SPHOT_remove_glitches.py.txt]]: OT1_Workshop_SPHOT_remove_glitches.py.txt

---++++ HIFI

   * [[%ATTACHURL%/HifiScripts.zip][HifiScripts.zip]]: HifiScripts.zip


---++ Hands-on Sessions

*PACS photometer:*

   * [[%ATTACHURL%/scanmap_Deep_Survey_miniscan_Pointsource.py.txt][scanmap_Deep_Survey_miniscan_Pointsource.py.txt]]: scan map deep survey mini-scan point-source
   * [[%ATTACHURL%/multiple_obsid_scanmap_Deep_survey_miniscan_Pointsource.py.txt][multiple_obsid_scanmap_Deep_survey_miniscan_Pointsource.py.txt]]: Multiple obsid's mini-scan map point-source

   * [[%ATTACHURL%/scanmap_Extended_emission_PhotProject.py.txt][scanmap_Extended_emission_PhotProject.py.txt]]: Extended source scan map
   * [[%ATTACHURL%/multiple_obsid_scanmap_Extended_emission.py.txt][multiple_obsid_scanmap_Extended_emission.py.txt]]: Multiple obsid's scan map extended source

   * [[%ATTACHURL%/L25_scanMapMadMap.py.txt][L25_scanMapMadMap.py.txt]]: MADmap script for crossed maps

   * [[%ATTACHURL%/plotscanpath.py.txt][plotscanpath.py.txt]]: plot scan path

*PACS spectrometer:*

*SPIRE photometer:*

*SPIRE spectrometer:*

*HIFI:*


*SPECIAL HANDS-ON SESSION ON CASSIS*


On Thursday March 17 (16:45h) a presentation of the CASSIS software package as a HIPE Plugin will be given by Sandrine Bottinelli. 
On Friday March 18 (12h-13h, room B65), a hands-on session on CASSIS supervised by Jean-Michel Glorian (CASSIS developer), Sandrine Bottinelli and Emmanuel Caux (CASSIS Scientists) is organized. This hands-on session will make use of the HIFI, PACS and SPIRE data provided for the workshop.


The CASSIS Plug-in can be installed in your HIPE 6.0.3. CASSIS is a spectral analysis tool-set containing:

&#8226; Line Identification Tool (via a CASSIS internal database containing the JPL, CDMS and NIST databases)
&#8226; Prediction of spectra (HIFI only at this time)
&#8226; Powerful line/baseline fitting
&#8226; Comparison of telescope or laboratory data with a wide variety of models
&#8226; Tools to determine the physical parameters of the sources

See the cassis web-site for details (http://cassis.cesr.fr). 

The plug-in makes these functionalities available directly in HIPE.

To install the CASSIS plugin, select "Plug-ins" from the HIPE Tools menu. Click "Install new plug-in" and enter the following URL:
   
http://cassis.cesr.fr/download/cassis_2.8.jar

The plugin has been successfully tested with HIPE 6.0.3 within the following environments :

- Mac OSX 10.6 Snow Leopard
- Windows XP and Windows 7
- Linux and Unix

*It would be better for the users who plan to attend the CASSIS hands-on to come to the workshop with the CASSIS plugin installed on their laptops in HIPE 6.0.3 as the download and install of the plugin can take a while if done simultaneously from ESAC (~350 Mb to download).*



---++ Booklets

   * [[%ATTACHURL%/HipeHelpBooklet.pdf][Discover HIPE Help]] (PDF)

---++ Video Tutorials

   * [[http://www.youtube.com/learnhipe][Learn HIPE - Video Tutorials]]

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	2011_March_DP_workshop_phot_level0_1.pdf	r1	manage	8591.7 K	2011-03-14 - 13:20	BrunoAltieri	PACS photo from level0 to level1
ppt	2011_March_DP_workshop_phot_level0_1.ppt	r1	manage	2805.0 K	2011-03-14 - 13:18	BrunoAltieri	PACS photo from level0 to level1
pdf	2011_March_DP_workshop_phot_level1_2.pdf	r1	manage	8218.6 K	2011-03-14 - 14:53	BrunoAltieri	PACS photo from level1 to level2
pdf	Day1_overview_DP_Ott.pdf	r1	manage	4112.4 K	2011-03-14 - 08:48	PedroGarciaLario
pdf	Day1_overview_DP_Ott_v2.pdf	r1	manage	4112.4 K	2011-03-14 - 22:20	PedroGarciaLario
pdf	Day1_overview_Herschel_Pilbratt.pdf	r1	manage	12791.6 K	2011-03-14 - 22:29	PedroGarciaLario
pdf	Day1_overview_instr_Marston.pdf	r1	manage	666.6 K	2011-03-14 - 08:47	PedroGarciaLario
pdf	Day2_PACS-MADmap.pdf	r1	manage	2207.0 K	2011-03-15 - 00:05	PedroGarciaLario
pdf	DpWorkshop2011_Notes.pdf	r1	manage	3851.5 K	2011-03-14 - 09:27	DavideRizzo	HIPE documentation presentation
txt	L25_scanMapMadMap.py.txt	r5 r4 r3 r2 r1	manage	8.8 K	2011-03-14 - 10:33	BrunoAltieri	MADmap script for crossed maps
pdf	OT1_DPWorkshop_PACS_draft_agenda.pdf	r2 r1	manage	70.5 K	2011-03-11 - 11:30	PedroGarciaLario
pdf	OT1_HIFI_SPIRE_DPWorkshop_final_agenda.pdf	r1	manage	14.5 K	2011-03-15 - 00:50	PedroGarciaLario
pdf	OT1_PACS_DPWorkshop_draft_agenda.pdf	r1	manage	70.5 K	2011-03-11 - 11:18	PedroGarciaLario
pdf	OT1_PACS_DPWorkshop_final_agenda.pdf	r1	manage	14.0 K	2011-03-15 - 00:49	PedroGarciaLario
txt	multiple_obsid_scanmap_Deep_survey_miniscan_Pointsource.py.txt	r1	manage	14.6 K	2011-03-14 - 08:49	BrunoAltieri	Multiple obsid's mini-scan map point-source
txt	multiple_obsid_scanmap_Extended_emission.py.txt	r1	manage	14.1 K	2011-03-14 - 08:51	BrunoAltieri	Multiple obsid's scan map extended source
txt	plotscanpath.py.txt	r1	manage	1.4 K	2011-03-14 - 08:57	BrunoAltieri	plot scan path
txt	scanmap_Deep_Survey_miniscan_Pointsource.py.txt	r1	manage	41.7 K	2011-03-14 - 08:47	BrunoAltieri	scan map deep survey mini-scan point-source
txt	scanmap_Extended_emission_PhotProject.py.txt	r1	manage	39.4 K	2011-03-14 - 08:50	BrunoAltieri	Extended source scan map

Topic revision: r35 - 2011-03-15 - PedroGarciaLario

Public

Webs
Public
TWiki