Full Name: | herschel.hifi.pipeline.generic.DoCleanUpTask |
Alias: | doCleanUp |
Type: | Java Task -
![]() |
Import: | from herschel.hifi.pipeline.generic import DoCleanUpTask |
Category |
Cleans up the timeline product by removing data no longer needed after running the level1 pipeline.
Furthermore, it packs all the data belonging to the same frequency group to on single dataset. Here, the temporal order is conserved.
Example 1: In HIPE: | ||
---|---|---|
|
Jython Syntax |
---|
|
HifiTimelineProduct htp
[INOUT, MANDATORY, default=no default value]
|
|
---|---|
The timeline product (observation) to be passed to the module. |
PipelineConfiguration params
[INPUT, OPTIONAL, default=no default value]
|
|
---|---|
Pipeline configuration parameters that can be passed to the task. |
Boolean ignore
[INPUT, OPTIONAL, default=no default value]
|
|
---|---|
Flag to indicate whether the execution of the module should be ignored. |
String retain
[INPUT, OPTIONAL, default=scienceOn]
|
|
---|---|
String parameter specifying which data to retain while cleaning up. Options: 'scienceOn' (default), 'science'. |
Boolean mergeDatasets
[INPUT, OPTIONAL, default=True]
|
|
---|---|
If set to true datasets that belong to the same "group" are merged. The data typically is structured into groups where the groups are given an observing mode specific meaning:
In addition, scans that belong to the same group but are not subsequent in observation time will not be merged. |
Integer datasetSize
[INPUT, OPTIONAL, default=100]
|
|
---|---|
Maximum size of the datasets (number of rows) included in the result timeline product. Note that datasets are not teared in the sense that datasets are not merged if the resulting size is not within the specified size. Furthermore, if a given input dataset is already above the limit this will be moved to the output without change. |