lsst.pipe.drivers
14.0-11-gd2b3832
|
Public Member Functions | |
def | applyOverrides (cls, config) |
def | __init__ (self, args, kwargs) |
def | processResult (self, exposure) |
def | scale (self, ccdIdLists, data) |
def | batchWallTime (cls, time, parsedCmd, numCores) |
def | batchWallTime (cls, time, parsedCmd, numCores) |
def | run (self, expRefList, butler, calibId) |
Construct a calib from a list of exposure references. More... | |
def | getOutputId (self, expRefList, calibId) |
Generate the data identifier for the output calib. More... | |
def | getMjd (self, butler, dataId, timescale=dafBase.DateTime.UTC) |
def | getFilter (self, butler, dataId) |
def | addMissingKeys (self, dataId, butler, missingKeys=None, calibName=None) |
def | updateMetadata (self, calibImage, exposureTime, darkTime=None, kwargs) |
Update the metadata from the VisitInfo. More... | |
def | scatterProcess (self, pool, ccdIdLists) |
Scatter the processing among the nodes. More... | |
def | process (self, cache, ccdId, outputName="postISRCCD", kwargs) |
Process a CCD, specified by a data identifier. More... | |
def | processSingle (self, dataRef) |
def | processWrite (self, dataRef, exposure, outputName="postISRCCD") |
Write the processed CCD. More... | |
def | scatterCombine (self, pool, outputId, ccdIdLists, scales) |
Scatter the combination of exposures across multiple nodes. More... | |
def | getFullyQualifiedOutputId (self, ccdName, butler, outputId) |
def | combine (self, cache, struct, outputId) |
Combine multiple exposures of a particular CCD and write the output. More... | |
def | recordCalibInputs (self, butler, calib, dataIdList, outputId) |
Record metadata including the inputs and creation details. More... | |
def | interpolateNans (self, image) |
def | write (self, butler, exposure, dataId) |
Write the final combined calib. More... | |
def | makeCameraImage (self, camera, dataId, calibs) |
Create and write an image of the entire camera. More... | |
def | parseAndRun (cls, args, kwargs) |
def | parseAndSubmit (cls, args=None, kwargs) |
def | batchCommand (cls, args) |
def | logOperation (self, operation, catch=False, trace=True) |
Public Attributes | |
isTrimmed | |
images | |
background | |
Static Public Attributes | |
ConfigClass = FlatConfig | |
string | calibName = "flat" |
RunnerClass = CalibTaskRunner | |
filterName = None | |
float | exposureTime = 1.0 |
Flat construction The principal change from the base class involves gathering the background values from each image and using them to determine the scalings for the final combination.
Definition at line 947 of file constructCalibs.py.
def lsst.pipe.drivers.constructCalibs.FlatTask.__init__ | ( | self, | |
args, | |||
kwargs | |||
) |
Definition at line 964 of file constructCalibs.py.
|
inherited |
Definition at line 534 of file constructCalibs.py.
def lsst.pipe.drivers.constructCalibs.FlatTask.applyOverrides | ( | cls, | |
config | |||
) |
Overrides for flat construction
Definition at line 959 of file constructCalibs.py.
|
inherited |
Definition at line 403 of file constructCalibs.py.
|
inherited |
Combine multiple exposures of a particular CCD and write the output.
Only the slave nodes execute this method.
cache | Process pool cache |
struct | Parameters for the combination, which has the following components:
|
outputId | Data identifier for combined image (exposure part only) |
Definition at line 711 of file constructCalibs.py.
|
inherited |
Determine the filter from a data identifier
Definition at line 529 of file constructCalibs.py.
|
inherited |
Get fully-qualified output data identifier We may need to look up keys that aren't in the output dataId. @param ccdName Name tuple for CCD @param butler Data butler @param outputId Data identifier for combined image (exposure part only) @return fully-qualified output dataId
Definition at line 695 of file constructCalibs.py.
|
inherited |
Determine the Modified Julian Date (MJD; in TAI) from a data identifier
Definition at line 516 of file constructCalibs.py.
|
inherited |
Generate the data identifier for the output calib.
The mean date and the common filter are included, using keywords from the configuration. The CCD-specific part is not included in the data identifier.
expRefList | List of data references at exposure level |
calibId | Data identifier elements for the calib provided by the user |
Definition at line 481 of file constructCalibs.py.
|
inherited |
Interpolate over NANs in the combined image NANs can result from masked areas on the CCD. We don't want them getting into our science images, so we replace them with the median of the image.
Definition at line 779 of file constructCalibs.py.
|
inherited |
Create and write an image of the entire camera.
This is useful for judging the quality or getting an overview of the features of the calib.
This requires that the 'ccd name' is a tuple containing only the detector ID. If that is not the case, change CalibConfig.ccdKeys or set CalibConfig.doCameraImage=False to disable this.
camera | Camera object |
dataId | Data identifier for output |
calibs | Dict mapping 'ccd name' to calib image |
Definition at line 806 of file constructCalibs.py.
|
inherited |
Process a CCD, specified by a data identifier.
After processing, optionally returns a result (produced by the 'processResult' method) calculated from the processed exposure. These results will be gathered by the master node, and is a means for coordinated scaling of all CCDs for flats, etc.
Only slave nodes execute this method.
cache | Process pool cache |
ccdId | Data identifier for CCD |
outputName | Output dataset name for butler |
Definition at line 587 of file constructCalibs.py.
def lsst.pipe.drivers.constructCalibs.FlatTask.processResult | ( | self, | |
exposure | |||
) |
Definition at line 968 of file constructCalibs.py.
|
inherited |
Process a single CCD, specified by a data reference Generally, this simply means doing ISR. Only slave nodes execute this method.
Definition at line 622 of file constructCalibs.py.
|
inherited |
Write the processed CCD.
We need to write these out because we can't hold them all in memory at once.
Only slave nodes execute this method.
dataRef | Data reference |
exposure | CCD exposure to write |
outputName | Output dataset name for butler. |
Definition at line 631 of file constructCalibs.py.
|
inherited |
Record metadata including the inputs and creation details.
This metadata will go into the FITS header.
butler | Data butler |
calib | Combined calib exposure. |
dataIdList | List of data identifiers for calibration inputs |
outputId | Data identifier for output |
Definition at line 749 of file constructCalibs.py.
|
inherited |
Construct a calib from a list of exposure references.
This is the entry point, called by the TaskRunner.__call__
Only the master node executes this method.
expRefList | List of data references at the exposure level |
butler | Data butler |
calibId | Identifier dict for calib |
Definition at line 415 of file constructCalibs.py.
def lsst.pipe.drivers.constructCalibs.FlatTask.scale | ( | self, | |
ccdIdLists, | |||
data | |||
) |
Determine the scalings for the final combination We have a matrix B_ij = C_i E_j, where C_i is the relative scaling of one CCD to all the others in an exposure, and E_j is the scaling of the exposure. We convert everything to logarithms so we can work with a linear system. We determine the C_i and E_j from B_ij by iteration, under the additional constraint that the average CCD scale is unity. This algorithm comes from Eugene Magnier and Pan-STARRS.
Definition at line 971 of file constructCalibs.py.
|
inherited |
Scatter the combination of exposures across multiple nodes.
In this case, we can only scatter across as many nodes as there are CCDs.
Only the master node executes this method.
pool | Process pool |
outputId | Output identifier (exposure part only) |
ccdIdLists | Dict of data identifier lists for each CCD name |
scales | Dict of structs with scales, for each CCD name |
dict | of binned images |
Definition at line 675 of file constructCalibs.py.
|
inherited |
Scatter the processing among the nodes.
We scatter each CCD independently (exposures aren't grouped together), to make full use of all available processors. This necessitates piecing everything back together in the same format as ccdIdLists afterwards.
Only the master node executes this method.
pool | Process pool |
ccdIdLists | Dict of data identifier lists for each CCD name |
Definition at line 571 of file constructCalibs.py.
|
inherited |
Update the metadata from the VisitInfo.
calibImage | The image whose metadata is to be set |
exposureTime | The exposure time for the image |
darkTime | The time since the last read (default: exposureTime) |
Definition at line 555 of file constructCalibs.py.
|
inherited |
Write the final combined calib.
Only the slave nodes execute this method
butler | Data butler |
exposure | CCD exposure to write |
dataId | Data identifier for output |
Definition at line 794 of file constructCalibs.py.
|
inherited |
Definition at line 830 of file constructCalibs.py.
|
static |
Definition at line 956 of file constructCalibs.py.
|
static |
Definition at line 954 of file constructCalibs.py.
|
staticinherited |
Definition at line 394 of file constructCalibs.py.
|
staticinherited |
Definition at line 392 of file constructCalibs.py.
|
inherited |
Definition at line 829 of file constructCalibs.py.
|
inherited |
Definition at line 828 of file constructCalibs.py.
|
staticinherited |
Definition at line 391 of file constructCalibs.py.