lsst.pipe.drivers  20.0.0-1-g5b95a8c+c7b4c25256
Public Member Functions | Static Public Attributes | List of all members
lsst.pipe.drivers.ingestDriver.PoolIngestTask Class Reference
Inheritance diagram for lsst.pipe.drivers.ingestDriver.PoolIngestTask:
lsst::ctrl::pool::parallel::BatchCmdLineTask lsst.pipe::tasks::ingest::IngestTask

Public Member Functions

def batchWallTime (cls, time, parsedCmd, numCores)
 
def parseAndRun (cls, *args, **kwargs)
 
def runFileWrapper (self, struct, args)
 
def run (self, args)
 
def writeConfig (self, *args, **kwargs)
 
def writeMetadata (self, *args, **kwargs)
 
def parseAndSubmit (cls, args=None, **kwargs)
 
def batchWallTime (cls, time, parsedCmd, numCores)
 
def batchCommand (cls, args)
 
def logOperation (self, operation, catch=False, trace=True)
 
def __init__ (self, *args, **kwargs)
 
def parseAndRun (cls)
 
def prepareTask (cls, root=None, dryrun=False, mode="move", create=False, ignoreIngested=False)
 
def ingest (self, infile, outfile, mode="move", dryrun=False)
 
def isBadFile (self, filename, badFileList)
 
def isBadId (self, info, badIdList)
 
def expandFiles (self, fileNameList)
 
def runFile (self, infile, registry, args, pos)
 
def run (self, args)
 
def ingestFiles (self, fileList)
 

Static Public Attributes

 ConfigClass
 
 ArgumentParser
 

Detailed Description

Parallel version of IngestTask

Definition at line 7 of file ingestDriver.py.

Member Function Documentation

◆ batchWallTime()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.batchWallTime (   cls,
  time,
  parsedCmd,
  numCores 
)

Definition at line 10 of file ingestDriver.py.

◆ parseAndRun()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.parseAndRun (   cls,
args,
**  kwargs 
)
Run with a MPI process pool

Definition at line 24 of file ingestDriver.py.

◆ run()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.run (   self,
  args 
)
Run ingest

We read and ingest the files in parallel, and then
stuff the registry database in serial.

Definition at line 60 of file ingestDriver.py.

◆ runFileWrapper()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.runFileWrapper (   self,
  struct,
  args 
)
Run ingest on one file

This is a wrapper method for calling ``runFile``.

Parameters
----------
struct : `lsst.pipe.base.Struct`
    Structure containing ``filename`` (`str`) and ``position`` (`int`).
args : `argparse.Namespace`
    Parsed command-line arguments.

Returns
-------
hduInfoList : `list` of `dict`
    Parsed information from FITS HDUs, or ``None``.

Definition at line 34 of file ingestDriver.py.

◆ writeConfig()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeConfig (   self,
args,
**  kwargs 
)

Definition at line 82 of file ingestDriver.py.

◆ writeMetadata()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeMetadata (   self,
args,
**  kwargs 
)

Definition at line 85 of file ingestDriver.py.


The documentation for this class was generated from the following file: