lsst.pipe.drivers g96f01af41f+625d72ca7f
Public Member Functions | List of all members
lsst.pipe.drivers.ingestDriver.PoolIngestTask Class Reference
Inheritance diagram for lsst.pipe.drivers.ingestDriver.PoolIngestTask:
lsst::ctrl::pool::parallel::BatchCmdLineTask

Public Member Functions

def batchWallTime (cls, time, parsedCmd, numCores)
 
def parseAndRun (cls, *args, **kwargs)
 
def runFileWrapper (self, struct, args)
 
def run (self, args)
 
def writeConfig (self, *args, **kwargs)
 
def writeMetadata (self, *args, **kwargs)
 
def parseAndSubmit (cls, args=None, **kwargs)
 
def batchWallTime (cls, time, parsedCmd, numCores)
 
def batchCommand (cls, args)
 
def logOperation (self, operation, catch=False, trace=True)
 

Detailed Description

Parallel version of IngestTask

Definition at line 7 of file ingestDriver.py.

Member Function Documentation

◆ batchWallTime()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.batchWallTime (   cls,
  time,
  parsedCmd,
  numCores 
)

Definition at line 10 of file ingestDriver.py.

◆ parseAndRun()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.parseAndRun (   cls,
args,
**  kwargs 
)
Run with a MPI process pool

Definition at line 24 of file ingestDriver.py.

◆ run()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.run (   self,
  args 
)
Run ingest

We read and ingest the files in parallel, and then
stuff the registry database in serial.

Definition at line 60 of file ingestDriver.py.

◆ runFileWrapper()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.runFileWrapper (   self,
  struct,
  args 
)
Run ingest on one file

This is a wrapper method for calling ``runFile``.

Parameters
----------
struct : `lsst.pipe.base.Struct`
    Structure containing ``filename`` (`str`) and ``position`` (`int`).
args : `argparse.Namespace`
    Parsed command-line arguments.

Returns
-------
hduInfoList : `list` of `dict`
    Parsed information from FITS HDUs, or ``None``.

Definition at line 34 of file ingestDriver.py.

◆ writeConfig()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeConfig (   self,
args,
**  kwargs 
)

Definition at line 82 of file ingestDriver.py.

◆ writeMetadata()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeMetadata (   self,
args,
**  kwargs 
)

Definition at line 85 of file ingestDriver.py.


The documentation for this class was generated from the following file: