lsst.pipe.drivers  6.0b0-hsc-20-g3029749+4
Public Member Functions | Static Public Attributes | List of all members
lsst.pipe.drivers.ingestDriver.PoolIngestTask Class Reference
Inheritance diagram for lsst.pipe.drivers.ingestDriver.PoolIngestTask:
lsst::ctrl::pool::parallel::BatchCmdLineTask lsst.pipe::tasks::ingest::IngestTask

Public Member Functions

def batchWallTime (cls, time, parsedCmd, numCores)
 
def parseAndRun (cls, args, kwargs)
 
def run (self, args)
 
def writeConfig (self, args, kwargs)
 
def writeMetadata (self, args, kwargs)
 
def parseAndSubmit (cls, args=None, kwargs)
 
def batchWallTime (cls, time, parsedCmd, numCores)
 
def batchCommand (cls, args)
 
def logOperation (self, operation, catch=False, trace=True)
 
def __init__ (self, args, kwargs)
 
def parseAndRun (cls)
 
def ingest (self, infile, outfile, mode="move", dryrun=False)
 
def isBadFile (self, filename, badFileList)
 
def isBadId (self, info, badIdList)
 
def expandFiles (self, fileNameList)
 
def runFile (self, infile, registry, args)
 
def run (self, args)
 

Static Public Attributes

 ConfigClass
 
 ArgumentParser
 

Detailed Description

Parallel version of IngestTask

Definition at line 6 of file ingestDriver.py.

Member Function Documentation

◆ batchWallTime()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.batchWallTime (   cls,
  time,
  parsedCmd,
  numCores 
)

Definition at line 9 of file ingestDriver.py.

◆ parseAndRun()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.parseAndRun (   cls,
  args,
  kwargs 
)
Run with a MPI process pool

Definition at line 23 of file ingestDriver.py.

◆ run()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.run (   self,
  args 
)
Run ingest

We read and ingest the files in parallel, and then
stuff the registry database in serial.

Definition at line 34 of file ingestDriver.py.

◆ writeConfig()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeConfig (   self,
  args,
  kwargs 
)

Definition at line 56 of file ingestDriver.py.

◆ writeMetadata()

def lsst.pipe.drivers.ingestDriver.PoolIngestTask.writeMetadata (   self,
  args,
  kwargs 
)

Definition at line 59 of file ingestDriver.py.


The documentation for this class was generated from the following file: