lsst.ctrl.pool  13.0-6-gf96f8ec+31
 All Classes Namespaces Files Functions Variables Pages
Public Member Functions | Static Public Attributes | List of all members
lsst.ctrl.pool.parallel.BatchParallelTask Class Reference
Inheritance diagram for lsst.ctrl.pool.parallel.BatchParallelTask:
lsst.ctrl.pool.parallel.BatchCmdLineTask

Public Member Functions

def parseAndRun
 
def parseAndSubmit
 
def batchWallTime
 Return walltime request for batch job. More...
 
def batchCommand
 Return command to run CmdLineTask. More...
 
def logOperation
 Provide a context manager for logging an operation. More...
 

Static Public Attributes

 RunnerClass = BatchTaskRunner
 

Detailed Description

Runs the BatchCmdLineTask in parallel

Use this subclass of BatchCmdLineTask if you don't need to use the Pool
directly, but just want to iterate over many objects (like a multi-node
version of the '-j' command-line argument).

Definition at line 578 of file parallel.py.

Member Function Documentation

def lsst.ctrl.pool.parallel.BatchCmdLineTask.batchCommand (   cls,
  args 
)
inherited

Return command to run CmdLineTask.

Parameters
cls,:Class
args,:Parsed batch job arguments (from BatchArgumentParser)

Definition at line 458 of file parallel.py.

def lsst.ctrl.pool.parallel.BatchCmdLineTask.batchWallTime (   cls,
  time,
  parsedCmd,
  numCores 
)
inherited

Return walltime request for batch job.

Subclasses should override if the walltime should be calculated differently (e.g., addition of some serial time).

Parameters
cls,:Class
time,:Requested time per iteration
parsedCmd,:Results of argument parsing
numCores,:Number of cores

Definition at line 443 of file parallel.py.

def lsst.ctrl.pool.parallel.BatchCmdLineTask.logOperation (   self,
  operation,
  catch = False,
  trace = True 
)
inherited

Provide a context manager for logging an operation.

Parameters
operation,:description of operation (string)
catch,:Catch all exceptions?
trace,:Log a traceback of caught exception?

Note that if 'catch' is True, all exceptions are swallowed, but there may be other side-effects such as undefined variables.

Definition at line 484 of file parallel.py.

def lsst.ctrl.pool.parallel.BatchParallelTask.parseAndRun (   cls,
  args,
  kwargs 
)
Parse an argument list and run the command

This is the entry point when we run in earnest, so start the process pool
so that the worker nodes don't go any further.

Definition at line 598 of file parallel.py.

def lsst.ctrl.pool.parallel.BatchCmdLineTask.parseAndSubmit (   cls,
  args = None,
  kwargs 
)
inherited

Definition at line 420 of file parallel.py.

Member Data Documentation

lsst.ctrl.pool.parallel.BatchParallelTask.RunnerClass = BatchTaskRunner
static

Definition at line 585 of file parallel.py.


The documentation for this class was generated from the following file: