stilt.execution.SlurmExecutor#
- class stilt.execution.SlurmExecutor(n_workers: 'int', cpus_per_task: 'int' = 1, array_parallelism: 'int | None' = None, setup: 'list[str] | None' = None, **kwargs: 'Any') 'None'[source]#
Fire-and-forget executor that submits Slurm array jobs via
sbatch.Always uses push dispatch — the coordinator writes immutable chunk files before calling
start(), andSlurmExecutorderives the chunk directory fromspec.output_dirandspec.batch_id.
Parameters
n_workersNumber of array tasks to use for the submission. Each task processes one chunk.
cpus_per_taskNumber of CPUs to request per array task. This is passed to the push worker via
--cpus, enabling parallel execution within each task if greater than 1.array_parallelismMaximum number of array tasks to run in parallel (
%Nsuffix).setupOptional list of shell commands to run before the push worker command.
**kwargsAdditional keyword arguments passed as
--key=valuesbatch directives.
Methods#
|
Build a Slurm executor from |
|
Write chunk files, generate a submission script, submit via |
Attributes#
|
|
|
Return the default array-task count used by this executor. |