Skip to end of banner
Go to start of banner

Job Scheduling and Partitions Use Policies

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 9 Next »

Debug and Development Partitions

The debug and development partitions are strictly reserved for the following activities:

  • Code porting
  • Code debugging
  • Code development
  • Job script/workflow management script porting, debugging and/or development
These partitions must not be used for the following activities:
  • Production runs (i.e., jobs that are intended to generate final results or data for publication, reporting, or use in further analysis)
  • Preparatory or test runs, including but not limited to:
    • Warm-up/generation of initial conditions for simulations
    • Testing configurations, searching for optimal parameters, or setting up simulations, even if the results will not be used directly.
    • Running simulations or experiments to determine production parameters for AI/ML model training (e.g., hyperparameter tuning, configuration testing, validation of stability under different settings).
    • Testing code or scripts in ways that mimic production workloads, such as large-scale simulations or model training, that are not explicitly part of the development or debugging process.
Note: This restriction applies regardless of the execution time of the jobs. For instance, jobs that involve testing for numerical stability, parameter optimization, or early-stage simulations should not be conducted on the Debug/Development partitions, even if the run times are under the partition's walltime limit.

Current available debug and development partitions at Pawsey are:

ClusterName

N. Nodes

Cores per nodeAvailable node-RAM for jobsGPU chiplets per nodeTypes of jobs supportedMax Number of Nodes per JobMax Wall timeMax Number of Concurrent Jobs per UserMax Number of Jobs Submitted per User
Setonixdebug82x 64230 GBn/aExclusive for development and debugging of CPU code and workflows.41h14
Setonixgpu-dev201x 64230 GB8Exclusive for development and debugging of GPU code and workflows.-4h--
  • No labels