...

GPUs must be explicitly requested to Slurm using the --gres=gpu:<num_gpus>,  --gpus-per-task=<num_gpus> or --gpu-per-node=<num_gpus> options.

Compiling

...

software

If you are using ROCm libraries, such as rocFFT, to offload computations to GPUs, you should be able to use any compiler to link those to your code.

For HIP code as well as one making use of OpenMP offloading, you must use hipcc. Take a look at Programming AMD GPUs.

There is no OpenACC support currently available.

Accounting

Each MI250X GCD, which corresponds to a Slurm GPU, is charged 64SU per hour. This means the use of an entire GPU node is charged 512SU per hour. In general, a job is charged the largest proportion of core, memory, or GPU usage rounded up to 1/8ths of a node (corresponding to an individual MI250X GCD).

...