Segmentation Fault Occurred

Problem

A "segmentation fault occurred" error appears while using srun.

Solution

There are many causes of a segmentation fault, but they are all memory related.  Try:

  1. Add the below to your job script, before srun.

    ulimit -s unlimited

    The Intel compiler in particular appears to use stack memory heavily.

  2. Use more physical memory per task.  Either ask for more nodes in the job request, or use the --mem-per-cpu option for sbatch (see "man sbatch").
  3. Compile your software with debugging options, to see if an array index is going out of bounds.