Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt

There are multiple filesystems mounted to each of Pawsey's supercomputers. Each of these filesystems are designed for particular use cases. This page provides a detailed description of these filesystems.

...

Column


Code Block
languagebash
themeDJango
titleTerminal 1. Setup configuration directories on /software
$ mv .vscode-server $MYSOFTWARE/ # if .vscode_server already exists 
$ mkdir $MYSOFTWARE/.vscode-server # if the directory does not exist yet
$ cd $HOME
$ ln -s $MYSOFTWARE/.vscode-server # generate a symbolic link, make sure you are in $HOME



Software filesystem

The /software  filesystem is a Lustre file system with much higher throughput than /home. It is intended for software installations and Slurm batch script templates. Each project has an associated directory , on the filesystem whose path is /software/projects/<project>, with a quota of 256 GB per project. (More can be allocated upon justified request.) Within the Within a project directory, each project member has a subdirectoryhis or her own directory whose full path, /software/projects/<project>/<username>, with a limit , is contained in the MYSOFTWARE environment variable.

There are two types of quota in place on /software:

  • A project-wide quota of 256GB on the amount of used disk space, and
  • a per-user quota of 100,000 individual files

...

The user software location can be viewed by using the $MYSOFTWARE environment variable.

...

  • . Notice that files belonging to different projects count towards the same user quota. In other words, a user can have a maximum of 100k files across all the projects she is involved in.


Column


Note

The software filesystem is intended for storage of software installations and Slurm batch scripts for the lifetime of the project.


All members of a project have read and write access to the /software/projects/<project> directory, so it can be used for sharing software installations and batch script templates templates within a project. Your allocation of space on /software exists for the duration of the project and is not subject to any automatic purging.

Quotas on disk space usage are managed per project group. If any member of the project exceeds the shared project quota on /software, it will affect the whole project and will be unable to save data (you may see a 'quota exceeded' message')

/software is a Lustre file system and has a much higher throughput than /home. The quota The project-wide quota consumption can be queried using the following command:

Column
width900px


Code Block
languagebash
themeDJango
titleTerminal 21. List project storage usageChecking the project quota.
$ pawseyAccountBalancelfs quota -g $PAWSEY_PROJECT -storage
...
Storage Information
-------------------
/software usage for project123, used = 899.54 GiB, quota = 1024.00 GiBh /software
Disk quotas for grp project1234 (gid xxxxx):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
      /software  1.688G      0k    256G       -   29415       0       0       -


whereas the per-user quota usage can be queried in the following way:

Column
width900px


Code Block
languagebash
themeDJango
titleTerminal 2. Checking the per-user quota
cdipietrantonio@setonix-03:/software/projects/director2183/cdipietrantonio> lfs quota -u $USER -h /software
Disk quotas for usr cdipietrantonio (uid 22158):
     Filesystem    used   quota   limit   grace   files   quota   limit   grace
      /software  14.16G      0k      0k       -   49053       0  100000       -




Warning

The software filesystem is not backed up.

Scratch filesystem

The scratch filesystem should be used for working data, which is input and output files actively used by jobs queued or running on the supercomputer.

...