When you are writing large files to /scratch or any other Lustre filesystem, it is recommended to stripe these across multiple partitions (Lustre OSTs). Verylarge files (> 1 TB), must be striped, as they can rapidly fill the OST and cause I/O issues for you and other users.
| Info |
|---|
By default, files on Setonix |
...
striped to make best use of the SSD and HDD. This default stripping has been set to work all most all workflows and we recommend not setting the stripping explicitly. |
Below is an example of how to set stripping. However, only proceed with explicit stripping for exceptionally large files and proceed with caution. The default stripping has been set to ensure performance and mitigate I/O issues since this is a shared resource.
Step-by-step guide - creating and setting a new striped directory
...