Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The file system /scratch on Setonix is a Lustre filesystem that makes automatic use of file striping to increase I/O performance and is performed automatically. This means that files are automatically divided into chunks that are written or read simultaneously across a set of Object Storage Targets (OSTs). In previous systems, users were it was recommended to use manually set optimal file striping settings parameters depending on the size of the different files read/written by their applications , but that but, in current Lustre systems, this is not longer neededin our current Lustre installations, thanks to the Progressive File Layout (PFL) technology.

PFL automatically enforces different striping settings for different segments of the files as they grow, allowing great I/O performance for most of the applications without the need for users to "optimise" their own striping settings. Because of this, we ask users not to manually adjust the file striping. If users feel the default PFL settings are not meeting their needs, please contact the help desk via help@pawsey.org.au.raise a ticket to the helpdesk.

Info
title/scratch now uses Progressive FIle Layout

By default, Setonix /scratch use PFL to stripe files to make best use of the SSD and HDD. This default settings has been set to work for almost all workflows and we recommend not setting the stripping explicitly. 

Related pages