Skip to end of banner
Go to start of banner

Files in Scratch Were Deleted

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Current »

Problem

Files in /scratch were deleted.

Explanation

There is a "purge policy" (Explained here) which means that files in /scratch not accessed within the last 21 days will be deleted.

This policy is presented, within the the Message of the Day (MotD) banner, displayed at login, as follows

Please remember that NO filesystems are backed up, and any files in /scratch
that have not been accessed for 21 days or more will be permanently deleted. 
You are responsible for ensuring you have a copy of any critical data.


Note that:

  • There are multiple timestamps for files - last access, last modification, and creation.
    Purging is based on access time. "ls -l" by default shows modification time.
    You should use the "-u" flag to see last access time. "ls -ltu" is recommended.
  • Some files in a directory may get deleted while others remain. It depends on what was accessed in the last 21 days.
  • When copying/rsyncing/untarring files, be sure not to retain original timestamps. Otherwise the files might be immediately eligible for purging.
    As Pawsey recommends keeping copies of "long-lived" data within its Acacia object storage system,
    please familiarise yourself with some of the know issues when using the object storage,
    as documented in the Acacia - Troubleshooting page.





  • No labels