/
Frequently Asked Questions

Frequently Asked Questions

My storage quota has been exceeded, what should I do?

Please consider the following approaches to ensure your existing quota is being utilised efficiently:

  • deleting or moving older data sets away,

  • pooling common data-sets within a project,

  • compression strategies,

  • concerns specific to Pawsey storage resources - see below.

If you have exhausted such approaches, then the project PI can request a quota increase to the relevant project. Please refer to the main documentation page Data Services to find further instructions on how to make such requests.

Acacia usage quotas

When larger files are uploaded, S3 clients may break up the data into smaller parts to send. If a transfer was interrupted before completion, there can be incomplete parts left on Acacia waiting for remaining parts that never arrive. These incomplete multi-part uploads consume quota and you should add bucket policies to automatically clean them up.

You can read more about S3 bucket policies and the AWSCLI tool here: https://pawsey.atlassian.net/wiki/x/Fk4YAw

If you prefer, you can also use Pawsey’s custom client (pshell) to simplify creating policies. Please read the pshell documentation to get started: https://pawsey.atlassian.net/wiki/x/slUYAw

Note: there is currently a discrepancy between the Acacia usage reporting in the project portal and the usage as reported by S3 clients such as rclone and pshell. This is a known issue and is being investigated. If you are certain you have cleaned up failed uploads that may be inflating your quota, please let us know and we will include it in our ongoing investigation of this issue.

 

My files are stuck and/or downloading very slowly!

You should check https://status.pawsey.org.au in case there is a known issue that is being worked on. If you are using Banksia (The Data Portal or pshell) then please make sure you have read the section on: https://pawsey.atlassian.net/wiki/x/AQD9Mw. You may also wish to consider some of the options here: https://pawsey.atlassian.net/wiki/x/jDoYAw. Also, if you are connecting from somewhere outside Pawsey, you should check with your home institution system administrators to see if there is a network bottleneck outside of Pawsey’s control.

Finally, if you are still having problems then please reach out to our Helpdesk.