Acacia - Troubleshooting

Why Is my data disappearing in less than 21 days when I use rclone to pull it from Acacia to Setonix /scratch?

If copying to Setonix /scratch file system please be aware that rclone sets modtime to the value it gets from the S3 storage.
This could result in data being purged from /scratch even though it has not been on the file system for 21 days.
To prevent this you can use the --local-no-set-modtime option to rclone.

Why Am I Unable to Create a Bucket?

If the name for the new bucket already exists, use another name and try again. Each bucket name must be globally unique. Specifically, it must be different from that of buckets created by its owner or by any other users.
The name of a deleted bucket cannot be reused immediately after the deletion.
Check whether the account has the required permissions.

Why Can't I Delete a Bucket?

A bucket needs to be empty before it can be deleted.

How Much is My Quota, and Can I Increase it?

The default quota is 100GB for users and 1TB for projects. This can be increased to 10TB for projects if you submit a request to the helpdesk stating your case for the increase. Allocations beyond 10TB are possible with an application for managed storage through the application portal.

How Many Buckets/Objects Can I Have?

There is a limit of 1K buckets per project/user.
We recommend no more than 100K objects per bucket.
There is no limit to the size of an object apart from your quota.
Please note that some clients report a "Quota Exceeded" error if you have 1M objects in a bucket.

I Copied Some Data to Acacia, Why Doesn't it Appear When I List the Contents of My Storage Space?

Check that you have properly configured your client. If there is an error in your configuration the client will perform the actions on the local system rather than on Acacia. For example: you saved your user access keys to your project alias instead of your project access keys; you have a typo in the Acacia endpoint https://project.pawsey.org.au instead of https://projects.pawsey.org.au.

What file transfer program should I use with acacia?

Any software that is properly compatible with the AWS S3 protocol can be used. Currently, Pawsey is recommending that rclone be used as it is the most featureful and is more robust when transferring larger (>100GB) files.

Can I give read-only access to certain users?

For your personal storage area, you can grant any permission (including readonly) to other users on a per-bucket basis. This is discussed in the policy section of the documentation. For projects, this feature is not available in production yet.

How do I copy/move data to a different project?

Where possible, you should attempt to share data rather than making another copy of it.

However, buckets may be moved from one project to another by request to the helpdesk, with a supporting explanation.

What do I do if I'm still having trouble?

You can try looking for a solution in the external resources listed below, or contact helpdesk@pawsey.org.au