Transferring to Pawsey via Cloudstor
- Sarah Beecroft
The following page is an example of how Cloudstor might be leveraged to transfer data to Pawsey systems if required.
Cloudstor offers 1TB of data for free to individual researcher at AARNet-connected institution.
Go to the URL https://www.aarnet.edu.au/network-and-services/cloud-services-applications/cloudstor and click “LOGIN TO CLOUDSTOR” to login with your host institution's credentials.
Once your username and password have been verified, you should land on your own CloudStor page.
From here, you can upload files with your browser, or with command line.
rclone is a free tool for command line data transfer, which is very easy to use after following a few config steps. Instructions for how to install and configure rclone for cloudstor can be found here: https://support.aarnet.edu.au/hc/en-us/articles/115007168507 This can be used to setup rclone on your local machine and/or Pawsey and Nimbus as desired.
We have linked this article so it will always stay current with Cloudstor's documentation.
As an example of using curl:
curl --progress-bar --verbose -T my_file.txt --user cloudstor.email@your.institute.edu.au https://cloudstor.aarnet.edu.au/plus/remote.php/webdav/my_dir/ | tee /dev/null
The command will only work if my_dir exists, so create it using the web interface prior to running the command. Otherwise, remove my_dir/ from the line and you can upload directly to the root directory. Do not forget the trailing /.
The command will prompt you for a password. Use your CloudStor password that you created when you first logged onto CloudStor.
You can also use curl to send other request methods, such as deleting a file.
curl -X DELETE --user cloudstor.email@your.institute.edu.a https://cloudstor.aarnet.edu.au/plus/remote.php/webdav/my_file.txt