Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt
hiddentrue

Installing an S3 client application

Working with Acacia requires client applications compatible with the Amazon S3 protocol. These clients can be accessed from Pawsey clusters or they can be installed on your local/institutional computer. 

Acacia is a modern object storage system built upon the open-source software Ceph. Interacting with Acacia and managing your data on it requires client applications compatible with the Amazon S3 protocol. Such clients can be accessed from Pawsey clusters or they can be installed on your local/institutional computer. Pawsey recommends the open-source Rclone command line program, and for researchers who have Managed Data projects we also provide the Pawsey client pshell.

Pawsey Supercomputers and Data Mover Nodes

Rclone can be accessed on Pawsey's supercompute facilities through the module system. There is no default module version, so you can check the available versions with:

...

Code Block
module load rclone/<version>


Pshell requires >= Python 3.6.x and boto3

Code Block
module load python/3.6.3
module load boto3

Then download the client:

Code Block
git clone https://bitbucket.org/datapawsey/mfclient.git


Other Systems

Rclone installation on Linux/macOS/BSD systems, run:

Code Block
sudo -v ; curl https://rclone.org/install.sh | sudo bash



Pshell requires >= Python 3.6.x and boto3 to be installed.

Then download the client:

Code Block
git clone https://bitbucket.org/datapawsey/mfclient.git

...