Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt
hiddentrue

Creating and deleting objects

This page shows you how to create and delete objects from Acacia.

What is an object?

Objects are the individual pieces of data that are contained in a bucket. An object is typically a file and any metadata that describes the file. 

...

Since objects are both file and metadata, for the sake of the performance of the storage system, it is recommended that no more than 100K objects are contained per bucket. There is a system limit of 1M objects per bucket.

Object names 

You can use any UTF-8 character in an object name. However, using certain characters can cause problems with some applications and protocols. The following character sets are generally safe for use in object names.

...

  • 2012-march-samples

  • test.sample_images-2014/jan/calibrator.jpg

  • data/2019/genesamples/results001.tar

Creating an object

To create a single object using rclone, use the rclone copy command:

...

  • <SOURCE> is the filesystem path and that contains the files to upload as objects. For a single file,it can contain the name of the file you want to upload.
  • <TARGET> is  is the key of the object on Acacia , so (equivalent to the destination path). So the key consists of the profile name (with its colon, :), bucket name, pseudo folder (optional), and . IMPORTANT: In the target, you can't specify the object name. You can specify any object name to “rename” the file on uploadIf the object name was given, then it would be considered as another pseudo folder, but the last part containing the name of the object will be the same as in the source.

Example:

Code Block
$ rclone copy galaxy_xlassification.ipynb courses01:cou01/


Deleting an object

To delete an object using rclone, use the delete command:

...

Note
titleClient support

The delete command works recursively. So if a pseudo folder is specified to be deleted instead of an a specific object name, then all its contents will be removed. On top of that, because rclone does not allow for empty pseudo folders to exist, it will also remove the pseudo folder itself and all the pseudo folders above in the tree branch that become empty due to the deletion in cascade. This cascade process will stop with the bucket itself, as the delete command cannot remove buckets, even if they are empty. 

Consider using the --dry-run option to validate that the operation targets only the desired objects.


Related pages