Page Comparison

...

An asset is metadata plus content (content is the file) and namespaces are a virtual hierarchy of assets.

Authentication and Delegation

If you are doing a lot of scripting, it is undesirable to populate lots of plain text files with your login details. This is where delegation becomes useful. Delegate credentials are binary tokens that reside in the home directory of the user that creates them. These credentials automatically perform a login on your behalf when interacting with Pawsey data storage. Here's an example of creating a delegate credential that lasts for approximately one month:

pawsey:/projects>delegate 30
Delegating until: 01-Jun-2016 14:13:15
 
pawsey:/projects>exit

From now on, until the delegate expires, there is no need to login to data storage on the machine where this was run. Any pshell sessions that are run will automatically use the delegate to login. 

Finally, to destroy all delegate credentials, use:

pawsey:/projects>delegate off
 Delegate credentials removed.

...

...

for assets.

Asset metadata

Standard metadata

...

To restrict the search to look only in /projects/Data Teammyproject, use:

asset.query :where "namespace='/projects/Data Teammyproject' and name='*.PNG'"

To If you wish to search in /projects/Data Team myproject and all folders underneath it, use:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'"

Searching for all assets that were created after a certain date would be done as follows:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "ctime>='01-Jan-2017'"

Similar searches could be done using a geometric bounding box if your data has geospatial information attached.

...

If one of the elements in mytype was location (which is of type string), then here is how to search for a particular value:

asset.query :namespace "/projects/myproject" :where "xpath(mytype/location) = 'Perth' and namespace>='/projects/myproject'"

Getting more information from the results

...

To get the name of the asset as well, use:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action get-name

To get arbitrary pieces of metadata, for example the name and checksum, use:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action get-value :xpath name :xpath content/csum

...

To associate a better name with the returned metadata item, use something like:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action get-value :xpath -ename checksum content/csum

...

For example, to count all PNG files stored in the entire Data Team project or and then to sum their sizes you would run, respectively:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action count
asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action sum :xpath content/size

...

For example, suppose we wanted to move all PNG files to a new location /projects/Data Teammyproject/png-files we would use:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action pipe :service -name asset.move < :namespace /projects/Data Teammyproject/png-files >

Here our action is to pipe the results to another service call, in this case an asset.move, which is a service call that takes the required destination namespace argument in a shorthand XML document.

Naturally, similar constructions could be used to simply delete these files instead:

asset.query :wherenamespace "namespace>='/projects/Data Team' and myproject" :where "name='*.PNG'" :action pipe :service -name asset.destroy

...

To change the name of the sean folder1 namespace to sean2 folder2 use:

asset.namespace.rename :namespace /projects/Data Teammyproject/seanfolder1 :name sean2folder2

To move the namespace sean to folder1 to a new parent location use:

asset.namespace.move :namespace /projects/Data Teammyproject/seanfolder1 :to /projects/Data Teammyproject/adminsnewparent

To delete a namespace entirely, use:

asset.namespace.destroy :namespace /projects/Data Teammyproject/seanfolder1