pshell and cool-tier storage
Files stored on cool-tier storage (Banksia) will often be in an offline state.
portal:/projects/myproject>info myfile.zip
...
state : offlineAttempting to download such files using a normal client (eg rclone, wget, etc) will likely timeout as the data is not immediately available and must be recalled from tape to disk.
However, the Data Portal and pshell can manage such files as they issue a recall command to Banksia, wait for the file to become online, and then download it.
Recalling files can take a while; anywhere from minutes to hours or even longer depending on the number and size of the files, and requests from other users. It is also very inefficient to recall files for download one at a time.
When downloading a significant number of files, we recommend pshell over the Data Portal. This is because if you download in pshell using a pattern match (eg *.zip) the matches can be submitted as a batch tape recall request. This approach will be far more efficient overall.
pshell> get *.zip
Preparing 50 files...
<wait>
progress=0.1%, 0/50 files, errors=0, skipped=0, running=4, overall rate=10.0 MB/s