You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 13
Next »
Overview
If you have a supercomputing allocation, then your workflow will involve some of these steps.
The first is how do you perform authentication in the context of a (non-interactive) submitted job - use the delegate command.
pshell can be then run from the command line to perform stand alone commands.
It can also be given a script containing any number of commands that will be executed sequentially.
Exercises
Exercise - create a delegate and check that pshell is using it.
Solution 1
pshell
login
sean
????
delegate
exit
pshell whoami
Exercise - script a task to download a file in your directory.
Solution 2
Create a plain text file script1.txt containing:
cd Demo/sean
get testfile1
pshell -i script1.txt
Exercise - script a task that attempts to perform something that will fail (eg remove a directory that doesn't exist) and correctly report that the script encountered an error.
Solution 3
Run the following script if you have bash ... sorry Windows users (without WSL.)
#!/bin/bash
pshell "rmdir /idontexist"
if [ $? == 0 ]; then
echo "All good - proceed further!"
else
echo "Operation failed!"
fi
This would typically be a job script on (eg) Pawsey HPC - where you would be doing all such work in a Linux environment.
The idea is that if something in your data setup pipeline fails - don't waste any valuable cpu time on it.