pshell and scripting

Overview

If you have a supercomputing allocation, then your workflow will involve some of these steps.

The first is how do you perform authentication in the context of a (non-interactive) submitted job - use the delegate command.

pshell can be then run from the command line to perform stand alone commands.

It can also be given a script containing any number of commands that will be executed sequentially.

Exercises

Exercise - create a delegate and check that pshell is using it.

Solution 1

pshell

login

sean

????

delegate

exit

pshell whoami

Exercise - script a task to download a file in your directory.

Solution 2

pshell -i script1.txt

With the plain text file script1.txt created containing:

cd Demo/sean
get testfile1

Exercise - bash script a task that attempts to perform something illegal (eg remove directory www) and correctly report that the script encountered an error

Solution 3

Run the following script if you have bash ... sorry Windows users.

#!/bin/bash

pshell "rmdir /idontexist"
if [$? -ne 0]
   echo "Operation failed!"
else
   eco "All good - proceed further!"

This would typically be a job script on (eg) Pawsey HPC - where you would be doing all such work in a Linux environment.

The idea is that if something in your data setup pipeline fails - don't waste any valuable cpu time on it.