Prerequisites
- A recent python 2.7.x flavour (but not 3.x) e.g. https://conda.io/miniconda.html
- The pawsey command line client pshell (https://bitbucket.org/datapawsey/mfclient/downloads/)
- Grant pshell permission to execute (chmod u+x pshell)
Example of pshell running on Magnus
ssh magnus.pawsey.org.au magnus> module load python/2.7.10 magnus> wget https://bitbucket.org/datapawsey/mfclient/downloads/pshell -O pshell magnus:~> chmod u+x pshell magnus:~> ./pshell === pshell: type 'help' for a list of commands === pawsey:offline>
Pshell is a python command line client that implements a subset of the standard SFTP commands.
- Remote filesystem commands: cd, ls, pwd, mkdir, rmdir
- Local filesystem commands: lcd, lls, lpwd
- Transfer commands: get, put
Type help command to get information on the syntax of each.
Simple wildcards are accepted for file transfers.
There are also a few shell-like commands, such as:
- whoami: reports the current logged in identity
- file: reports metadata information on a file. This useful for finding size (bytes) of a file
- compare: useful to check on successful transfer from remote to pawsey
Pagination
For file listings that are longer than the terminal height, a pagination control prompt will be displayed with the following options:
Entry | Result |
|---|---|
| <enter> | Display the next page of files |
| <page number><enter> | Display the requested page number |
| /<pattern> | Filter the result on the pattern |
| q | Leave (quit) paginated display mode |
Exercises
Exercise 1 - pshell with Pawsey account
Perform the following:
- run pshell and login to the mediaflux server,
- query what your logged in identity is,
- display your current working directory on the server,
- display your local working directory
- list the contents of the remote directory on the server.
Exercise 2 - downloading data
Perform the following:
- Navigate to the /projects/Data Team folder,
- download the testfiles folder to your local machine,
check the download by listing the files locally.
Exercise 3 - uploading data
Perform the following:
- Navigate to the /projects/Demo folder
- create a unique new folder (eg your Pawsey account name)
- change into this unique folder and confirm it is your current working directory
- upload the files you downloaded in the previous exercise
- check the upload by listing the remote files.
Exercise 4 - deleting data
Perform the following:
- Navigate to the folder where you uploaded files in the previous exercise,
- use a filter to display files with 077 in the filename,
- delete files that match that pattern.