Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


...

Info
titlePrerequisities
  • A recent python 2.7.x flavour (but not 3.x)

...

...

...

  • pshell permission to

...

  • execute (chmod u+x pshell)


Example of pshell running on Magnus

...

  • whoami: reports the current logged in identity
  • file: reports metadata information on a file.  This useful for finding size (bytes) of a file
  • compare:  useful to check on successful transfer from remote to pawsey

Pagination

For file listings that are longer than the terminal height, a pagination control prompt will be displayed with the following options:

Entry

Result

<enter>Display the next page of files
<page number><enter>Display the requested page number
/<pattern>Filter the result on the pattern
qLeave (quit) paginated display mode

Exercises

Exercise 1 - pshell with Pawsey account

Perform the following:

  • run pshell and login to the mediaflux server,
  • query what your logged in identity is,
  • display your current working directory on the server,
  • display your local working directory
  • list the contents of the remote directory on the server.
Expand
titleSolution to exercise 1


Code Block
iblis:~> python pshell
Reading default config from bundle...
 === pshell: type 'help' for a list of commands ===
pawsey:offline>login
Username: sean
Password: 
pawsey:/projects>

pawsey:/projects>whoami
actor = ivec:sean
  role = ivec
  role = user

pawsey:/projects>pwd
Remote: /projects

pawsey:/projects>lpwd
Local: /Users/sean
pawsey:/projects>ls

2 items, 29 items per page, remote folder: /projects
[Folder] DMF-TEST
[Folder] Data Team


Exercise 2 - downloading data


Perform the following:

  • Navigate to the /projects/Data Team folder,
  • download the testfiles folder to your local machine,
  • check the download by listing the files locally.

...

Expand
titleSolution to exercise 2


Code Block
pawsey:/projects>cd Data Team/
Remote: /projects/Data Team
pawsey:/projects/Data Team>get testfiles
Total files=31, transferring ...  
Progress=100%, rate=0.5 MB/s  Completed.

pawsey:/projects/Data Team>lls testfiles
Local folder: /Users/sean/testfiles
 17.02 KB | i000765.jpg
 17.59 KB | i000766.jpg
 17.21 KB | i000767.jpg
 19.09 KB | i000768.jpg
etc


Exercise 3 - uploading data

Perform the following:

  • Navigate to the /projects/Demo folder
  • create a unique new folder (eg your Pawsey account name)
  • change into this unique folder and confirm it is your current working directory
  • upload the files you downloaded in the previous exercise
  • check the upload by listing the remote files.
Expand
titleSolution to exercise 3


Code Block
iblis:~> python pshell
Reading config [/Users/sean/.mf_config]
 === pshell: type 'help' for a list of commands ===
pawsey:/projects>cd Demo/
Remote: /projects/Demo
pawsey:/projects/Demo>mkdir sean
pawsey:/projects/Demo>cd sean
Remote: /projects/Demo/sean
pawsey:/projects/Demo/sean>lcd testfiles
Local: /Users/sean/testfiles
pawsey:/projects/Demo/sean>put *
Total files=31, transferring...  
Progress: 100% at 0.5 MB/s  Completed.

pawsey:/projects/Demo/sean>ls
31 items, 29 items per page, remote folder: /projects/Demo/sean
 69776130   | online  |  17.69 KB | i000771.jpg
 69776131   | online  |  17.02 KB | i000765.jpg
 69776132   | online  |  17.21 KB | i000767.jpg
etc


Exercise 4 - deleting data

Perform the following:

  • Navigate to the folder where you uploaded files in the previous exercise,
  • use a filter to display files with 077 in the filename,
  • delete files that match that pattern.

...