Versions Compared

Old Version 2

changes.mady.by.user Luke Edwards

Saved on

compared with

New Version Current

changes.mady.by.user Luke Edwards

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Overview

...

Image Added

What will you learn?

• How to upload, download and manage data
•Inspect • How to inspect metadata/project overview info
•Do • How to do simple searches
•Create • How to create private and public links to share data

Lets get Started 

We have a website interface to our data storage system.  This is intended as a light weight interface for small scale data management work.

Load the website at https://data.pawsey.org.au (we recommend you use Chrome in this training).

Login with your provided authentication details.  Contact a trainer if something goes wrong.


Exercises

Exercise 1 - Navigate and inspect data with Data Portal

...

  • login to the Data Portal,
  • navigate Data portal 
  • search for files (including wild card search)
  • discover allocation size


iblis:~> python pshell Reading defaults from bundle... === pshell: type 'help' for a list of commands === pawsey:/projects>whoami actor = delegate role = Data Team:readonly role = Demo:readwrite role = ivec pawsey:/projects>pwd Remote: /projects pawsey:/projects>lpwd Local: /Users/sean pawsey:/projects>ls 2 items, 29 items per page, remote folder: /projects [Folder] Data Team [Folder] Demo
Expand
titleSolution 1a
Code Block
1
  • login with your authentication details
  • Navigate the portal

Image Added

  • Search for files

Image Added


  • Find allocation size...how much storage does my project have?

Image Added


Exercise 2 - Upload and download using Data Portal

Perform the following:

  • select Upload a file to uploaddownload datayour project.
  • Download a file from your project,


whoami pwd ls
Expand
titleSolution 1
Code Block
2
  • Upload a file to your project.

You can either drag and drop a file to your browser window, with the target folder selected. Alternatively, use the upload button

Image Added

Observe the upload detail pane...click on Uploads. Have a look at the activity log button...

Image Added

  • download a file from your project,

Image Added

Exercise 3 -

...

Managing data with

...

Data Portal 

Perform the following:
  • Make a file public
  • Make a folder
  • Move file 
  • Move folder


pawsey:/projects>cd Data Team/ Remote: /projects/Data Team pawsey:/projects/Data Team>get testfiles Total files=31, transferring ... Progress=100%, rate=0.5 MB/s Completed. pawsey:/projects/Data Team>lls testfiles Local folder: /Users/sean/testfiles 17.02 KB | i000765.jpg 17.59 KB | i000766.jpg 17.21 KB | i000767.jpg 19.09 KB | i000768.jpg etc
Expand
titleSolution 2
Code Block
3
  • Make a file public and private

Image Added

  • Make a folder

Image Added

  • Moving file and folders

Image Added

Navigate to the destination and click "Move to Here". This will work with Folders.