Training Roadmaps

These roadmaps provide suggested learning paths for a particular topic. You can follow in sequence or take individual courses as needed.  

To view upcoming training activities, view the Pawsey Events calendar

Is there a roadmap you'd like to see that isn't here? Contact training@pawsey.org.au. 

Allocations

 Click here to expand...

Pawsey Resource

Title Format 

I want to learn more about...

SupercomputingMerit Allocation Training (for Pawsey)

YouTube link 

Recording (1.06  hour/min)

7 Sep 2021

  • Setonix, Acacia and other Pawsey resources, and their impact on my allocation application
  • The changes to the 2021/2022 allocation submission process
  • The allocation timeline, application requirements, and application good practices
Supercomputing(External) NCMAS Call for 2021 Application

Web-based self-study materials 

learning.hpc-australia.org.au

  • General overview/introduction to NCMAS, including process and eligibility
  • NCMAS 2022 Committee (NCMAC)
  • Applicant recommendations
SupercomputingFor additional informationSupercomputing Documentation

Of particular interest for merit allocations on Pawsey resources: 

Migration to Setonix Supercomputing System

 Click here to expand...

Pawsey Resource

Title Format 

I want to learn more about...

SupercomputingSetonix Migration GuideSupercomputing Documentation
  • Changes to and additional features of Setonix, starting from the "knowns" of current systems (Magnus, Zeus, etc.)
  • Assumes familiarity with supercomputers 
SupercomputingSetonix Documentation - Top Level pages and linksSupercomputing Documentation
  • Information for new users (Resources Overview, Access)
  • Conditions of resource use and policies
  • How to work with a supercomputer 
  • Guides to Pawsey supercomputing systems

Supercomputing

01. Getting Started with Setonix

Live, online training

Video recordings 

  • Setonix, in comparison to Pawsey's existing supercomputers
  • The impact to my project from the new Setonix architecture
  • The migration pathways to Setonix and the migration timeframe

Supercomputing

02. Supercomputing Filesystems

Live, online training

Video recordings

  • The file management approaches on Setonix, including management of use and size
  • The file migration pathways and use cases
  • Recommended changes/updates to my data workflow
  • Data security and other data-related best practices
Supercomputing03. Using Modules and Containers

Live, online training

Video recordings

  • Whether and how API libraries and driver changes impact my project
  • The changes to loading modules when using Setonix
  • Deciding when software installations are necessary to migrate to Setonix
  • The programming environments that a module is compatible with
  • The changes to my container use when using Setonix
Supercomputing04. Installing and Maintaining your Software

Live, online training

Video recordings

  • Considerations and best practices to installing and managing my software stack on Setonix
  • The impacts and considerations for my current software stack when migrating to Setonix
  • The software stack development tools, profilers, and debuggers
Supercomputing05. Submitting and Monitoring your Job

Live, online training

Video recordings

  • Key job script changes to best schedule jobs and to best run jobs
  • The tools, software and reports that can help when monitoring and managing a job on Setonix
  • The best practices for scheduling, running and monitoring a job on Setonix
Supercomputing06. Using Data Throughout the Project Lifecycle

Live, online training

Video recordings

  • The importance of managing the entirety of the data lifecycle
  • Which data is to be migrated into the Project Object Storage (Acacia)
  • The data management and storage strategy for workflows on Setonix
  • The data storage considerations and best practices on Setonix
Supercomputing(External) AMD CPU Model Details AMD Epyc 7763 (external link)
  • Information on 3rd Gen AMD EPYC™, which is the CPU model used in Setonix 
SupercomputingROCm Learning from AMDROCm Learning Center (external link)
  • Presentations, videos, documentation and more for developers using ROCm. 
  • ROCm courses on HIP fundamentals, deep learning, and multi-GPU programming. 

Migration to Acacia Storage System

 Click here to expand...

Pawsey Resource

Title

Format

I want to learn more about... 
Storage / Data ManagementIntroducing Acacia Object Storage Service Video Series
  • Object storage concepts, terms and illustrations/examples
  • Object storage in contrast to filesystems
  • Brief introduction to the Acacia Object Storage Service
Storage / Data ManagementAcacia Early Adopters User GuideUser Guide / Documentation
  • Common tasks, such as configuring an S3 client, creating buckets, uploading objects
  • Advanced tasks, such as synchronising data, adding metadata to objects
  • Links to more information, such as Acacia best practices, workflow examples, terms and concepts
Storage / Data Management

Ask.Me.Anything. Pawsey's 130Pb of Multi-tier Storage 


YouTube Link

Recording (55 min)

7 Sep 2021

  • Setonix, Australia's new 50 petaflop system  
  • Banksia, tape library
  • Acacia, scalable online storage for research
  • LUMI object storage from CSC
  • Q&A

Visualisation

 Click here to expand...
Pawsey Resource 

Title

Format

I want to learn more about... 

Visualisation

Introduction to Remote Visualisation

Training Slides

YouTube link 

Recording (52:53 hour:min)

5 Aug 2020

/wiki/spaces/VIS/pages/58303256

  • What is remote visualisation?
  • How do I use the remote visualisation service at Pawsey?
  • How do I access visualisation packages remotely? 
VisualisationParaview Part 1

Training Slides

/wiki/spaces/VIS/pages/58303215

/wiki/spaces/VIS/pages/58303215

  • How do I use ParaView remote visualisation?
  • ParaView basics
  • How do I launch a ParaView client-server?
  • Hands-on examples
Visualisation

ParaView Part 2

Training Slides

/wiki/spaces/VIS/pages/58303215

  • What is ParaView scripting?
  • Hands-on scripting
VisualisationGetting Started with NebulaDocumentation: Nebula Remote Visualisation
  • How do I get access to Nebula?
  • How do I use Nebula remote visualisation?
VisualisationGetting Started with the Pawsey Visualisation LabDocumentation: Visualisation Lab
  • How do I get access to the Pawsey Visualisation Lab?
  • How do I use the Visualisation Lab?