...
...
...
...
| Info |
|---|
Setonix will experience downtime in the beginning of January 2023 while final acceptance testing is carried out |
Most important changes
- Submissions From 2023 allocation round, submissions to NCMAS and Pawsey Partner Schemes can now include Setonix CPU and Setonix GPU requests.
- Minimum allocation request size is now 1M Service Units.
- New accounting Accounting model for Setonix now includes Service Units definition for both Setonix CPU and GPU partitions.
- There will be is no Pawsey Partner top-up allocations starting from 2023 allocation round. Researchers can apply to both NCMAS and Pawsey Partner Scheme subject to the eligibility and conditions of these schemes.
- Pawsey has improved technical review process, scalability criteria is now covering both CPU and GPU parallel scalability as well as data workflows scalability.
- The new Preparatory Access Scheme is is now available for researchers who need to port and benchmark their codes and workflows before applying to one of the merit allocation schemes.
...
| Column | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Available resources for
...
2024 allocations (Pawsey Supercomputing Centre)
Single application to National Computational Merit Allocation Scheme (NCMAS) and Pawsey Partner Merit Allocation Scheme schemes can now include Setonix-CPU and Setonix-GPU requests. Researchers can apply only for Setonix-CPU allocation, only for Setonix-GPU allocation or for both.
...
| Column | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||
The Accounting Model
With Setonix, Pawsey is moving from an exclusive node usage to a proportional node usage accounting model. While the Service Unit (SU) is still mapped to the hourly usage of CPU cores, users are not charged for whole nodes irrespective of whether they are been fully utilised. With the proportional node usage accounting model, users are charged only for the portion of a node they requested.
Each CPU compute node of Setonix can run multiple jobs in parallel, submitted by a single user or many users, from any project. Sometimes this configuration is called shared access.
A project that has entirely consumed its service units (SUs) for a given quarter of the year will run its jobs in low priority mode, called extra, for that time period. Furthermore, if its service unit consumption for that same quarter hits the 150% usage mark, users of that project will not be able to run any more jobs for that quarter.
Pawsey accounting model bases the GPU charging rate on energy consumption. Such approach, designed for Setonix, has a lot of advantages compared to other models, introducing carbon footprint as a primary driver in determining the allocation of computational workflow on heterogeneous resources.
Pawsey and NCI centres are using slightly different accounting models. Researchers applying for allocations on Setonix and Gadi should refer to Table 2 when calculating their allocation requests.
| Column | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
* calculated based on https://opus.nci.org.au/display/Help/2.2+Job+Cost+Examples for gpuvolta queue | ||||||||||||||||||||
| Info | ||
|---|---|---|
| ||
Researchers planning their migration from NVIDIA-based GPU systems like Pawsey’s Topaz and NCI’s Gadi to AMD-based Setonix-GPU should use the following example strategy to calculate their Service Units request.
Please see: https://www.amd.com/en/graphics/server-accelerators-benchmarks |
| Info | ||
|---|---|---|
| ||
The Setonix’s AMD MI250X GPUs have a very specific migration pathway related to CUDA to HIP and OpenACC to OpenMP conversions. Pawsey is working closely with research groups within PaCER project (https://pawsey.org.au/pacer/) and with vendors to further extend the list of supported codes. Please see: https://www.amd.com/en/technologies/infinity-hub |