Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt

Python is a very popular programming language and has successfully found its way into many application areas including data science, machine learning, and scientific computing.

...

Column

Anchor
Top of Page
Top of Page

Panel
titleOn this page:

Table of Contents
maxLevel3


Python can be used in many different ways in scientific computing, depending on the features of the researcher workflows. As a result, Pawsey provides different options to use and expand Python capabilities on the Setonix supercomputer and the other systems. 

How to use Python at Pawsey

Python is currently installed on Pawsey systems, in the form of software modules.

Warning
titleDo NOT use system Python

Upon login, you may notice that the following commands are already available: python , python2 , python3. These are Python interpreters installed by the system Operating System for its own purposes. They are old versions with limited functionalities.

Do NOT use them for your scientific workflows.


Info
titleCray Python is not recommended

The Setonix supercomputer also comes with a vendor-provided cray-python module. Some of the packages included in this module are quite old, therefore at this stage we recommend not to use it, and use instead the Pawsey-provided modules (see below).


Tip
titlePawsey Software Stack Python is the recommended option

Pawsey provides Python as part of the Pawsey Software Stack. This software stack contains a couple of Python installations that can be used by loading the specific module, as described in the following sections.

Bare Python module

A module with the basic Python interpreter is available on all Pawsey systems. Available versions can be checked via the module avail python command. And they can be used by loading the desired version. For example:

$ module load python/3.9.7

...

When any of these modules are loaded, its dependencies, including the Python interpreter, will also be loaded. When launched, the interpreter will be able to import the loaded scientific packages.

Single collection of scientific Python packages

On the Setonix supercomputer, all of the above Python packages for scientific computing are also available as a single module, hpc-python-collection, so that one single load will make all of them available:

$ module load hpc-python-collection/2022.05-py3.9.7

Such collection module can be useful for researchers that need to use a large set of the above packages, to reduce the amount of required module loads. Information on the included packages and versions can be found using module whatis :

...

width900px

...

languagebash
themeDJango
titleTerminal 2. Information on the Python collection module

...

packages

...

.

...

Containers with set of scientific Python packages

...