6.1 Python For HPC

Source repo: sdsc-summer-institute-2025 | Branch: main | Last synced: 2026-04-24 10:27:17.425 UTC

SDSC Summer Institute 2025

Session 6.1 Python for HPC

Date: Friday, August 8

Summary: In this session we will introduce 2 key technologies in the Python ecosystem that provide significant benefits for scientific applications run in supercomputing environments. Previous Python experience is recommended but not required.

• (1) First, we will learn how to speed up Python code compiling it on-the-fly with numba
• (2) Then we will introduce the threads, processes and the Global Interpreter lock and we will leverage first numba then dask to use all available cores on a machine
• (3) Finally we will distribute computations across multiple nodes launching dask workers on a separate Expanse job.

Presented by: Andrea Zonca

Reading and Presentations:

• Lecture material:
  • Introductory Slides on Google Docs
• Source Code/Examples: See all the files in this folder and subfolders