4.2a Python For HPC

Source repo: sdsc-summer-institute-2023 | Branch: main | Last synced: 2026-04-24 10:27:17.425 UTC

SDSC Summer Institute 2023

Session 4.2a Python for HPC

Date: Wednesday, August 9, 2023

Summary: In this session we will introduce four key technologies in the Python ecosystem that provide significant benefits for scientific applications run in supercomputing environments. Previous Python experience is recommended but not required.

• (1) First, we will learn how to speed up Python code compiling it on-the-fly with numba
• (2) Then we will introduce the threads, processes and the Global Interpreter lock and we will leverage first numba then dask to use all available cores on a machine
• (3) Finally we will distribute computations across multiple nodes launching dask workers on a separate Expanse job.

Presented by: Andrea Zonca

Reading and Presentations:

• Lecture material:
  • Introductory Slides on Google Docs
• Source Code/Examples: See all the files in this folder and subfolders