2.1 Parallel Computing Concepts
Source repo: sdsc-summer-institute-2024 | Branch:
main| Last synced: 2026-04-24 10:27:17.425 UTC
SDSC Summer Institute 2024
Session 2.1 Parallel Computing Concepts
Date: Monday, August 5, 2024
Summary: Advanced cyberinfrastructure users, whether they develop their own software or run 3rd party applications, should understand fundamental parallel computing concepts. Here we cover supercomputer architectures, the differences between threads and processes, implementations of parallelism (e.g., OpenMP and MPI), strong and weak scaling, limitations on scalability (Amdahl’s and Gustafson’s Laws) and benchmarking. We also discuss how to choose the appropriate number of cores, nodes or GPUs when running your applications and, when appropriate, the best balance between threads and processes. This session does not assume any programming experience.
Presented by: Robert Sinkovits (sinkovit @sdsc.edu)
Reading and Presentations:
- Source Code/Examples:
- Lastest version at https://github.com/sdsc-complecs/Parallel-computing-concepts