Source repo: ciml-summer-institute-2024 | Branch:
main| Last synced: 2026-04-24 10:27:17.425 UTC
Session 2.4 Data Management and File Systems
Date: Tuesday, June 25, 2024
Summary: Managing data efficiently on a supercomputer is important from both users' and system's perspectives. We will cover a few basic data management techniques and I/O best practices in the context of the Expanse system at SDSC.
Presented by: Marty Kandes (mkandes @ucsd.edu)
Reading and Presentations:
- Lecture material:
- https://education.sdsc.edu/training/interactive/?id=202406-Data-Transfer
- https://github.com/sdsc/sdsc-summer-institute-2023/tree/main/3.2_data_management
- https://github.com/sdsc/sdsc-summer-institute-2022/tree/main/2.5_data_management
- https://education.sdsc.edu/training/interactive/?id=202303-SDSCWebinar-Data-Management-File-Systems
- https://zenodo.org/records/10794824
- Source Code/Examples: N/A