SDSC Expanse Notebook: Data_Analysis

This README file provides instructions for Expanse users to run data analyis notebooks. The notebook covers pandas, a useful Python data analysis toolkit. We will look at two pandas objects: Series and DataFrame (1D and 2D data structures).

Keep in mind the added files:
• city temps spreadsheet.xlsx
• city temps.csv
• olympics.csv
These contain the necessary data for the notebook to run.
Listof Content

• Import Module
• Launch Galyleo
• Environment Modules
• Install Modules
• Location
• Sources
• Submit Ticket

Import Module:

• numpy
• pandas

Launch Galyleo

For specific information about launching Galyleo, please refer to this GitHub repository.

Environment Modules

By utilizing --env-modules, we can load any software installed in Expanse.

This command line loads GPU modules and Anaconda3 in the Jupyter session to run in a GPU environment.

• GPU: --env-modules gpu/0.17.3b,anaconda3/2021.05

  galyleo launch --account abc123 —partition gpu-shared --cpus 10 --memory 92 --gpus 1 --time-limit 00:30:00  --env-modules  gpu/0.17.3b,anaconda3/2021.05 --bind /oasis,/scratch --nv
  

  Install Modules

  To run data_analysis_pandas notebook, we do not need to install additional packages.

Location

Data_Analysis
├──data_analysis_cupy.ipynb
├── README.md

Sources

More info on pandas, including a detailed API: https://pandas.pydata.org/

Submit Ticket

If you find anything that needs to be changed, edited, or if you would like to provide feedback or contribute to the notebook, please submit a ticket by contacting us at:

Email: consult@sdsc.edu

We appreciate your input and will review your suggestions promptly!