CIML Summer Institute: Accounts, Login, Environments, Running Jobs, Logging into Expanse User Portal

Session: 1.2_accounts_login_environments_running_jobs_expanse_portal

Date: Tuesday, June 17, 2025

Presented by: Mary Thomas ( mpthomas @ ucsd.edu )

Title: Expanse Webinar: Accessing and Running Jobs on Expanse

Reading and Presentations:

• Lecture material:

  • Presentation Slides: Access, accounts, modules & Envs

    https://github.com/ciml-org/ciml-summer-institute-2025/blob/main/1.2_accounts_login_environment_expanse_portal/MThomas-CIML-SI25_Jun_17_2025-PrepDay_accts_login_envs_jobs.pdf
    

  • Source Code/Examples:

    https://github.com/sdsc-hpc-training-org/hpctr-examples
    

• Exercises:

  • Exercise 1: Log onto Expanse Use your training account and password to log on, find out what project you are on, and list out your module environment.

    quantum:ciml accountname$ ssh -Y train111@login.expanse.sdsc.edu
    (train111@login.expanse.sdsc.edu) Password: 
     Welcome to Bright release         9.0
                                                        Based on Rocky Linux 8
                                                                   ID: #000002
    --------------------------------------------------------------------------------
                                WELCOME TO
                 _______  __ ____  ___    _   _______ ______
                / ____/ |/ // __ \/   |  / | / / ___// ____/
               / __/  |   // /_/ / /| | /  |/ /\__ \/ __/
              / /___ /   |/ ____/ ___ |/ /|  /___/ / /___
             /_____//_/|_/_/   /_/  |_/_/ |_//____/_____/
    --------------------------------------------------------------------------------
    Use the following commands to adjust your environment:
    'module avail'            - show available modules
    'module add <module>'     - adds a module to your environment for this session
    'module initadd <module>' - configure module to be loaded at every login
    -------------------------------------------------------------------------------
    Last login: Mon Jun 17 19:18:38 2024 from 75.80.45.222
    connect /private/tmp/com.apple.launchd.HbagVgBfXZ/org.xquartz:0: Connection refused
    [train111@login02 ~]$ 
    

  • Exercise 2: Clone the HPC Training GitHub Repo:

    [train111@login02 ~]$ git clone https://github.com/sdsc-hpc-training-org/hpctr-examples.git
    Cloning into 'hpctr-examples'...
    remote: Enumerating objects: 485, done.
    remote: Counting objects: 100% (485/485), done.
    remote: Compressing objects: 100% (318/318), done.
    remote: Total 485 (delta 212), reused 421 (delta 158), pack-reused 0
    Receiving objects: 100% (485/485), 27.65 MiB | 27.87 MiB/s, done.
    Resolving deltas: 100% (212/212), done.
    Updating files: 100% (304/304), done.
    [train111@login02 ~]$ ll hpctr-examples/
    total 214
    drwxr-xr-x 15 train111 gue998    19 Jun 17 22:35 .
    drwxr-x--- 10 train111 gue998    20 Jun 17 22:35 ..
    drwxr-xr-x  9 train111 gue998    10 Jun 17 22:35 basic_par
    drwxr-xr-x  2 train111 gue998     6 Jun 17 22:35 calc-pi
    drwxr-xr-x  2 train111 gue998     5 Jun 17 22:35 calc-prime
    drwxr-xr-x  6 train111 gue998     7 Jun 17 22:35 cuda
    drwxr-xr-x  2 train111 gue998     5 Jun 17 22:35 env_info
    -rw-r--r--  1 train111 gue998  5772 Jun 17 22:35 file-tree.txt
    drwxr-xr-x  8 train111 gue998    13 Jun 17 22:35 .git
    [snip]
    drwxr-xr-x  2 train111 gue998    21 Jun 17 22:35 mpi
    drwxr-xr-x  2 train111 gue998     3 Jun 17 22:35 netcdf
    drwxr-xr-x  2 train111 gue998    17 Jun 17 22:35 openacc
    drwxr-xr-x  2 train111 gue998     8 Jun 17 22:35 openmp
    -rw-r--r--  1 train111 gue998  5772 Jun 17 22:35 README.md
    [train111@login02 ~]$ 
    

  • Exercise 3: create an interactive CPU node The following example will request one regular compute node, 4 cores, in the debug partition for 30 minutes.

     [train111@exp-9-55 ~]$ hostname
     login02
     [train111@login02 ~]$ srun --partition=debug  --pty --account=gue998 --nodes=1 --ntasks-per-node=4 --mem=8G
       -t 00:30:00 --wait=0 --export=ALL /bin/bash
     srun: job 31426273 queued and waiting for resources
     srun: job 31426273 has been allocated resources
     [train111@exp-9-55 ~]$ hostname
     exp-9-55
     [train111@exp-9-55 ~]$ exit
      [train111@login02 ~]$
    

  • Exercise 4: create an interactive GPU node The following example will request a GPU node, 10 cores, 1 GPU and 96G in the debug partition for 30 minutes. To ensure the GPU environment is properly loaded, please be sure run both the module purge and module restore commands.

      [train111@login02 ~]$ hostname
     login02
     login02$ srun --partition=gpu-debug --pty --account=gue998 --ntasks-per-node=10 
      --nodes=1 --mem=96G --gpus=1 -t 00:30:00 --wait=0 --export=ALL /bin/bash
    

  • Exercise 5: compile the MPI Hello World code.

    cd hpctr-examples/mpi 
    [train111@login02 mpi]$ module purge
    [train111@login02 mpi]$ module load slurm
    [train111@login02 mpi]$ module load cpu/0.15.4  
    [train111@login02 mpi]$ module load gcc/10.2.0
    [train111@login02 mpi]$ module load openmpi/4.0.4
    [train111@login02 mpi]$ mpif90 -o hello_mpi hello_mpi.f90
    [train111@login02 mpi]$ 
    [train111@login02 mpi]$ mpicc -o mpi_hello mpi_hello.c
    [train111@login02 mpi]$ ll mpi_hello
    -rwxr-xr-x 1 train111 gue998 18120 Jun 17 23:22 mpi_hello
    

  • Exercise 6: Log onto the Expanse User Portal: Use your training account and password

      https://portal.expanse.sdsc.edu/training
    

    Back to Top