Skip to main content
Context Awesome

awesome-institutional-hpc

github.com/frankier/awesome-institutional-hpc ↗

List of tools you can use to get the most from your institutional HPC resources

4
GitHub Stars
31
Curated Resources
7
Categories
21 hours ago
Last Refreshed
Tools provided for youGuidesContainersWorkflow managers and distributed computing frameworksSLURM wrappers and librariesNetworkingFancy shell sessions

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me guides resources from awesome-institutional-hpc"

Installation instructions →

What's inside

Containers

  • Apptainer

    Container runtime which must be installed by your cluster administrator. It can run converted OCI (Docker compatible) images.

  • singreqrun

    Shim to allow running programs from the host from within a Singularity container.

  • udocker

    Docker compatible CLI, which does not require action from your cluster administrator, but can use Apptainer/Singularity as a backend if it's available.

Workflow managers and distributed computing frameworks

Fancy shell sessions

  • EternalTerminal

    Another approach to drop free SSH sessions

  • Euporie

    Jupyter notebooks in the terminal including support for image display with kitty

  • kitty

    Terminal supporting image display

  • mosh

    Drop free, low latency faked SSH sessions

  • tmux

    Terminal multiplexers, which allow running multiple sessions and detatching and reattaching to terminal sessions

  • xxh

    Bring your own shell and config to shared computing environments

SLURM wrappers and libraries

  • lazyslurm

    Intuitive terminal UI for managing slurm jobs.

  • pyslurm

    Python library for interfacing with SLURM.

  • SEML

    Slurm Experiment Management Library (SEML). Integration of the sacred experiment manager and SLURM.

  • slurmpy

    Small Python library for starting SLURM jobs.

  • stubl

    Utilities for SLURM including wrappers for job launching and reporting.

  • yaspi

    A Python-based SLURM wrapper based on job arrays.

Tools provided for you

  • lmod

    A tool allows you to load additional software packaged as modules. Just run

  • SLURM

    A job scheduler for HPC clusters which includes CLI programs you will run to interact with it.

Networking

  • lsyncd

    A program to sync your files to a remote server, e.g. a HPC login node. This allows a workflow where you can develop and run smoke tests locally, and then seemlessly switch to HPC for full runs.

  • sshuttle

    This program can help if you need to connect from outside of campus and the VPN doesn't get you where you want.

Showing a sample of 31 resources. View the full list on GitHub →