Sparkrun - central command with tab completion for launching inference on Spark Clusters

sparkrun has been updated. This is a big update (including transition to next minor version, 0.2.x).

First and foremost, this release marks the official transition of sparkrun to being part of the spark-arena organization. The git repo is now at: https://github.com/spark-arena/sparkrun to reflect sparkrun’s position as an effort for the community.

Beyond that, lots of changes:

  • Documentation Revamp
  • Spark Arena Integration (integrated login & benchmarking)
  • Security (work on shell injection protection for recipes; pinning all dependency versions; non-root user and non-privileged containers by default)
  • Fixes for cross-platform cache paths
  • Additional commands to enable automation and external use of sparkrun for orchestration
  • Addition of systemd service export
  • Tighter integration with eugr-vllm-docker
  • Intended to align with new spark-arena images for eugr vllm and llama.cpp (sglang coming soon)
  • Ability to configure transfer interface preferences as part of cluster configuration
  • Lots of bug fixes and internal architecture improvements
  • New setup wizard for better installation/setup experience for new users

I’ll post more shortly about how to get started with some of the new functionality.

6 Likes