Hi everyone,
I’m a Game Producer planning to implement a private, locally hosted AI coding system for our game development company.
Our requirements:
- 4 developers working simultaneously on 4 different Unity game projects.
- Each developer uses an AI coding agent through VS Code or Rider.
- One central DGX Spark (128 GB) hosting an open-source coding model.
- Each developer needs independent context and access to their own project codebase.
- AI should be capable of generating C# scripts, debugging, refactoring, understanding project architecture and assisting with development.
- We may implement RAG and fine-tuning later.
I’d appreciate advice on the following:
- Can a single DGX Spark realistically serve 4 simultaneous AI coding agents?
- Which open-source coding model offers the best balance of performance and code quality on DGX Spark?
- What tokens-per-second performance should we expect per developer under concurrent load?
- What context window can we practically allocate to each developer (32K, 64K or higher)?
- How much unified memory will the model and 4 concurrent KV caches consume?
- Would you recommend Ollama, vLLM, llama.cpp or NVIDIA NIM for inference?
- What’s the best architecture for connecting 4 development PCs to one AI server while keeping projects isolated?
- Should we use RAG for Unity project knowledge or consider fine-tuning?
- Is a single DGX Spark sufficient, or would a different GPU server be better for this workload?
- Is there a cloud GPU environment where we can benchmark this setup before purchasing hardware?
Our goal is to build a reliable internal AI coding assistant that can help four developers work independently on different games.
I’d especially appreciate real-world benchmarks, recommended configurations and feedback from anyone running multiple coding agents on a DGX Spark.
Thanks!