instanttensor broke gemma4-26b-a3b-it as far as i found,
safetensors makes it usable and after 2 days I can say it for sure.
But… it’s slower!
Latest vLLM bundled with eugr spark-vllm-docker in almost 75% slower.
I’m not sure which version I used before the pull I did 3 days ago.
I think it was vLLM 0.19.1rc0 + mod gemma4 and was a lot faster.
I would like to revert to it cause it worked better.
8/10 concurrent request (3-5k tokens) was insanely faster than “today”.
Grafana shows the previous version had a 3x aggregte troughput.
Is there a way to build an old commit afte pulling it?
As far as I undestand the flow in build-*.sh, the compiled wheels are downloaded from an “untracked” url; they are not part of the commit.
If I try to rebuild using paramether -vllm-ref v0.19.1rc0 I suspect I will get error cause Dockerfile whill not match the wheels downloaded.
Are my assumption wrong?
I would like to do some test but I cannot “stop” the current unit to make some test.
Do some of you know if is possible to get/build/use an old commit and go back in time?