Hi everyone,
It looks like the issue that prevented Claude Code >= 2.1.154 from working with vLLM has been fixed in PR #44283 and merged into v0.23.0.
I haven’t been able to test it yet. If anyone has already tried it, I’d love to hear how it went.
Yes, that should be fixed. We try to stay on top of these things on the vLLM side. While some of our maintainers follow these forums, not everyone does, so please escalate via GitHub issues or drop a note in a relevant vLLM slack channel and ping me (bbrowning) or others for this type of breakage. Don’t abuse it for random things, but if anyone breaks like this we can always expedite fixes.
I tested this using eugr/spark-vllm-docker running vLLM v0.23.0.
./build-and-copy.sh -c --copy-parallel -t vllm-node-0230 --vllm-ref v0.23.0
I can confirm that the issue has been resolved: Claude Code >= 2.1.154 no longer breaks and works as expected.