@coder543 Unfortunately, I’m now getting persistent crashes trying to get the baseline numbers. I’m having the same issue that was reported on the PR, but it was working for a while.
@verdverm Yes 2-3 has seemed generally recommended for Qwen3.6, but I think the key is the new ability to specify min-p for the draft (--spec-draft-p-min 0.75) which boosts the acceptance at the higher draft tokens up to 7. I use Qwen for coding and I do prefer the MoE, but the MTP benefit for the dense model does seem appealing. I think 30 tk/s is usable, but llama.cpp doesn’t handle concurrency as well as vLLM.