Has anyone tried this new Eagle yet?
Introducing EAGLE-4: One Flexible Drafter for All Batch Sizes and Hardware — Eagle Blog
Has anyone tried this new Eagle yet?
Introducing EAGLE-4: One Flexible Drafter for All Batch Sizes and Hardware — Eagle Blog
I did it just now. I used the HP clone of the Spark, identical hardware (HP ZGX Nano - 128-GB GB10 Blackwell).
Used SGLang recompiled myself to use Eagle4 (wasn’t available online, it’s only for x86-64 so far).
I tested it with Qwen 3.8-27B - BF16
speed up of ~4.6x with respect to baseline (plain decoding, no EAGLE-4)
My baseline was at 4.5 tok/s after 1st warm-up run
With EAGLE-4: 20.7 tok/s after 1st warm-up run
I only tested with this test prompt:
“Explain how a hash table works, with a short Python example.”