Ornith-1.0-397B Released – Has Anyone Tested It Yet or Found the Best Inference Settings?

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10
15

I don’t know if it was available at the time, but there’s an official FP8 version that’s < 40GB, is it worth trying to go smaller?

I’m currently running some benchmarks on it to compare to others on GitHub - DanTup/spark-evals: Some benchmark results of small models and quants that fit on DGX Spark · GitHub

Edit: I misread, this thread is about the big version not 35B… I was reading two threads about this at the same time 😄