Firmware updates like they rolled out when the Grace Hopper first launched with thermal throttling problems, they had compounded improvements rolled out through firmware over the first 4 months. Here’s to hoping by the next few months we’ll see some improvement.
It is very stable so far, and I’m seeing massive improvements in model loading speeds with mmap off (like 5x or more!), but mmap performance is still mediocre.
It’s not officially released by NVidia yet, so if you want to try this new kernel, you have to compile it from the source. So, unless you are an experienced Linux user, I would not recommend doing this.
1 Like
I’m by no means an expert in Linux and while I’d like to think my Agents are, they sometimes are not :)
So I’ll wait till it’s stable enough for us to adopt, thank you for sharing some of the efficiencies to expect!
My 40Gbps UGREEN arrived this morning and now it’s reading the right average read/write rates.
and accurately on my ports:
/: Bus 001.Port 001: Dev 001, Class=root_hub, Driver=xhci-hcd/1p, 480M
/: Bus 002.Port 001: Dev 001, Class=root_hub, Driver=xhci-hcd/1p, 20000M/x2
|__ Port 001: Dev 007, If 0, Class=Mass Storage, Driver=uas, 20000M/x2
Interestingly enough although it’s the same brand and the same SSD this time I’m not seeing the name spelled out under disk or Device @Neurfer I wonder if it’s the JL chip that allowed the previous read out, regardless it was the wrong fit for my needs.
