Weird issues with the Realtek r8127 10gb controller

This is a bit of an odd one, and I am not entirely sure why this happens.
I have an asus GX10, although I am pretty sure all the GB10 variants use the same realtek 10gb nic. I have a random issue where when downloading larger containers or model files it takes down my router. I have a unifi UDM pro / USW 10g switch. I bought a handful of sfp+ adapters thinking the issue was maybe the switch liking the 10g adapters. I had this issue on the wan side, but seemed to be fine using the gtek sfp+ adapters. I also tried moving it to a unifi 2.5gb switch I have thinking maybe that would help, but it tends to do the same thing. Its also really random and I have yet to catch an error on the UDM. It just locks up and I have to power cycle it to get routing back.

I did some more digging and found that the realtek nic has some known issues with the hardware acceleration ingress / egress making too many requests and flooding upstream devices. I disabled all of the hardware acceleration on the NIC, but still when the stars align and I decide to download a model it tanks the whole network. Its not even every time it just seems to decide when it wants to tank the network. I did not have this issue before adding the gx10 into the mix so I am pretty sure its the one up to something odd.

This is mostly a uhh has anyone else had this issue or do I have my own shade of crazy going on.