Performance loss after kernel 4.9

OS: Manjaro Linux
GPU: GTX 980 Zotac AMP! Extreme
Driver version: 396.24

During my tests, I noticed a huge performance loss if I upgraded to any kernel over 4.9.
I’m unsure of what caused this issue and am looking for ideas on how to find out why this occurs

The kernels are tested by rebooting and selecting the version in grub.

Spectre and Meltdown patches were ported back to 4.9 since it’s a LTS release so I don’t think they might be entirely at fault

Performance loss depends on the game and the max framerate attained. On Dota2 for example I can get as much as 100fps below from 244ish. While in another game that runs at 70fps I can get 10 fps lower