Performance issue 960 GTX

I am experiencing fps degrade overtime while playing games on linux. The games launch fine but I lose fps after certain events in game i.e. opening inventory menu in the outer worlds and dying 5 or more times in darksouls 3. The performance degrades each time these events happen and does not recover, causing the frame rate to come from near 60 fps to 13 fps or lower. This makes the game unplayable. This might be a driver issue can you please fix this issue. I noticed this issue after upgrading my driver from 390.

My specs
elementary os hera
gtx 960 2gb (driver 455.28)
16 gb ram
i5 4690k