3050Ti ubuntu5.15 with nvidiadriver550 randomly freezes

I have a 3050ti ubuntu5.15.0-102-generic, I just updated to cuda12.4 nvidia-driver550 , now whenever I plug out my charge, the TGP comes to 10W and after I replug in, the system automatically freezes with no mouse and keyboard.
The system also randomly freezes even when I dont plug in. Also, I sometimes get a 20-40%usage of gpu from nvidia-smi even when I dont launch any program