2080TI performance stability


I bought new 2080TI and tested a few tensorflow models. Based on measurements it looks like that final prediction is very unstable: For single prediction (same model): 100ms - 120ms… this is wide range 20ms. 1080ti seems to be more stable… Any thoughts why? Thank you!

I have noticed that sometimes my weights blowup during training, though I was attributing this to something new with CUDA 10 and not using the official tensorflow (custom build for using CUDA 10).