If you blow away the .lists, then I don’t think you need to install the key ring deb because you’re not even going to be using NVIDIA’s repositories anymore.
So you could just do…
RUN rm /etc/apt/sources.list.d/cuda.list
RUN rm /etc/apt/sources.list.d/nvidia-ml.list
…and that will “fix” the issue.