Hi, I have been a researcher in AI for 20+ years but I have not used Tensorflow. (AI frameworks were not available at my time.) I am going to learn some DL stuffs and do some work in this area. Maybe later I will buy RTX Titan but not in the next three months. Could you please let me know the following?
Given a model and if I want to see how it behaves under different initial parameters, will there be a problem if my desktop has two GPU of different kinds (e.g. one GTX 1060 and one RTS 2080/2080Ti or RTS Titan)?
Am I correct that only when I do parallel training of the same network with the same set of initial parameters will I need to have GPU of the same model?
Those 20x0 cards have Tensor Cores in addition to CUDA Cores. Are Tensor Cores helpful in speeding up the training in Tensorflow? What else is it good to buy RTX card now rather than GTX card?