Hi,
Could you try to set some limitation on the TensorFlow memory usage to see if helps first?
1. Limit the maximal memory available for TensorFlow
gpu_options = tf.GPUOptions(per_process_gpu_memory_fraction=0.6)
sess = tf.Session(config=tf.ConfigProto(gpu_options=gpu_options))
2. Allow gradually memory allocation
config = tf.ConfigProto()
config.gpu_options.allow_growth=True
sess = tf.Session(config=config)
Thanks.