I have had problems utilizing all four GPUs on my computer for Keras and TensorFlow multi GPU training.
They train my neural network, but it’s slower than when using only one GPU.
I tried to get help here, but we didn’t solve the problem:
The conclusion was that this is likely a setup/driver issue.
Does anyone have any idea what’s going on, or where to start to fix this?
- Ubuntu 16.04
- TensorFlow 1.4.0
- Keras 2.1.5
- CUDA Version 8.0.61
- cuDNN 6.0.21