Training a deep learning model on different machine

Is there any way to train a deep learning model on multiple machines in a premise each having single or multiple GPU? Since I have a PC with 2GB GPU only, I need the above-mentioned method to train my model.