I am adding a bias term after convolution. My bias has a tensor descriptor that is defined as:
cudnnCreateTensor4dDescriptor(&bias_descriptor);
cudnnSetTensor4dDescriptor(bias_descriptor, CUDNN_TENSOR_NCHW, CUDNN_DATA_FLOAT, 1, number_of_filters, 1, 1);
Am i defining my (Tensor)bias descriptor correctly?
After convolution forward i add this bias to the result like this:
float h_alpha = 1.0;
cudnnAddTensor4d(handle, CUDNN_ADD_SAME_C, &h_alpha, bias_descriptor, d_bias, top_descriptor, d_top);
Am i adding the (Tensor)bias to my output correctly?