cuDNN with Caffe on the Jetson TK1

I have been running Caffe on the TK1 and I have noticed that I get hardly any improvement in performance with the forward or backward pass times when linking to cuDNN v2. The improvement is around a factor 1.05x better than without cuDNN. Is this to be expected for cuDNN on the TK1 ? Has anyone seen better acceleration ?