I’m trying to use cudnnRNNForwardInference() for LSTM network inference.
It appears cudnnRNNMode_t = CUDNN_LSTM supports only LSTM w/o peephole connections.
In that, I have few questions below.
Q1: Are there ways to massage LSTM network with peephole connections in this CUDNN_LSTM mode? Any workarounds?
Q2: How would you handle LSTM with a recurrent projection layer + optional non-recurrent projection layer?
Best regards, Hak