I try to implement the batch normalization layer using tensorrt IElementWiseLayer. But I found out IElementWiseLayer has no square root operation in it. As we know , the batch norm layer contain a sqrt. How can I implement it? Is there any other API for sqrt ?
Square root operation support is part of IUnaryLayer layer (UnaryOperation). Please refer below link for more details:
Also, BatchNormalization operation is already supported in Caffe and ONNX layer. You can also use caffe and ONNX parser for your model optimization.