The gst-nvinfer is open source. The code is under /opt/nvidia/deepstream/deepstream/sources/gst-plugins/gst-nvinfer
There is a simple introduction of the gst-nvinfer: DeepStream SDK FAQ - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums