You may want to try with the ‘nvvidconv’ plugin which can be used as a replacement with hardware optimization for videoconvert. However, as you are using appsink you may want to check the following topic
For instructions on how to use the nvvidconv with appsink.