Hi, I encountered inference error using deepstream, so I am debugging th nvinfer plugin. When I read the nvdsinfer source code, I found there is a void pointer sends to the enqueueV2 function(Code is attached below) m_Context->enqueueV2(bindingBuffers.data(), stream, (consumeEvent ? &consumeEvent->ptr() : nullptr)) I think this should be the data finally sends to the tensorrt for inference. So I want to dump this data to a txt file to see what the final data is like, but I dont know how to do this. Could anyone could give me some hints? NvDsInferStatus FullDimTrtBackendContext::enqueueBuffer( const std::shared_ptr & buffer, CudaStream& stream, CudaEvent* consumeEvent) { assert(m_Context); assert(stream.ptr()); std::vector bindingBuffers = buffer->getDeviceBuffers(); for (int iL = 0; iL getBatchDims(iL); assert(batchDims.batchSize == buffer->getBatchDims(0).batchSize); //fix for onnx model which has fixed input dimensions if(batchDims.batchSize < m_AllLayers[iL].profileDims[kSELECTOR_MIN].batchSize) batchDims.batchSize = m_AllLayers[iL].profileDims[kSELECTOR_MIN].batchSize; if (!canSupportBatchDims(iL, batchDims)) { dsInferError( "Failed to enqueue buffer in fulldims mode because " "binding idx: %d with batchDims: %s is not supported ", iL, safeStr(batchDims2Str(batchDims))); return NVDSINFER_INVALID_PARAMS; } nvinfer1::Dims dimsWBatch = CombineDimsBatch(batchDims.dims, batchDims.batchSize); nvinfer1::Dims lastDimsBatch = m_Context->getBindingDimensions(iL); if (dimsWBatch != lastDimsBatch) { if (!m_Context->setBindingDimensions(iL, dimsWBatch)) { dsInferError( "Failed to enqueue buffer when setting bindings idx:%d with " "dims:%s", iL, safeStr(dims2Str(dimsWBatch))); return NVDSINFER_INVALID_PARAMS; } } } if (!m_Context->allInputDimensionsSpecified()) { dsInferError( "Failed to enqueue buffer because context dims are not specified " "in dynamic mode"); return NVDSINFER_TENSORRT_ERROR; } if (!m_Context->enqueueV2(bindingBuffers.data(), stream, (consumeEvent ? &consumeEvent->ptr() : nullptr))) { dsInferError("Failed to enqueue trt inference batch"); return NVDSINFER_TENSORRT_ERROR; } return NVDSINFER_SUCCESS; } Here is my full system configuration: Hardware Platform (Jetson / GPU) : Xavier NX DeepStream Version : 5.0 JetPack Version (valid for Jetson only) : 4.4 TensorRT Version : 7.1.3

How could I save buffer data from nvdsinfer

Fiona.Chen July 1, 2021, 1:44am 3

Topic		Replies	Views
How to get raw output of nvinfer ? DeepStream SDK	6	2669	June 19, 2019
Package the tensorRT inference results into GstBuffer and push them to the downstream DeepStream SDK	6	1494	October 17, 2022
NvDsInferLayerInfo buffer pointer cannot be mapped to GstBuffer DeepStream SDK	13	1098	September 16, 2020
How to read infer raw output? DeepStream SDK	1	1246	May 20, 2019
Frame pointer DeepStream SDK	9	1177	October 19, 2020
Wrong / Missing output from Gst-nvinfer plugin DeepStream SDK tensorrt , deepstream	8	342	January 23, 2025
Read the buffer data recuperated from NvDsInferLayerInfo (in Python) DeepStream SDK	6	1215	December 31, 2020
How to get input (and output) of model inside nvinfer in Python - Correct way to probe nvinfer? DeepStream SDK python , deepstream	15	1750	February 6, 2024
Acquire NvDsInferLayerInfo output DeepStream SDK gstreamer	5	1115	February 2, 2021
NvDsInferLayerInfo.buffer and NvDsInferTensorMeta.out_buf_ptrs_host (and out_buf_ptrs_dev) are consistently NULL DeepStream SDK deepstream	2	190	July 31, 2025