# \[TensorRT\] ERROR: \[graph.cpp::computeInputExecutionUses::510\]

**URL:** <https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125>\
**Category:** TensorRT\
**Tags:** tensorrt\
**Created:** [May 17, 2021, 7:41am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125 "2021-05-17T07:41:46Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![stefan.podg](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@stefan.podg](https://forums.developer.nvidia.com/u/stefan.podg)\
**Post date:** [May 17, 2021, 7:41am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/1 "2021-05-17T07:41:46Z")

</div>

Full error: [TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)

## Description

This is my first attempt at using TensorRT after running through your brain segmentation demo and I have run head first into an issue.

What I am trying to do is build an engine from a Torchvision Faster-RCNN model which I have converted to an ONNX model.

However, when I try and build the model I receive the following error:

> [TensorRT] ERROR: 4: [network.cpp::validate::2361] Error Code 4: Internal Error (Network must have at least one output)

which I am guessing is caused by:

> [TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)

I have tried to set the output with:

```
last_layer = network.get_layer(network.num_layers - 1)
         # Check if last layer recognizes it's output
         if not last_layer.get_output(0):
             # If not, then mark the output using TensorRT API
             network.mark_output(last_layer.get_output(0))

```

But it did not help.

When I attach a debugger and check the network I have inputs as 2, layers as 60 and outputs as 0. I have tried to set the manually output using “network.mark\_output(last\_layer.get\_output(0))” which then shows the network with an output of 1 but building the engine results in the error codes:

> [TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
> [TensorRT] ERROR: 2: [symbolicDims.h::size::63] Error Code 2: Internal Error (Assertion nbDims \>= 0 failed.)

I am completely at a loss here…

## Environment

**TensorRT Version** : 8.0.0.3  
**GPU Type** : 2080ti  
**Nvidia Driver Version** : 465.19.01  
**CUDA Version** : 11.3  
**CUDNN Version** : 8.2.0  
**Operating System + Version** : Ubuntu 20.04  
**Python Version (if applicable)**: 3.8  
**PyTorch Version (if applicable)**: 1.8  
**ONNX** : 1.8.0  
**ONNX Runtime-GPU** : 1.7.0

## Relevant Files

[ONNX file dropbox link](https://www.dropbox.com/s/38khofvfx2fnr9h/faster_rcnn.onnx?dl=0)

## Steps To Reproduce

I generate the ONNX model with:

```
with open(class_names_path) as f:
    class_names: list = [line.strip() for line in f.readlines()]

model = LitFasterRCNN(len(class_names) + 1)
model.load_state_dict(state_dict=torch.load(args.model_path)['state_dict'])
model.eval()
# dummy_input = torch.rand(size=(3, 1080, 1920)) # this fixes the input size in the onnx export
x = [torch.rand(3, 300, 400), torch.rand(3, 500, 400)]
model_out = model(x)

# export to onnx
torch.onnx.export(model, # model to export
                  x, # model input
                  "faster_rcnn.onnx", # where to save the model
                  # export_params=True, # store the trained parameter weights inside the model file
                  opset_version=11, # the ONNX version to export the model to
                  # do_constant_folding=True, # whether to execute constant folding for optimization
                  # input_names=['input'], # the model's input names
                  # output_names=['output'], # the model's output names
                  verbose=True,
                  )

```

From the following PyTorch Lightning Model - The model is a pre-cooked Torchvision Faster-RCNN

```
class LitFasterRCNN(pl.LightningModule):

    def __init__ (self, num_classes=3):
        super(). __init__ ()
        self.model = torchvision.models.detection.fasterrcnn_resnet50_fpn(pretrained=True)
        self.model.roi_heads.box_predictor = FastRCNNPredictor(
            in_channels=self.model.roi_heads.box_predictor.cls_score.in_features,
            num_classes=num_classes
        )

    def forward(self, x: torch.tensor):
        return self.model(x)

    def configure_optimizers(self):
        optimizer = torch.optim.SGD(self.model.parameters(),
                                    lr=0.005,
                                    momentum=0.9,
                                    weight_decay=0.0005
                                    )
        return optimizer

    def training_step(self, train_batch, train_idx):
        images, targets = train_batch
        # this precooked model spits out the losses during training
        images = list(image for image in images)
        targets = [{k: v for k, v in t.items()} for t in targets]
        loss_dict = self.model(images, targets)
        loss = sum(loss for loss in loss_dict.values())
        self.log("train_loss", loss)
        return {'loss': loss}

```

I feed the ONNX model path to a build\_engine func

```
def build_engine(model_path) -> trt.ICudaEngine:
    explicit_batch = 1 << (int)(trt.NetworkDefinitionCreationFlag.EXPLICIT_BATCH)
    with trt.Builder(TRT_LOGGER) as builder, \
            builder.create_network(explicit_batch) as network, \
            trt.OnnxParser(network, TRT_LOGGER) as parser:
            builder_config = builder.create_builder_config()
            builder_config.max_workspace_size = 1 << 20
            builder.max_batch_size = 1
            with open(model_path, "rb") as model:
                parser.parse(model.read())
                if not parser.parse(model.read()):
                    print('ERROR: Failed to parse the ONNX file.')
                    for error in range(parser.num_errors):
                        print(parser.get_error(error))
            last_layer = network.get_layer(network.num_layers - 1)
            # Check if last layer recognizes it's output
            if not last_layer.get_output(0):
                # If not, then mark the output using TensorRT API
                network.mark_output(last_layer.get_output(0))
            engine = builder.build_engine(network, builder_config)
            return engine

engine = trt.build_engine(onnx_path)
context = engine.create_execution_context()

```

When I use the above function I get the below traceback.

_Note_: I can run and infer on the ONNX model but I am unable to build the TensorRT engine

**Traceback** :  
2021-05-17 16:54:47.323512008 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1874  
2021-05-17 16:54:47.323527983 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1987  
2021-05-17 16:54:47.323533092 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1992  
2021-05-17 16:54:47.323537398 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1877  
2021-05-17 16:54:47.323540624 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1988  
2021-05-17 16:54:47.323544652 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1994  
2021-05-17 16:54:47.323550634 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1845  
2021-05-17 16:54:47.323553801 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1849  
2021-05-17 16:54:47.323557732 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1842  
2021-05-17 16:54:47.323560907 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1848  
2021-05-17 16:54:47.323564924 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1839  
2021-05-17 16:54:47.323568230 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1847  
2021-05-17 16:54:47.323572439 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1836  
2021-05-17 16:54:47.323575711 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1846  
2021-05-17 16:54:47.323581034 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1850  
2021-05-17 16:54:47.323585177 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1852  
2021-05-17 16:54:47.323589174 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1857  
2021-05-17 16:54:47.323593933 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1858  
2021-05-17 16:54:47.323598781 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1810  
2021-05-17 16:54:47.323601876 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1814  
2021-05-17 16:54:47.323605820 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1807  
2021-05-17 16:54:47.323608940 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1813  
2021-05-17 16:54:47.323613004 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1804  
2021-05-17 16:54:47.323616163 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1812  
2021-05-17 16:54:47.323620180 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1801  
2021-05-17 16:54:47.323623346 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1811  
2021-05-17 16:54:47.323629351 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1815  
2021-05-17 16:54:47.323633564 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1817  
2021-05-17 16:54:47.323637648 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1822  
2021-05-17 16:54:47.323642669 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1823  
2021-05-17 16:54:47.323647866 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1775  
2021-05-17 16:54:47.323651009 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1779  
2021-05-17 16:54:47.323655012 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1772  
2021-05-17 16:54:47.323658161 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1778  
2021-05-17 16:54:47.323662065 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1769  
2021-05-17 16:54:47.323665147 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1777  
2021-05-17 16:54:47.323669094 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1766  
2021-05-17 16:54:47.323672219 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1776  
2021-05-17 16:54:47.323677615 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1780  
2021-05-17 16:54:47.323681875 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1782  
2021-05-17 16:54:47.323685944 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1787  
2021-05-17 16:54:47.323690640 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1788  
2021-05-17 16:54:47.323696400 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1740  
2021-05-17 16:54:47.323699531 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1744  
2021-05-17 16:54:47.323703443 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1737  
2021-05-17 16:54:47.323706557 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1743  
2021-05-17 16:54:47.323710519 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1734  
2021-05-17 16:54:47.323713676 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1742  
2021-05-17 16:54:47.323717585 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1731  
2021-05-17 16:54:47.323720706 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1741  
2021-05-17 16:54:47.323726094 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1745  
2021-05-17 16:54:47.323731604 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1747  
2021-05-17 16:54:47.323735652 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1752  
2021-05-17 16:54:47.323740253 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1753  
2021-05-17 16:54:47.323745721 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1714  
2021-05-17 16:54:47.323748862 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1718  
2021-05-17 16:54:47.323752850 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1711  
2021-05-17 16:54:47.323755882 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1717  
2021-05-17 16:54:47.323759798 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1708  
2021-05-17 16:54:47.323763496 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1716  
2021-05-17 16:54:47.323767428 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1705  
2021-05-17 16:54:47.323770534 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1715  
2021-05-17 16:54:47.323775772 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1719  
2021-05-17 16:54:47.323781724 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1983  
2021-05-17 16:54:47.323785551 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1985  
2021-05-17 16:54:47.323789433 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1880  
2021-05-17 16:54:47.323793348 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1886  
2021-05-17 16:54:47.323797211 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1883  
2021-05-17 16:54:47.323801024 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1887  
2021-05-17 16:54:47.323804114 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1974  
2021-05-17 16:54:47.323808886 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1975  
2021-05-17 16:54:47.323812802 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1889  
2021-05-17 16:54:47.323819431 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2144  
2021-05-17 16:54:47.323822508 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2147  
2021-05-17 16:54:47.323826302 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2141  
2021-05-17 16:54:47.323829400 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2146  
2021-05-17 16:54:47.323833747 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2138  
2021-05-17 16:54:47.323836863 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2145  
2021-05-17 16:54:47.323841472 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_2148  
2021-05-17 16:54:47.323848211 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2025  
2021-05-17 16:54:47.323851334 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2028  
2021-05-17 16:54:47.323855272 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2022  
2021-05-17 16:54:47.323858470 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2027  
2021-05-17 16:54:47.323862293 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_2019  
2021-05-17 16:54:47.323865330 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_2026  
2021-05-17 16:54:47.323869923 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_2029  
2021-05-17 16:54:47.323874764 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1871  
[TensorRT] INFO: [MemUsageChange] Init CUDA: CPU +322, GPU +0, now: CPU 1056, GPU 1065 (MiB)  
[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchorRect\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::NMS\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Reorg\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Region\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Clip\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::LReLU\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::PriorBox\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Normalize\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::ScatterND version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::RPROI\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMSDynamic\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::Split version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice\_TRT version 1  
[TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization\_TRT version 1  
[TensorRT] VERBOSE: Adding network input: image.1 with dtype: float32, dimensions: (3, 300, 400)  
[TensorRT] VERBOSE: Registering tensor: image.1 for ONNX tensor: image.1  
[TensorRT] VERBOSE: Adding network input: image.3 with dtype: float32, dimensions: (3, 500, 400)  
[TensorRT] VERBOSE: Registering tensor: image.3 for ONNX tensor: image.3  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.0.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.0.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.0.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.0.downsample.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.1.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.1.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.1.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.2.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.2.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer1.2.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.0.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.0.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.0.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.0.downsample.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.1.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.1.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.1.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.2.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.2.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.2.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.3.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.3.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer2.3.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.0.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.0.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.0.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.0.downsample.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.1.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.1.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.1.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.2.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.2.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.2.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.3.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.3.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.3.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.4.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.4.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.4.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.5.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.5.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer3.5.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.0.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.0.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.0.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.0.downsample.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.1.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.1.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.1.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.2.conv1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.2.conv2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.body.layer4.2.conv3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.0.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.1.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.2.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.inner\_blocks.3.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.0.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.0.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.1.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.1.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.2.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.2.bias  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.3.weight  
[TensorRT] VERBOSE: Importing initializer: model.backbone.fpn.layer\_blocks.3.bias  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.conv.weight  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.conv.bias  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.cls\_logits.weight  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.cls\_logits.bias  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.bbox\_pred.weight  
[TensorRT] VERBOSE: Importing initializer: model.rpn.head.bbox\_pred.bias  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_head.fc6.weight  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_head.fc6.bias  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_head.fc7.weight  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_head.fc7.bias  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_predictor.cls\_score.weight  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_predictor.cls\_score.bias  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_predictor.bbox\_pred.weight  
[TensorRT] VERBOSE: Importing initializer: model.roi\_heads.box\_predictor.bbox\_pred.bias  
[TensorRT] VERBOSE: Importing initializer: 3601  
[TensorRT] VERBOSE: Importing initializer: 3602  
[TensorRT] VERBOSE: Importing initializer: 3603  
[TensorRT] WARNING: onnx2trt\_utils.cpp:320: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.  
[TensorRT] VERBOSE: Importing initializer: 3604  
[TensorRT] VERBOSE: Importing initializer: 3605  
[TensorRT] VERBOSE: Importing initializer: 3606  
[TensorRT] VERBOSE: Importing initializer: 3607  
[TensorRT] VERBOSE: Importing initializer: 3608  
[TensorRT] VERBOSE: Importing initializer: 3609  
[TensorRT] VERBOSE: Importing initializer: 3610  
[TensorRT] VERBOSE: Importing initializer: 3611  
[TensorRT] VERBOSE: Importing initializer: 3612  
[TensorRT] VERBOSE: Importing initializer: 3613  
[TensorRT] VERBOSE: Importing initializer: 3614  
[TensorRT] VERBOSE: Importing initializer: 3615  
[TensorRT] VERBOSE: Importing initializer: 3616  
[TensorRT] VERBOSE: Importing initializer: 3624  
[TensorRT] VERBOSE: Importing initializer: 3626  
[TensorRT] VERBOSE: Importing initializer: 3634  
[TensorRT] VERBOSE: Importing initializer: 3636  
[TensorRT] VERBOSE: Importing initializer: 3644  
[TensorRT] VERBOSE: Importing initializer: 3646  
[TensorRT] VERBOSE: Importing initializer: 3654  
[TensorRT] VERBOSE: Importing initializer: 3656  
[TensorRT] VERBOSE: Importing initializer: 3664  
[TensorRT] VERBOSE: Importing initializer: 3666  
[TensorRT] VERBOSE: Importing initializer: 3674  
[TensorRT] VERBOSE: Importing initializer: 3676  
[TensorRT] VERBOSE: Importing initializer: 3684  
[TensorRT] VERBOSE: Importing initializer: 3686  
[TensorRT] VERBOSE: Importing initializer: 3694  
[TensorRT] VERBOSE: Importing initializer: 3696  
[TensorRT] VERBOSE: Importing initializer: 3704  
[TensorRT] VERBOSE: Importing initializer: 3706  
[TensorRT] VERBOSE: Importing initializer: 3714  
[TensorRT] VERBOSE: Importing initializer: 3716  
[TensorRT] VERBOSE: Importing initializer: 3724  
[TensorRT] VERBOSE: Importing initializer: 3726  
[TensorRT] VERBOSE: Importing initializer: 3734  
[TensorRT] VERBOSE: Importing initializer: 3736  
[TensorRT] VERBOSE: Importing initializer: 3744  
[TensorRT] VERBOSE: Importing initializer: 3746  
[TensorRT] VERBOSE: Importing initializer: 3754  
[TensorRT] VERBOSE: Importing initializer: 3756  
[TensorRT] VERBOSE: Importing initializer: 3764  
[TensorRT] VERBOSE: Importing initializer: 3766  
[TensorRT] VERBOSE: Importing initializer: 3774  
[TensorRT] VERBOSE: Importing initializer: 3776  
[TensorRT] VERBOSE: Importing initializer: 3784  
[TensorRT] VERBOSE: Importing initializer: 3786  
[TensorRT] VERBOSE: Importing initializer: 3794  
[TensorRT] VERBOSE: Importing initializer: 3796  
[TensorRT] VERBOSE: Importing initializer: 3804  
[TensorRT] VERBOSE: Importing initializer: 3806  
[TensorRT] VERBOSE: Importing initializer: 3814  
[TensorRT] VERBOSE: Importing initializer: 3816  
[TensorRT] VERBOSE: Importing initializer: 3824  
[TensorRT] VERBOSE: Importing initializer: 3826  
[TensorRT] VERBOSE: Importing initializer: 3834  
[TensorRT] VERBOSE: Importing initializer: 3836  
[TensorRT] VERBOSE: Importing initializer: 3844  
[TensorRT] VERBOSE: Importing initializer: 3846  
[TensorRT] VERBOSE: Importing initializer: 3854  
[TensorRT] VERBOSE: Importing initializer: 3856  
[TensorRT] VERBOSE: Importing initializer: 3864  
[TensorRT] VERBOSE: Importing initializer: 3866  
[TensorRT] VERBOSE: Importing initializer: 3874  
[TensorRT] VERBOSE: Importing initializer: 3876  
[TensorRT] VERBOSE: Importing initializer: 3884  
[TensorRT] VERBOSE: Importing initializer: 3886  
[TensorRT] VERBOSE: Importing initializer: 3894  
[TensorRT] VERBOSE: Importing initializer: 3896  
[TensorRT] VERBOSE: Importing initializer: 3904  
[TensorRT] VERBOSE: Importing initializer: 3906  
[TensorRT] VERBOSE: Importing initializer: 3914  
[TensorRT] VERBOSE: Importing initializer: 3916  
[TensorRT] VERBOSE: Importing initializer: 3924  
[TensorRT] VERBOSE: Importing initializer: 3926  
[TensorRT] VERBOSE: Importing initializer: 3934  
[TensorRT] VERBOSE: Importing initializer: 3936  
[TensorRT] VERBOSE: Importing initializer: 3944  
[TensorRT] VERBOSE: Importing initializer: 3946  
[TensorRT] VERBOSE: Importing initializer: 3954  
[TensorRT] VERBOSE: Importing initializer: 3956  
[TensorRT] VERBOSE: Importing initializer: 3964  
[TensorRT] VERBOSE: Importing initializer: 3966  
[TensorRT] VERBOSE: Importing initializer: 3974  
[TensorRT] VERBOSE: Importing initializer: 3976  
[TensorRT] VERBOSE: Importing initializer: 3984  
[TensorRT] VERBOSE: Importing initializer: 3986  
[TensorRT] VERBOSE: Importing initializer: 3994  
[TensorRT] VERBOSE: Importing initializer: 3996  
[TensorRT] VERBOSE: Importing initializer: 4004  
[TensorRT] VERBOSE: Importing initializer: 4006  
[TensorRT] VERBOSE: Importing initializer: 4014  
[TensorRT] VERBOSE: Importing initializer: 4016  
[TensorRT] VERBOSE: Importing initializer: 4024  
[TensorRT] VERBOSE: Importing initializer: 4026  
[TensorRT] VERBOSE: Importing initializer: 4034  
[TensorRT] VERBOSE: Importing initializer: 4036  
[TensorRT] VERBOSE: Importing initializer: 4044  
[TensorRT] VERBOSE: Importing initializer: 4046  
[TensorRT] VERBOSE: Importing initializer: 4054  
[TensorRT] VERBOSE: Importing initializer: 4056  
[TensorRT] VERBOSE: Importing initializer: 4064  
[TensorRT] VERBOSE: Importing initializer: 4066  
[TensorRT] VERBOSE: Importing initializer: 4074  
[TensorRT] VERBOSE: Importing initializer: 4076  
[TensorRT] VERBOSE: Importing initializer: 4084  
[TensorRT] VERBOSE: Importing initializer: 4086  
[TensorRT] VERBOSE: Importing initializer: 4094  
[TensorRT] VERBOSE: Importing initializer: 4096  
[TensorRT] VERBOSE: Importing initializer: 4104  
[TensorRT] VERBOSE: Importing initializer: 4106  
[TensorRT] VERBOSE: Importing initializer: 4114  
[TensorRT] VERBOSE: Importing initializer: 4116  
[TensorRT] VERBOSE: Importing initializer: 4124  
[TensorRT] VERBOSE: Importing initializer: 4126  
[TensorRT] VERBOSE: Importing initializer: 4134  
[TensorRT] VERBOSE: Importing initializer: 4136  
[TensorRT] VERBOSE: Importing initializer: 4144  
[TensorRT] VERBOSE: Importing initializer: 4146  
[TensorRT] VERBOSE: Importing initializer: 4147  
[TensorRT] VERBOSE: Importing initializer: 4148  
[TensorRT] VERBOSE: Importing initializer: 4149  
[TensorRT] VERBOSE: Importing initializer: 4150  
[TensorRT] VERBOSE: Importing initializer: 4151  
[TensorRT] VERBOSE: Importing initializer: 4152  
[TensorRT] VERBOSE: Importing initializer: 4153  
[TensorRT] VERBOSE: Importing initializer: 4154  
[TensorRT] VERBOSE: Importing initializer: 4155  
[TensorRT] VERBOSE: Importing initializer: 4156  
[TensorRT] VERBOSE: Importing initializer: 4157  
[TensorRT] VERBOSE: Importing initializer: 4158  
[TensorRT] VERBOSE: Importing initializer: 4159  
[TensorRT] VERBOSE: Importing initializer: 4160  
[TensorRT] VERBOSE: Importing initializer: 4161  
[TensorRT] VERBOSE: Importing initializer: 4162  
[TensorRT] VERBOSE: Importing initializer: 4163  
[TensorRT] VERBOSE: Importing initializer: 4164  
[TensorRT] VERBOSE: Importing initializer: 4165  
[TensorRT] VERBOSE: Importing initializer: 4166  
[TensorRT] VERBOSE: Importing initializer: 4167  
[TensorRT] VERBOSE: Importing initializer: 4168  
[TensorRT] VERBOSE: Importing initializer: 4169  
[TensorRT] VERBOSE: Importing initializer: 4170  
[TensorRT] VERBOSE: Importing initializer: 4171  
[TensorRT] VERBOSE: Importing initializer: 4172  
[TensorRT] VERBOSE: Importing initializer: 4173  
[TensorRT] VERBOSE: Importing initializer: 4174  
[TensorRT] VERBOSE: Importing initializer: 4175  
[TensorRT] VERBOSE: Importing initializer: 4176  
[TensorRT] VERBOSE: Importing initializer: 4177  
[TensorRT] VERBOSE: Importing initializer: 4178  
[TensorRT] VERBOSE: Importing initializer: 4179  
[TensorRT] VERBOSE: Importing initializer: 4180  
[TensorRT] VERBOSE: Importing initializer: 4181  
[TensorRT] VERBOSE: Importing initializer: 4182  
[TensorRT] VERBOSE: Importing initializer: 4183  
[TensorRT] VERBOSE: Importing initializer: 4184  
[TensorRT] VERBOSE: Importing initializer: 4185  
[TensorRT] VERBOSE: Importing initializer: 4186  
[TensorRT] VERBOSE: Importing initializer: 4187  
[TensorRT] VERBOSE: Importing initializer: 4188  
[TensorRT] VERBOSE: Importing initializer: 4189  
[TensorRT] VERBOSE: Importing initializer: 4190  
[TensorRT] VERBOSE: Importing initializer: 4191  
[TensorRT] VERBOSE: Importing initializer: 4192  
[TensorRT] VERBOSE: Importing initializer: 4193  
[TensorRT] VERBOSE: Importing initializer: 4194  
[TensorRT] VERBOSE: Importing initializer: 4195  
[TensorRT] VERBOSE: Importing initializer: 4196  
[TensorRT] VERBOSE: Importing initializer: 4197  
[TensorRT] VERBOSE: Importing initializer: 4198  
[TensorRT] VERBOSE: Importing initializer: 4199  
[TensorRT] VERBOSE: Importing initializer: 4200  
[TensorRT] VERBOSE: Importing initializer: 4201  
[TensorRT] VERBOSE: Importing initializer: 4202  
[TensorRT] VERBOSE: Importing initializer: 4203  
[TensorRT] VERBOSE: Importing initializer: 4204  
[TensorRT] VERBOSE: Importing initializer: 4205  
[TensorRT] VERBOSE: Importing initializer: 4206  
[TensorRT] VERBOSE: Importing initializer: 4207  
[TensorRT] VERBOSE: Importing initializer: 4208  
[TensorRT] VERBOSE: Importing initializer: 4209  
[TensorRT] VERBOSE: Importing initializer: 4210  
[TensorRT] VERBOSE: Importing initializer: 4211  
[TensorRT] VERBOSE: Importing initializer: 4212  
[TensorRT] VERBOSE: Importing initializer: 4213  
[TensorRT] VERBOSE: Importing initializer: 4214  
[TensorRT] VERBOSE: Parsing node: Shape\_0 [Shape]  
[TensorRT] VERBOSE: Searching for input: image.1  
[TensorRT] VERBOSE: Shape\_0 [Shape] inputs: [image.1 → (3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_0 for ONNX node: Shape\_0  
[TensorRT] VERBOSE: Registering tensor: 297 for ONNX tensor: 297  
[TensorRT] VERBOSE: Shape\_0 [Shape] outputs: [297 → (3)],  
[TensorRT] VERBOSE: Parsing node: Constant\_1 [Constant]  
[TensorRT] VERBOSE: Constant\_1 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_1 [Constant] outputs: [298 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_2 [Gather]  
[TensorRT] VERBOSE: Searching for input: 297  
[TensorRT] VERBOSE: Searching for input: 298  
[TensorRT] VERBOSE: Gather\_2 [Gather] inputs: [297 → (3)], [298 → ()],  
[TensorRT] VERBOSE: Registering layer: 298 for ONNX node: 298  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_2 for ONNX node: Gather\_2  
[TensorRT] VERBOSE: Registering tensor: 299 for ONNX tensor: 299  
[TensorRT] VERBOSE: Gather\_2 [Gather] outputs: [299 → ()],  
[TensorRT] VERBOSE: Parsing node: Shape\_3 [Shape]  
[TensorRT] VERBOSE: Searching for input: image.1  
[TensorRT] VERBOSE: Shape\_3 [Shape] inputs: [image.1 → (3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_3 for ONNX node: Shape\_3  
[TensorRT] VERBOSE: Registering tensor: 300 for ONNX tensor: 300  
[TensorRT] VERBOSE: Shape\_3 [Shape] outputs: [300 → (3)],  
[TensorRT] VERBOSE: Parsing node: Constant\_4 [Constant]  
[TensorRT] VERBOSE: Constant\_4 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_4 [Constant] outputs: [301 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_5 [Gather]  
[TensorRT] VERBOSE: Searching for input: 300  
[TensorRT] VERBOSE: Searching for input: 301  
[TensorRT] VERBOSE: Gather\_5 [Gather] inputs: [300 → (3)], [301 → ()],  
[TensorRT] VERBOSE: Registering layer: 301 for ONNX node: 301  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_5 for ONNX node: Gather\_5  
[TensorRT] VERBOSE: Registering tensor: 302 for ONNX tensor: 302  
[TensorRT] VERBOSE: Gather\_5 [Gather] outputs: [302 → ()],  
[TensorRT] VERBOSE: Parsing node: Shape\_6 [Shape]  
[TensorRT] VERBOSE: Searching for input: image.3  
[TensorRT] VERBOSE: Shape\_6 [Shape] inputs: [image.3 → (3, 500, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_6 for ONNX node: Shape\_6  
[TensorRT] VERBOSE: Registering tensor: 303 for ONNX tensor: 303  
[TensorRT] VERBOSE: Shape\_6 [Shape] outputs: [303 → (3)],  
[TensorRT] VERBOSE: Parsing node: Constant\_7 [Constant]  
[TensorRT] VERBOSE: Constant\_7 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_7 [Constant] outputs: [304 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_8 [Gather]  
[TensorRT] VERBOSE: Searching for input: 303  
[TensorRT] VERBOSE: Searching for input: 304  
[TensorRT] VERBOSE: Gather\_8 [Gather] inputs: [303 → (3)], [304 → ()],  
[TensorRT] VERBOSE: Registering layer: 304 for ONNX node: 304  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_8 for ONNX node: Gather\_8  
[TensorRT] VERBOSE: Registering tensor: 305 for ONNX tensor: 305  
[TensorRT] VERBOSE: Gather\_8 [Gather] outputs: [305 → ()],  
[TensorRT] VERBOSE: Parsing node: Shape\_9 [Shape]  
[TensorRT] VERBOSE: Searching for input: image.3  
[TensorRT] VERBOSE: Shape\_9 [Shape] inputs: [image.3 → (3, 500, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_9 for ONNX node: Shape\_9  
[TensorRT] VERBOSE: Registering tensor: 306 for ONNX tensor: 306  
[TensorRT] VERBOSE: Shape\_9 [Shape] outputs: [306 → (3)],  
[TensorRT] VERBOSE: Parsing node: Constant\_10 [Constant]  
[TensorRT] VERBOSE: Constant\_10 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_10 [Constant] outputs: [307 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_11 [Gather]  
[TensorRT] VERBOSE: Searching for input: 306  
[TensorRT] VERBOSE: Searching for input: 307  
[TensorRT] VERBOSE: Gather\_11 [Gather] inputs: [306 → (3)], [307 → ()],  
[TensorRT] VERBOSE: Registering layer: 307 for ONNX node: 307  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_11 for ONNX node: Gather\_11  
[TensorRT] VERBOSE: Registering tensor: 308 for ONNX tensor: 308  
[TensorRT] VERBOSE: Gather\_11 [Gather] outputs: [308 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_12 [Constant]  
[TensorRT] VERBOSE: Constant\_12 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_12 [Constant] outputs: [309 → (3, 1, 1)],  
[TensorRT] VERBOSE: Parsing node: Sub\_13 [Sub]  
[TensorRT] VERBOSE: Searching for input: image.1  
[TensorRT] VERBOSE: Searching for input: 309  
[TensorRT] VERBOSE: Sub\_13 [Sub] inputs: [image.1 → (3, 300, 400)], [309 → (3, 1, 1)],  
[TensorRT] VERBOSE: Registering layer: 309 for ONNX node: 309  
[TensorRT] VERBOSE: Registering layer: Sub\_13 for ONNX node: Sub\_13  
[TensorRT] VERBOSE: Registering tensor: 310 for ONNX tensor: 310  
[TensorRT] VERBOSE: Sub\_13 [Sub] outputs: [310 → (3, 300, 400)],  
[TensorRT] VERBOSE: Parsing node: Constant\_14 [Constant]  
[TensorRT] VERBOSE: Constant\_14 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_14 [Constant] outputs: [311 → (3, 1, 1)],  
[TensorRT] VERBOSE: Parsing node: Div\_15 [Div]  
[TensorRT] VERBOSE: Searching for input: 310  
[TensorRT] VERBOSE: Searching for input: 311  
[TensorRT] VERBOSE: Div\_15 [Div] inputs: [310 → (3, 300, 400)], [311 → (3, 1, 1)],  
[TensorRT] VERBOSE: Registering layer: 311 for ONNX node: 311  
[TensorRT] VERBOSE: Registering layer: Div\_15 for ONNX node: Div\_15  
[TensorRT] VERBOSE: Registering tensor: 312 for ONNX tensor: 312  
[TensorRT] VERBOSE: Div\_15 [Div] outputs: [312 → (3, 300, 400)],  
[TensorRT] VERBOSE: Parsing node: Shape\_16 [Shape]  
[TensorRT] VERBOSE: Searching for input: 312  
[TensorRT] VERBOSE: Shape\_16 [Shape] inputs: [312 → (3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_16 for ONNX node: Shape\_16  
[TensorRT] VERBOSE: Registering tensor: 313 for ONNX tensor: 313  
[TensorRT] VERBOSE: Shape\_16 [Shape] outputs: [313 → (3)],  
[TensorRT] VERBOSE: Parsing node: Constant\_17 [Constant]  
[TensorRT] VERBOSE: Constant\_17 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_17 [Constant] outputs: [314 → (1)],  
[TensorRT] VERBOSE: Parsing node: Constant\_18 [Constant]  
[TensorRT] VERBOSE: Constant\_18 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_18 [Constant] outputs: [315 → (1)],  
[TensorRT] VERBOSE: Parsing node: Constant\_19 [Constant]  
[TensorRT] VERBOSE: Constant\_19 [Constant] inputs:  
[TensorRT] VERBOSE: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647  
[TensorRT] WARNING: onnx2trt\_utils.cpp:346: One or more weights outside the range of INT32 was clamped  
[TensorRT] VERBOSE: Constant\_19 [Constant] outputs: [316 → (1)],  
[TensorRT] VERBOSE: Parsing node: Constant\_20 [Constant]  
[TensorRT] VERBOSE: Constant\_20 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_20 [Constant] outputs: [317 → (1)],  
[TensorRT] VERBOSE: Parsing node: Slice\_21 [Slice]  
[TensorRT] VERBOSE: Searching for input: 313  
[TensorRT] VERBOSE: Searching for input: 315  
[TensorRT] VERBOSE: Searching for input: 316  
[TensorRT] VERBOSE: Searching for input: 314  
[TensorRT] VERBOSE: Searching for input: 317  
[TensorRT] VERBOSE: Slice\_21 [Slice] inputs: [313 → (3)], [315 → (1)], [316 → (1)], [314 → (1)], [317 → (1)],  
[TensorRT] VERBOSE: Registering layer: Slice\_21 for ONNX node: Slice\_21  
[TensorRT] VERBOSE: Registering tensor: 318 for ONNX tensor: 318  
[TensorRT] VERBOSE: Slice\_21 [Slice] outputs: [318 → (2)],  
[TensorRT] VERBOSE: Parsing node: ReduceMin\_22 [ReduceMin]  
[TensorRT] VERBOSE: Searching for input: 318  
[TensorRT] VERBOSE: ReduceMin\_22 [ReduceMin] inputs: [318 → (2)],  
[TensorRT] VERBOSE: Registering layer: ReduceMin\_22 for ONNX node: ReduceMin\_22  
[TensorRT] VERBOSE: Registering tensor: 319 for ONNX tensor: 319  
[TensorRT] VERBOSE: ReduceMin\_22 [ReduceMin] outputs: [319 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_23 [Cast]  
[TensorRT] VERBOSE: Searching for input: 319  
[TensorRT] VERBOSE: Cast\_23 [Cast] inputs: [319 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_23 for ONNX node: Cast\_23  
[TensorRT] VERBOSE: Registering tensor: 320 for ONNX tensor: 320  
[TensorRT] VERBOSE: Cast\_23 [Cast] outputs: [320 → ()],  
[TensorRT] VERBOSE: Parsing node: ReduceMax\_24 [ReduceMax]  
[TensorRT] VERBOSE: Searching for input: 318  
[TensorRT] VERBOSE: ReduceMax\_24 [ReduceMax] inputs: [318 → (2)],  
[TensorRT] VERBOSE: Registering layer: ReduceMax\_24 for ONNX node: ReduceMax\_24  
[TensorRT] VERBOSE: Registering tensor: 321 for ONNX tensor: 321  
[TensorRT] VERBOSE: ReduceMax\_24 [ReduceMax] outputs: [321 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_25 [Cast]  
[TensorRT] VERBOSE: Searching for input: 321  
[TensorRT] VERBOSE: Cast\_25 [Cast] inputs: [321 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_25 for ONNX node: Cast\_25  
[TensorRT] VERBOSE: Registering tensor: 322 for ONNX tensor: 322  
[TensorRT] VERBOSE: Cast\_25 [Cast] outputs: [322 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_26 [Constant]  
[TensorRT] VERBOSE: Constant\_26 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_26 [Constant] outputs: [323 → ()],  
[TensorRT] VERBOSE: Parsing node: Div\_27 [Div]  
[TensorRT] VERBOSE: Searching for input: 323  
[TensorRT] VERBOSE: Searching for input: 320  
[TensorRT] VERBOSE: Div\_27 [Div] inputs: [323 → ()], [320 → ()],  
[TensorRT] VERBOSE: Registering layer: 323 for ONNX node: 323  
[TensorRT] VERBOSE: Registering layer: Div\_27 for ONNX node: Div\_27  
[TensorRT] VERBOSE: Registering tensor: 324 for ONNX tensor: 324  
[TensorRT] VERBOSE: Div\_27 [Div] outputs: [324 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_28 [Constant]  
[TensorRT] VERBOSE: Constant\_28 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_28 [Constant] outputs: [325 → ()],  
[TensorRT] VERBOSE: Parsing node: Mul\_29 [Mul]  
[TensorRT] VERBOSE: Searching for input: 324  
[TensorRT] VERBOSE: Searching for input: 325  
[TensorRT] VERBOSE: Mul\_29 [Mul] inputs: [324 → ()], [325 → ()],  
[TensorRT] VERBOSE: Registering layer: 325 for ONNX node: 325  
[TensorRT] VERBOSE: Registering layer: Mul\_29 for ONNX node: Mul\_29  
[TensorRT] VERBOSE: Registering tensor: 326 for ONNX tensor: 326  
[TensorRT] VERBOSE: Mul\_29 [Mul] outputs: [326 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_30 [Constant]  
[TensorRT] VERBOSE: Constant\_30 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_30 [Constant] outputs: [327 → ()],  
[TensorRT] VERBOSE: Parsing node: Div\_31 [Div]  
[TensorRT] VERBOSE: Searching for input: 327  
[TensorRT] VERBOSE: Searching for input: 322  
[TensorRT] VERBOSE: Div\_31 [Div] inputs: [327 → ()], [322 → ()],  
[TensorRT] VERBOSE: Registering layer: 327 for ONNX node: 327  
[TensorRT] VERBOSE: Registering layer: Div\_31 for ONNX node: Div\_31  
[TensorRT] VERBOSE: Registering tensor: 328 for ONNX tensor: 328  
[TensorRT] VERBOSE: Div\_31 [Div] outputs: [328 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_32 [Constant]  
[TensorRT] VERBOSE: Constant\_32 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_32 [Constant] outputs: [329 → ()],  
[TensorRT] VERBOSE: Parsing node: Mul\_33 [Mul]  
[TensorRT] VERBOSE: Searching for input: 328  
[TensorRT] VERBOSE: Searching for input: 329  
[TensorRT] VERBOSE: Mul\_33 [Mul] inputs: [328 → ()], [329 → ()],  
[TensorRT] VERBOSE: Registering layer: 329 for ONNX node: 329  
[TensorRT] VERBOSE: Registering layer: Mul\_33 for ONNX node: Mul\_33  
[TensorRT] VERBOSE: Registering tensor: 330 for ONNX tensor: 330  
[TensorRT] VERBOSE: Mul\_33 [Mul] outputs: [330 → ()],  
[TensorRT] VERBOSE: Parsing node: Min\_34 [Min]  
[TensorRT] VERBOSE: Searching for input: 326  
[TensorRT] VERBOSE: Searching for input: 330  
[TensorRT] VERBOSE: Min\_34 [Min] inputs: [326 → ()], [330 → ()],  
[TensorRT] VERBOSE: Registering layer: Min\_34 for ONNX node: Min\_34  
[TensorRT] VERBOSE: Registering tensor: 331 for ONNX tensor: 331  
[TensorRT] VERBOSE: Min\_34 [Min] outputs: [331 → ()],  
[TensorRT] VERBOSE: Parsing node: Unsqueeze\_35 [Unsqueeze]  
[TensorRT] VERBOSE: Searching for input: 312  
[TensorRT] VERBOSE: Unsqueeze\_35 [Unsqueeze] inputs: [312 → (3, 300, 400)],  
[TensorRT] VERBOSE: Original shape: (3, 300, 400), unsqueezing to: (1, 3, 300, 400)  
[TensorRT] VERBOSE: Registering layer: Unsqueeze\_35 for ONNX node: Unsqueeze\_35  
[TensorRT] VERBOSE: Registering tensor: 332 for ONNX tensor: 332  
[TensorRT] VERBOSE: Unsqueeze\_35 [Unsqueeze] outputs: [332 → (1, 3, 300, 400)],  
[TensorRT] VERBOSE: Parsing node: Shape\_36 [Shape]  
[TensorRT] VERBOSE: Searching for input: 332  
[TensorRT] VERBOSE: Shape\_36 [Shape] inputs: [332 → (1, 3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_36 for ONNX node: Shape\_36  
[TensorRT] VERBOSE: Registering tensor: 333 for ONNX tensor: 333  
[TensorRT] VERBOSE: Shape\_36 [Shape] outputs: [333 → (4)],  
[TensorRT] VERBOSE: Parsing node: Constant\_37 [Constant]  
[TensorRT] VERBOSE: Constant\_37 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_37 [Constant] outputs: [334 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_38 [Gather]  
[TensorRT] VERBOSE: Searching for input: 333  
[TensorRT] VERBOSE: Searching for input: 334  
[TensorRT] VERBOSE: Gather\_38 [Gather] inputs: [333 → (4)], [334 → ()],  
[TensorRT] VERBOSE: Registering layer: 334 for ONNX node: 334  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_38 for ONNX node: Gather\_38  
[TensorRT] VERBOSE: Registering tensor: 335 for ONNX tensor: 335  
[TensorRT] VERBOSE: Gather\_38 [Gather] outputs: [335 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_39 [Cast]  
[TensorRT] VERBOSE: Searching for input: 335  
[TensorRT] VERBOSE: Cast\_39 [Cast] inputs: [335 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_39 for ONNX node: Cast\_39  
[TensorRT] VERBOSE: Registering tensor: 336 for ONNX tensor: 336  
[TensorRT] VERBOSE: Cast\_39 [Cast] outputs: [336 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_40 [Cast]  
[TensorRT] VERBOSE: Searching for input: 331  
[TensorRT] VERBOSE: Cast\_40 [Cast] inputs: [331 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_40 for ONNX node: Cast\_40  
[TensorRT] VERBOSE: Registering tensor: 337 for ONNX tensor: 337  
[TensorRT] VERBOSE: Cast\_40 [Cast] outputs: [337 → ()],  
[TensorRT] VERBOSE: Parsing node: Mul\_41 [Mul]  
[TensorRT] VERBOSE: Searching for input: 336  
[TensorRT] VERBOSE: Searching for input: 337  
[TensorRT] VERBOSE: Mul\_41 [Mul] inputs: [336 → ()], [337 → ()],  
[TensorRT] VERBOSE: Registering layer: Mul\_41 for ONNX node: Mul\_41  
[TensorRT] VERBOSE: Registering tensor: 338 for ONNX tensor: 338  
[TensorRT] VERBOSE: Mul\_41 [Mul] outputs: [338 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_42 [Cast]  
[TensorRT] VERBOSE: Searching for input: 338  
[TensorRT] VERBOSE: Cast\_42 [Cast] inputs: [338 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_42 for ONNX node: Cast\_42  
[TensorRT] VERBOSE: Registering tensor: 339 for ONNX tensor: 339  
[TensorRT] VERBOSE: Cast\_42 [Cast] outputs: [339 → ()],  
[TensorRT] VERBOSE: Parsing node: Floor\_43 [Floor]  
[TensorRT] VERBOSE: Searching for input: 339  
[TensorRT] VERBOSE: Floor\_43 [Floor] inputs: [339 → ()],  
[TensorRT] VERBOSE: Original shape: (), unsqueezing to: (1,)  
[TensorRT] VERBOSE: Registering layer: Floor\_43 for ONNX node: Floor\_43  
[TensorRT] VERBOSE: Original shape: (1,), squeezing to: ()  
[TensorRT] VERBOSE: Registering tensor: 340 for ONNX tensor: 340  
[TensorRT] VERBOSE: Floor\_43 [Floor] outputs: [340 → ()],  
[TensorRT] VERBOSE: Parsing node: Shape\_44 [Shape]  
[TensorRT] VERBOSE: Searching for input: 332  
[TensorRT] VERBOSE: Shape\_44 [Shape] inputs: [332 → (1, 3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_44 for ONNX node: Shape\_44  
[TensorRT] VERBOSE: Registering tensor: 341 for ONNX tensor: 341  
[TensorRT] VERBOSE: Shape\_44 [Shape] outputs: [341 → (4)],  
[TensorRT] VERBOSE: Parsing node: Constant\_45 [Constant]  
[TensorRT] VERBOSE: Constant\_45 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_45 [Constant] outputs: [342 → ()],  
[TensorRT] VERBOSE: Parsing node: Gather\_46 [Gather]  
[TensorRT] VERBOSE: Searching for input: 341  
[TensorRT] VERBOSE: Searching for input: 342  
[TensorRT] VERBOSE: Gather\_46 [Gather] inputs: [341 → (4)], [342 → ()],  
[TensorRT] VERBOSE: Registering layer: 342 for ONNX node: 342  
[TensorRT] VERBOSE: Using Gather axis: 0  
[TensorRT] VERBOSE: Registering layer: Gather\_46 for ONNX node: Gather\_46  
[TensorRT] VERBOSE: Registering tensor: 343 for ONNX tensor: 343  
[TensorRT] VERBOSE: Gather\_46 [Gather] outputs: [343 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_47 [Cast]  
[TensorRT] VERBOSE: Searching for input: 343  
[TensorRT] VERBOSE: Cast\_47 [Cast] inputs: [343 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_47 for ONNX node: Cast\_47  
[TensorRT] VERBOSE: Registering tensor: 344 for ONNX tensor: 344  
[TensorRT] VERBOSE: Cast\_47 [Cast] outputs: [344 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_48 [Cast]  
[TensorRT] VERBOSE: Searching for input: 331  
[TensorRT] VERBOSE: Cast\_48 [Cast] inputs: [331 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_48 for ONNX node: Cast\_48  
[TensorRT] VERBOSE: Registering tensor: 345 for ONNX tensor: 345  
[TensorRT] VERBOSE: Cast\_48 [Cast] outputs: [345 → ()],  
[TensorRT] VERBOSE: Parsing node: Mul\_49 [Mul]  
[TensorRT] VERBOSE: Searching for input: 344  
[TensorRT] VERBOSE: Searching for input: 345  
[TensorRT] VERBOSE: Mul\_49 [Mul] inputs: [344 → ()], [345 → ()],  
[TensorRT] VERBOSE: Registering layer: Mul\_49 for ONNX node: Mul\_49  
[TensorRT] VERBOSE: Registering tensor: 346 for ONNX tensor: 346  
[TensorRT] VERBOSE: Mul\_49 [Mul] outputs: [346 → ()],  
[TensorRT] VERBOSE: Parsing node: Cast\_50 [Cast]  
[TensorRT] VERBOSE: Searching for input: 346  
[TensorRT] VERBOSE: Cast\_50 [Cast] inputs: [346 → ()],  
[TensorRT] VERBOSE: Casting to type: float32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_50 for ONNX node: Cast\_50  
[TensorRT] VERBOSE: Registering tensor: 347 for ONNX tensor: 347  
[TensorRT] VERBOSE: Cast\_50 [Cast] outputs: [347 → ()],  
[TensorRT] VERBOSE: Parsing node: Floor\_51 [Floor]  
[TensorRT] VERBOSE: Searching for input: 347  
[TensorRT] VERBOSE: Floor\_51 [Floor] inputs: [347 → ()],  
[TensorRT] VERBOSE: Original shape: (), unsqueezing to: (1,)  
[TensorRT] VERBOSE: Registering layer: Floor\_51 for ONNX node: Floor\_51  
[TensorRT] VERBOSE: Original shape: (1,), squeezing to: ()  
[TensorRT] VERBOSE: Registering tensor: 348 for ONNX tensor: 348  
[TensorRT] VERBOSE: Floor\_51 [Floor] outputs: [348 → ()],  
[TensorRT] VERBOSE: Parsing node: Unsqueeze\_52 [Unsqueeze]  
[TensorRT] VERBOSE: Searching for input: 340  
[TensorRT] VERBOSE: Unsqueeze\_52 [Unsqueeze] inputs: [340 → ()],  
[TensorRT] VERBOSE: Original shape: (), unsqueezing to: (1,)  
[TensorRT] VERBOSE: Registering layer: Unsqueeze\_52 for ONNX node: Unsqueeze\_52  
[TensorRT] VERBOSE: Registering tensor: 349 for ONNX tensor: 349  
[TensorRT] VERBOSE: Unsqueeze\_52 [Unsqueeze] outputs: [349 → (1)],  
[TensorRT] VERBOSE: Parsing node: Unsqueeze\_53 [Unsqueeze]  
[TensorRT] VERBOSE: Searching for input: 348  
[TensorRT] VERBOSE: Unsqueeze\_53 [Unsqueeze] inputs: [348 → ()],  
[TensorRT] VERBOSE: Original shape: (), unsqueezing to: (1,)  
[TensorRT] VERBOSE: Registering layer: Unsqueeze\_53 for ONNX node: Unsqueeze\_53  
[TensorRT] VERBOSE: Registering tensor: 350 for ONNX tensor: 350  
[TensorRT] VERBOSE: Unsqueeze\_53 [Unsqueeze] outputs: [350 → (1)],  
[TensorRT] VERBOSE: Parsing node: Concat\_54 [Concat]  
[TensorRT] VERBOSE: Searching for input: 349  
[TensorRT] VERBOSE: Searching for input: 350  
[TensorRT] VERBOSE: Concat\_54 [Concat] inputs: [349 → (1)], [350 → (1)],  
[TensorRT] VERBOSE: Registering layer: Concat\_54 for ONNX node: Concat\_54  
[TensorRT] VERBOSE: Registering tensor: 351 for ONNX tensor: 351  
[TensorRT] VERBOSE: Concat\_54 [Concat] outputs: [351 → (2)],  
[TensorRT] VERBOSE: Parsing node: Shape\_55 [Shape]  
[TensorRT] VERBOSE: Searching for input: 332  
[TensorRT] VERBOSE: Shape\_55 [Shape] inputs: [332 → (1, 3, 300, 400)],  
[TensorRT] VERBOSE: Registering layer: Shape\_55 for ONNX node: Shape\_55  
[TensorRT] VERBOSE: Registering tensor: 352 for ONNX tensor: 352  
[TensorRT] VERBOSE: Shape\_55 [Shape] outputs: [352 → (4)],  
[TensorRT] VERBOSE: Parsing node: Constant\_56 [Constant]  
[TensorRT] VERBOSE: Constant\_56 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_56 [Constant] outputs: [353 → (1)],  
[TensorRT] VERBOSE: Parsing node: Constant\_57 [Constant]  
[TensorRT] VERBOSE: Constant\_57 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_57 [Constant] outputs: [354 → (1)],  
[TensorRT] VERBOSE: Parsing node: Constant\_58 [Constant]  
[TensorRT] VERBOSE: Constant\_58 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_58 [Constant] outputs: [355 → (1)],  
[TensorRT] VERBOSE: Parsing node: Slice\_59 [Slice]  
[TensorRT] VERBOSE: Searching for input: 352  
[TensorRT] VERBOSE: Searching for input: 354  
[TensorRT] VERBOSE: Searching for input: 355  
[TensorRT] VERBOSE: Searching for input: 353  
[TensorRT] VERBOSE: Slice\_59 [Slice] inputs: [352 → (4)], [354 → (1)], [355 → (1)], [353 → (1)],  
[TensorRT] VERBOSE: Registering layer: Slice\_59 for ONNX node: Slice\_59  
[TensorRT] VERBOSE: Registering tensor: 356 for ONNX tensor: 356  
[TensorRT] VERBOSE: Slice\_59 [Slice] outputs: [356 → (2)],  
[TensorRT] VERBOSE: Parsing node: Cast\_60 [Cast]  
[TensorRT] VERBOSE: Searching for input: 351  
[TensorRT] VERBOSE: Cast\_60 [Cast] inputs: [351 → (2)],  
[TensorRT] VERBOSE: Casting to type: int32  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] VERBOSE: Registering layer: Cast\_60 for ONNX node: Cast\_60  
[TensorRT] VERBOSE: Registering tensor: 357 for ONNX tensor: 357  
[TensorRT] VERBOSE: Cast\_60 [Cast] outputs: [357 → (2)],  
[TensorRT] VERBOSE: Parsing node: Concat\_61 [Concat]  
[TensorRT] VERBOSE: Searching for input: 356  
[TensorRT] VERBOSE: Searching for input: 357  
[TensorRT] VERBOSE: Concat\_61 [Concat] inputs: [356 → (2)], [357 → (2)],  
[TensorRT] VERBOSE: Registering layer: Concat\_61 for ONNX node: Concat\_61  
[TensorRT] VERBOSE: Registering tensor: 358 for ONNX tensor: 358  
[TensorRT] VERBOSE: Concat\_61 [Concat] outputs: [358 → (4)],  
[TensorRT] VERBOSE: Parsing node: Constant\_62 [Constant]  
[TensorRT] VERBOSE: Constant\_62 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_62 [Constant] outputs: [359 → ()],  
[TensorRT] VERBOSE: Parsing node: Constant\_63 [Constant]  
[TensorRT] VERBOSE: Constant\_63 [Constant] inputs:  
[TensorRT] VERBOSE: Constant\_63 [Constant] outputs: [360 → ()],  
[TensorRT] VERBOSE: Parsing node: Resize\_64 [Resize]  
[TensorRT] VERBOSE: Searching for input: 332  
[TensorRT] VERBOSE: Searching for input: 359  
[TensorRT] VERBOSE: Searching for input: 360  
[TensorRT] VERBOSE: Searching for input: 358  
[TensorRT] VERBOSE: Resize\_64 [Resize] inputs: [332 → (1, 3, 300, 400)], [359 → ()], [360 → ()], [358 → (4)],  
[TensorRT] VERBOSE: Registering layer: Resize\_64 for ONNX node: Resize\_64  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchor\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchorRect\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::NMS\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Reorg\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Region\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Clip\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::LReLU\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::PriorBox\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Normalize\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::ScatterND version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::RPROI\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMS\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMSDynamic\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::FlattenConcat\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::CropAndResize version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::DetectionLayer\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Proposal version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::ProposalLayer\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::PyramidROIAlign\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::ResizeNearest\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::Split version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::SpecialSlice\_TRT version 1  
[TensorRT] VERBOSE: Plugin creator already registered - ::InstanceNormalization\_TRT version 1  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510] Error Code 9: Internal Error (Floor\_51: IUnaryLayer cannot be used to compute a shape tensor)  
[TensorRT] INFO: [MemUsageSnapshot] Builder begin: CPU 1168 MiB, GPU 1065 MiB  
[TensorRT] ERROR: 4: [network.cpp::validate::2361] Error Code 4: Internal Error (Network must have at least one output)  
Traceback (most recent call last):  
File “/home/stefan/dev/co/object-detection-tests/FasterRCNN/detection\_test.py”, line 120, in   
run\_test()  
File “/home/stefan/dev/co/object-detection-tests/FasterRCNN/detection\_test.py”, line 59, in run\_test  
context = engine.create\_execution\_context()  
AttributeError: ‘NoneType’ object has no attribute ‘create\_execution\_context’

---

<div class="post-metadata">

**Author:** ![NVES](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/nves/32/14043_2.png) [@NVES](https://forums.developer.nvidia.com/u/NVES)\
**Post date:** [May 17, 2021, 8:07am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/2 "2021-05-17T08:07:59Z")

</div>

Hi,  
Please refer to the installation steps from the below link if in case you are missing on anything

> **[Installation Guide :: NVIDIA Deep Learning TensorRT Documentation](https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html)**
>
> This NVIDIA TensorRT 8.4.1 Installation Guide provides the installation requirements, a list of what is included in the TensorRT package, and step-by-step instructions for installing TensorRT.

However suggested approach is to use TRT NGC containers to avoid any system dependency related issues.

> **[TensorRT | NVIDIA NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/tensorrt)**
>
> NVIDIA TensorRT is a C++ library that facilitates high-performance inference on NVIDIA graphics processing units (GPUs). TensorRT takes a trained network and produces a highly optimized runtime engine that performs inference for that network.

In order to run python sample, make sure TRT python packages are installed while using NGC container.  
/opt/tensorrt/python/python\_setup.sh  
Thanks!

---

<div class="post-metadata">

**Author:** ![stefan.podg](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@stefan.podg](https://forums.developer.nvidia.com/u/stefan.podg)\
**Post date:** [May 18, 2021, 5:29am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/4 "2021-05-18T05:29:51Z")

</div>

Hi,

I did follow the pip wheel installation steps at: [Installation Guide :: NVIDIA Deep Learning TensorRT Documentation](https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html). I have followed them again today and end up with the same errors… I can run onnx inference without tensorrt in this environment.

I have now build a docker image based on the TRT NGC container which successfully runs the onnx network inference without tensorrt but still fails when I try to use tensorrt but now with an additional error including the original output.

**new traceback:**

2021-05-18 05:24:37.413057432 [W:onnxruntime:, graph.cc:3106 CleanUnusedInitializers] Removing initializer ‘2635’. It is not used by any node and should be removed from the model.  
2021-05-18 05:24:37.413078029 [W:onnxruntime:, graph.cc:3106 CleanUnusedInitializers] Removing initializer ‘2631’. It is not used by any node and should be removed from the model.  
2021-05-18 05:24:37.413084945 [W:onnxruntime:, graph.cc:3106 CleanUnusedInitializers] Removing initializer ‘3172’. It is not used by any node and should be removed from the model.  
2021-05-18 05:24:37.413088727 [W:onnxruntime:, graph.cc:3106 CleanUnusedInitializers] Removing initializer ‘3168’. It is not used by any node and should be removed from the model.  
2021-05-18 05:24:37.493622866 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_20  
2021-05-18 05:24:37.494897778 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_1207  
2021-05-18 05:24:37.494955293 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_1195  
2021-05-18 05:24:37.494979745 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_1183  
2021-05-18 05:24:37.495003054 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_1171  
2021-05-18 05:24:37.495027134 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceMin node name: ReduceMin\_1157  
2021-05-18 05:24:37.495162525 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceProd node name: ReduceProd\_1343  
2021-05-18 05:24:37.495705790 [W:onnxruntime:Default, cuda\_execution\_provider.cc:1983 GetCapability] CUDA kernel not found in registries for Op type: ReduceProd node name: ReduceProd\_1862  
2021-05-18 05:24:37.498113948 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_44  
2021-05-18 05:24:37.498123637 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_45  
2021-05-18 05:24:37.498133472 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_19  
2021-05-18 05:24:37.498138973 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: ReduceMax\_22  
2021-05-18 05:24:37.498143831 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_23  
2021-05-18 05:24:37.498149694 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_29  
2021-05-18 05:24:37.498155420 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_31  
2021-05-18 05:24:37.498164309 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_36  
2021-05-18 05:24:37.498169231 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_37  
2021-05-18 05:24:37.498179045 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_57  
2021-05-18 05:24:37.498187308 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_109  
2021-05-18 05:24:37.498193917 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_73  
2021-05-18 05:24:37.498198878 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_74  
2021-05-18 05:24:37.498203950 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_75  
2021-05-18 05:24:37.498209621 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_76  
2021-05-18 05:24:37.498213948 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: ReduceMax\_77  
2021-05-18 05:24:37.498218158 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_78  
2021-05-18 05:24:37.498222947 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Sub\_116  
2021-05-18 05:24:37.498227097 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_121  
2021-05-18 05:24:37.498232056 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_112  
2021-05-18 05:24:37.498236989 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_81  
2021-05-18 05:24:37.498241110 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_82  
2021-05-18 05:24:37.498245026 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_83  
2021-05-18 05:24:37.498249101 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_84  
2021-05-18 05:24:37.498253556 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: ReduceMax\_85  
2021-05-18 05:24:37.498257512 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_86  
2021-05-18 05:24:37.498261443 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_95  
2021-05-18 05:24:37.498266533 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_96  
2021-05-18 05:24:37.498270480 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Ceil\_97  
2021-05-18 05:24:37.498275799 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_99  
2021-05-18 05:24:37.498287958 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_100  
2021-05-18 05:24:37.498297264 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Sub\_117  
2021-05-18 05:24:37.498302736 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_120  
2021-05-18 05:24:37.498308813 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_115  
2021-05-18 05:24:37.498315087 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_89  
2021-05-18 05:24:37.498319965 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_90  
2021-05-18 05:24:37.498323913 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_91  
2021-05-18 05:24:37.498327870 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_92  
2021-05-18 05:24:37.498332996 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: ReduceMax\_93  
2021-05-18 05:24:37.498338134 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_94  
2021-05-18 05:24:37.498343315 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_101  
2021-05-18 05:24:37.498349462 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_102  
2021-05-18 05:24:37.498354442 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Ceil\_103  
2021-05-18 05:24:37.498360524 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_105  
2021-05-18 05:24:37.498365366 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_106  
2021-05-18 05:24:37.498370949 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Sub\_118  
2021-05-18 05:24:37.498375890 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_119  
2021-05-18 05:24:37.498385607 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_126  
2021-05-18 05:24:37.498392103 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_133  
2021-05-18 05:24:37.498398733 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_135  
2021-05-18 05:24:37.498407798 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_140  
2021-05-18 05:24:37.498412695 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Transpose\_141  
2021-05-18 05:24:37.498418256 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_143  
2021-05-18 05:24:37.498426203 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_495  
2021-05-18 05:24:37.498433004 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_489  
2021-05-18 05:24:37.498439288 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_531  
2021-05-18 05:24:37.498444474 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_697  
2021-05-18 05:24:37.498449389 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_695  
2021-05-18 05:24:37.498460862 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_498  
2021-05-18 05:24:37.498467760 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_492  
2021-05-18 05:24:37.498474095 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_535  
2021-05-18 05:24:37.498479716 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_693  
2021-05-18 05:24:37.498484765 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_691  
2021-05-18 05:24:37.498494028 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_705  
2021-05-18 05:24:37.498502454 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_483  
2021-05-18 05:24:37.498508610 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_523  
2021-05-18 05:24:37.498513279 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_659  
2021-05-18 05:24:37.498518318 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_657  
2021-05-18 05:24:37.498527634 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_486  
2021-05-18 05:24:37.498533507 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_527  
2021-05-18 05:24:37.498538493 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_655  
2021-05-18 05:24:37.498543489 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_653  
2021-05-18 05:24:37.498552310 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_667  
2021-05-18 05:24:37.498562316 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_390  
2021-05-18 05:24:37.498568926 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_382  
2021-05-18 05:24:37.498574083 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_384  
2021-05-18 05:24:37.498579836 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_379  
2021-05-18 05:24:37.498584679 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_383  
2021-05-18 05:24:37.498590763 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_385  
2021-05-18 05:24:37.498597782 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_392  
2021-05-18 05:24:37.498605311 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_477  
2021-05-18 05:24:37.498611288 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_515  
2021-05-18 05:24:37.498616602 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_621  
2021-05-18 05:24:37.498621276 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_619  
2021-05-18 05:24:37.498630830 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_480  
2021-05-18 05:24:37.498637034 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_519  
2021-05-18 05:24:37.498641266 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_617  
2021-05-18 05:24:37.498646264 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_615  
2021-05-18 05:24:37.498655194 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_629  
2021-05-18 05:24:37.498665463 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_412  
2021-05-18 05:24:37.498670758 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_404  
2021-05-18 05:24:37.498674802 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_406  
2021-05-18 05:24:37.498679893 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_401  
2021-05-18 05:24:37.498683994 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_405  
2021-05-18 05:24:37.498688924 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_407  
2021-05-18 05:24:37.498693980 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_414  
2021-05-18 05:24:37.498700844 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_471  
2021-05-18 05:24:37.498705657 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_507  
2021-05-18 05:24:37.498709684 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_583  
2021-05-18 05:24:37.498713742 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_581  
2021-05-18 05:24:37.498724229 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_474  
2021-05-18 05:24:37.498729286 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_511  
2021-05-18 05:24:37.498734693 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_579  
2021-05-18 05:24:37.498739508 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_577  
2021-05-18 05:24:37.498748171 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_591  
2021-05-18 05:24:37.498758268 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Slice\_434  
2021-05-18 05:24:37.498764296 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_426  
2021-05-18 05:24:37.498769094 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_428  
2021-05-18 05:24:37.498774872 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_423  
2021-05-18 05:24:37.498779577 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_427  
2021-05-18 05:24:37.498785254 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_429  
2021-05-18 05:24:37.498791269 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_436  
2021-05-18 05:24:37.498798573 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_465  
2021-05-18 05:24:37.498804368 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_499  
2021-05-18 05:24:37.498809403 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_545  
2021-05-18 05:24:37.498814093 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_543  
2021-05-18 05:24:37.498823450 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_468  
2021-05-18 05:24:37.498829206 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_503  
2021-05-18 05:24:37.498834495 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_541  
2021-05-18 05:24:37.498839303 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_539  
2021-05-18 05:24:37.498848273 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_553  
2021-05-18 05:24:37.498856878 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1012  
2021-05-18 05:24:37.498862937 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1015  
2021-05-18 05:24:37.498867797 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1102  
2021-05-18 05:24:37.498875448 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1103  
2021-05-18 05:24:37.498881323 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1017  
2021-05-18 05:24:37.498887717 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_965  
2021-05-18 05:24:37.498894525 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1002  
2021-05-18 05:24:37.498901855 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1003  
2021-05-18 05:24:37.498907807 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_974  
2021-05-18 05:24:37.498912654 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_998  
2021-05-18 05:24:37.498918614 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_971  
2021-05-18 05:24:37.498923603 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_997  
2021-05-18 05:24:37.498932662 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_999  
2021-05-18 05:24:37.498940816 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_923  
2021-05-18 05:24:37.498945266 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_960  
2021-05-18 05:24:37.498951810 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_961  
2021-05-18 05:24:37.498956952 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_932  
2021-05-18 05:24:37.498960930 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_956  
2021-05-18 05:24:37.498966141 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_929  
2021-05-18 05:24:37.498970406 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_955  
2021-05-18 05:24:37.498978207 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_957  
2021-05-18 05:24:37.498986592 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_881  
2021-05-18 05:24:37.498991181 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_918  
2021-05-18 05:24:37.498997666 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_919  
2021-05-18 05:24:37.499003934 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_890  
2021-05-18 05:24:37.499008078 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_914  
2021-05-18 05:24:37.499013142 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_887  
2021-05-18 05:24:37.499018163 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_913  
2021-05-18 05:24:37.499026299 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_915  
2021-05-18 05:24:37.499033575 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_839  
2021-05-18 05:24:37.499038649 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_876  
2021-05-18 05:24:37.499045832 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_877  
2021-05-18 05:24:37.499052081 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_848  
2021-05-18 05:24:37.499056985 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_872  
2021-05-18 05:24:37.499062266 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_845  
2021-05-18 05:24:37.499066340 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_871  
2021-05-18 05:24:37.499075064 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_873  
2021-05-18 05:24:37.499082392 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_797  
2021-05-18 05:24:37.499088062 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_834  
2021-05-18 05:24:37.499095386 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_835  
2021-05-18 05:24:37.499101199 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_806  
2021-05-18 05:24:37.499106169 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_830  
2021-05-18 05:24:37.499112275 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_803  
2021-05-18 05:24:37.499117228 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_829  
2021-05-18 05:24:37.499125929 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_831  
2021-05-18 05:24:37.499136450 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1248  
2021-05-18 05:24:37.499142299 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1109  
2021-05-18 05:24:37.499151270 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_737  
2021-05-18 05:24:37.499157640 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_734  
2021-05-18 05:24:37.499164045 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_785  
2021-05-18 05:24:37.499170282 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_740  
2021-05-18 05:24:37.499176449 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_786  
2021-05-18 05:24:37.499181567 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1133  
2021-05-18 05:24:37.499187684 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1141  
2021-05-18 05:24:37.499194277 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_748  
2021-05-18 05:24:37.499200599 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_745  
2021-05-18 05:24:37.499206415 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_787  
2021-05-18 05:24:37.499212552 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_751  
2021-05-18 05:24:37.499218623 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_788  
2021-05-18 05:24:37.499223708 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1134  
2021-05-18 05:24:37.499229075 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1143  
2021-05-18 05:24:37.499235148 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_759  
2021-05-18 05:24:37.499240604 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_756  
2021-05-18 05:24:37.499246905 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_789  
2021-05-18 05:24:37.499252456 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_762  
2021-05-18 05:24:37.499258807 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_790  
2021-05-18 05:24:37.499263892 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1135  
2021-05-18 05:24:37.499273156 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1145  
2021-05-18 05:24:37.499279461 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_770  
2021-05-18 05:24:37.499285635 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_767  
2021-05-18 05:24:37.499291795 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_791  
2021-05-18 05:24:37.499298081 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_773  
2021-05-18 05:24:37.499304063 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_792  
2021-05-18 05:24:37.499309317 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1136  
2021-05-18 05:24:37.499315632 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1147  
2021-05-18 05:24:37.499321885 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_781  
2021-05-18 05:24:37.499328466 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_778  
2021-05-18 05:24:37.499334422 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_793  
2021-05-18 05:24:37.499341107 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_784  
2021-05-18 05:24:37.499346936 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Mul\_794  
2021-05-18 05:24:37.499352667 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1137  
2021-05-18 05:24:37.499358378 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1149  
2021-05-18 05:24:37.499362849 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1110  
2021-05-18 05:24:37.499372403 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1111  
2021-05-18 05:24:37.499378793 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_977  
2021-05-18 05:24:37.499385380 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_979  
2021-05-18 05:24:37.499391564 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_968  
2021-05-18 05:24:37.499397711 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_982  
2021-05-18 05:24:37.499402755 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_993  
2021-05-18 05:24:37.499409792 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_994  
2021-05-18 05:24:37.499418878 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_989  
2021-05-18 05:24:37.499427438 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_935  
2021-05-18 05:24:37.499434070 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_937  
2021-05-18 05:24:37.499439971 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_926  
2021-05-18 05:24:37.499446055 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_940  
2021-05-18 05:24:37.499451480 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_951  
2021-05-18 05:24:37.499458481 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_952  
2021-05-18 05:24:37.499467034 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_947  
2021-05-18 05:24:37.499475847 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_893  
2021-05-18 05:24:37.499482233 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_895  
2021-05-18 05:24:37.499487529 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_884  
2021-05-18 05:24:37.499492613 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_898  
2021-05-18 05:24:37.499496737 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_909  
2021-05-18 05:24:37.499503098 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_910  
2021-05-18 05:24:37.499511551 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_905  
2021-05-18 05:24:37.499520016 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_851  
2021-05-18 05:24:37.499525778 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_853  
2021-05-18 05:24:37.499531542 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_842  
2021-05-18 05:24:37.499537271 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_856  
2021-05-18 05:24:37.499542201 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_867  
2021-05-18 05:24:37.499549004 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_868  
2021-05-18 05:24:37.499557452 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_863  
2021-05-18 05:24:37.499566562 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_809  
2021-05-18 05:24:37.499572626 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_811  
2021-05-18 05:24:37.499578847 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_800  
2021-05-18 05:24:37.499584919 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_814  
2021-05-18 05:24:37.499590309 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_825  
2021-05-18 05:24:37.499597517 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_826  
2021-05-18 05:24:37.499606280 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_821  
2021-05-18 05:24:37.499616833 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1203  
2021-05-18 05:24:37.499622309 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1204  
2021-05-18 05:24:37.499627732 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1206  
2021-05-18 05:24:37.499635988 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1191  
2021-05-18 05:24:37.499640998 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1192  
2021-05-18 05:24:37.499648142 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1179  
2021-05-18 05:24:37.499653190 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1180  
2021-05-18 05:24:37.499660612 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1167  
2021-05-18 05:24:37.499665489 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1168  
2021-05-18 05:24:37.499671877 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1153  
2021-05-18 05:24:37.499676877 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1154  
2021-05-18 05:24:37.499683133 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1164  
2021-05-18 05:24:37.499688526 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1176  
2021-05-18 05:24:37.499694364 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1188  
2021-05-18 05:24:37.499700075 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1200  
2021-05-18 05:24:37.499707258 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1194  
2021-05-18 05:24:37.499714682 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1182  
2021-05-18 05:24:37.499725605 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1170  
2021-05-18 05:24:37.499733489 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1156  
2021-05-18 05:24:37.499740193 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1250  
2021-05-18 05:24:37.499745983 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1259  
2021-05-18 05:24:37.499752594 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1257  
2021-05-18 05:24:37.499760720 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1294  
2021-05-18 05:24:37.499766004 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1296  
2021-05-18 05:24:37.499772276 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1291  
2021-05-18 05:24:37.499777170 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1295  
2021-05-18 05:24:37.499782839 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1297  
2021-05-18 05:24:37.499788822 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_67  
2021-05-18 05:24:37.499793801 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_1284  
2021-05-18 05:24:37.499801201 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_70  
2021-05-18 05:24:37.499806365 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_1280  
2021-05-18 05:24:37.499814848 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1222  
2021-05-18 05:24:37.499821328 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1229  
2021-05-18 05:24:37.499827413 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1126  
2021-05-18 05:24:37.499833178 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1123  
2021-05-18 05:24:37.499838965 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1120  
2021-05-18 05:24:37.499844766 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1117  
2021-05-18 05:24:37.499850684 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1114  
2021-05-18 05:24:37.499858280 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1235  
2021-05-18 05:24:37.499864929 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1242  
2021-05-18 05:24:37.499872331 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1646  
2021-05-18 05:24:37.499876766 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1749  
2021-05-18 05:24:37.499882291 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1753  
2021-05-18 05:24:37.499888659 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1617  
2021-05-18 05:24:37.499893035 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1621  
2021-05-18 05:24:37.499898184 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1614  
2021-05-18 05:24:37.499902150 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1620  
2021-05-18 05:24:37.499907832 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1611  
2021-05-18 05:24:37.499912914 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1619  
2021-05-18 05:24:37.499918731 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1608  
2021-05-18 05:24:37.499923581 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1618  
2021-05-18 05:24:37.499930989 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1622  
2021-05-18 05:24:37.499937192 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1624  
2021-05-18 05:24:37.499943271 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1629  
2021-05-18 05:24:37.499949969 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1630  
2021-05-18 05:24:37.499957366 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1582  
2021-05-18 05:24:37.499962766 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1586  
2021-05-18 05:24:37.499968149 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1579  
2021-05-18 05:24:37.499972178 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1585  
2021-05-18 05:24:37.499977274 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1576  
2021-05-18 05:24:37.499981409 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1584  
2021-05-18 05:24:37.499986741 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1573  
2021-05-18 05:24:37.499990903 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1583  
2021-05-18 05:24:37.499997405 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1587  
2021-05-18 05:24:37.500003659 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1589  
2021-05-18 05:24:37.500009685 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1594  
2021-05-18 05:24:37.500016463 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1595  
2021-05-18 05:24:37.500023446 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1547  
2021-05-18 05:24:37.500028366 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1551  
2021-05-18 05:24:37.500033685 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1544  
2021-05-18 05:24:37.500037934 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1550  
2021-05-18 05:24:37.500043236 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1541  
2021-05-18 05:24:37.500047555 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1549  
2021-05-18 05:24:37.500052671 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1538  
2021-05-18 05:24:37.500056710 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1548  
2021-05-18 05:24:37.500063353 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1552  
2021-05-18 05:24:37.500068865 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1554  
2021-05-18 05:24:37.500074318 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1559  
2021-05-18 05:24:37.500080188 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1560  
2021-05-18 05:24:37.500087048 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1512  
2021-05-18 05:24:37.500091437 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1516  
2021-05-18 05:24:37.500096742 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1509  
2021-05-18 05:24:37.500100833 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1515  
2021-05-18 05:24:37.500105898 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1506  
2021-05-18 05:24:37.500110098 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1514  
2021-05-18 05:24:37.500115254 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1503  
2021-05-18 05:24:37.500119166 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1513  
2021-05-18 05:24:37.500126126 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1517  
2021-05-18 05:24:37.500131810 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Reshape\_1519  
2021-05-18 05:24:37.500136939 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Equal\_1524  
2021-05-18 05:24:37.500143849 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Where\_1525  
2021-05-18 05:24:37.500150077 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1486  
2021-05-18 05:24:37.500154187 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1490  
2021-05-18 05:24:37.500159558 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1483  
2021-05-18 05:24:37.500163933 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1489  
2021-05-18 05:24:37.500170311 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1480  
2021-05-18 05:24:37.500174786 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1488  
2021-05-18 05:24:37.500180164 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1477  
2021-05-18 05:24:37.500184259 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1487  
2021-05-18 05:24:37.500191062 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1491  
2021-05-18 05:24:37.500198767 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1747  
2021-05-18 05:24:37.500204258 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1649  
2021-05-18 05:24:37.500209420 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Add\_1652  
2021-05-18 05:24:37.500213782 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1739  
2021-05-18 05:24:37.500220155 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1740  
2021-05-18 05:24:37.500225530 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1654  
2021-05-18 05:24:37.500234020 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1784  
2021-05-18 05:24:37.500238005 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1787  
2021-05-18 05:24:37.500243242 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1781  
2021-05-18 05:24:37.500247392 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1786  
2021-05-18 05:24:37.500252260 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1778  
2021-05-18 05:24:37.500256505 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Unsqueeze\_1785  
2021-05-18 05:24:37.500262111 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Concat\_1788  
2021-05-18 05:24:37.500271236 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_1643  
2021-05-18 05:24:37.500279962 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_4  
2021-05-18 05:24:37.500285166 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_1897  
2021-05-18 05:24:37.500291791 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_1899  
2021-05-18 05:24:37.500299376 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Gather\_7  
2021-05-18 05:24:37.500304467 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Cast\_1900  
2021-05-18 05:24:37.500310491 [W:onnxruntime:Default, fallback\_cpu\_capability.cc:135 GetCpuPreferredNodes] Force fallback to CPU execution for node: Div\_1902  
[TensorRT] WARNING: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:227: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.  
[TensorRT] WARNING: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:255: One or more weights outside the range of INT32 was clamped  
[TensorRT] WARNING: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:255: One or more weights outside the range of INT32 was clamped  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
**[TensorRT] ERROR: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:500: Found unsupported shape tensor producing layer: Floor\_41**  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
**[TensorRT] ERROR: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:500: Found unsupported shape tensor producing layer: Floor\_49**  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
[TensorRT] WARNING: Tensor DataType is determined at build time for tensors not marked as input or output.  
**[TensorRT] ERROR: Network must have at least one output**  
**[TensorRT] ERROR: Network validation failed.**\*  
Traceback (most recent call last):  
File “detection\_test.py”, line 120, in   
run\_test()  
File “detection\_test.py”, line 59, in run\_test  
context = engine.create\_execution\_context()  
AttributeError: ‘NoneType’ object has no attribute ‘create\_execution\_context’

---

<div class="post-metadata">

**Author:** ![spolisetty](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/spolisetty/32/14047_2.png) [@spolisetty](https://forums.developer.nvidia.com/u/spolisetty)\
**Post date:** [May 18, 2021, 8:03am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/5 "2021-05-18T08:03:54Z")

</div>

Hi @stefan.podg,

Could you please share us trtexec command you’ve tried and ONNX model (looks like link in description broken) to try from our end for better assistance.

Thank you.

---

<div class="post-metadata">

**Author:** ![stefan.podg](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@stefan.podg](https://forums.developer.nvidia.com/u/stefan.podg)\
**Post date:** [May 18, 2021, 8:11am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/6 "2021-05-18T08:11:57Z")

</div>

Hi @spolisetty,

Thanks for getting back to me.

I have regenerated the link to the ONNX (not sure what happened there)

[new faster-rcnn onnx](https://www.dropbox.com/s/7n8u4g5m6iuox42/faster_rcnn.onnx?dl=0)

And here is the code that I use to try to build the engine - I have not used trtexec (wasn’t aware of it):

```auto
def build_engine(model_path) -> trt.ICudaEngine:
    explicit_batch = 1 << (int)(trt.NetworkDefinitionCreationFlag.EXPLICIT_BATCH)
    with trt.Builder(TRT_LOGGER) as builder, \
            builder.create_network(explicit_batch) as network, \
            trt.OnnxParser(network, TRT_LOGGER) as parser:
            builder_config = builder.create_builder_config()
            builder_config.max_workspace_size = 1 << 20
            builder.max_batch_size = 1
            with open(model_path, "rb") as model:
                parser.parse(model.read())
                if not parser.parse(model.read()):
                    print('ERROR: Failed to parse the ONNX file.')
                    for error in range(parser.num_errors):
                        print(parser.get_error(error))
            last_layer = network.get_layer(network.num_layers - 1)
            # Check if last layer recognizes it's output
            if not last_layer.get_output(0):
                # If not, then mark the output using TensorRT API
                network.mark_output(last_layer.get_output(0))
            engine = builder.build_engine(network, builder_config)
            return engine

engine = trt.build_engine(onnx_path)
context = engine.create_execution_context()

```

---

<div class="post-metadata">

**Author:** ![stefan.podg](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@stefan.podg](https://forums.developer.nvidia.com/u/stefan.podg)\
**Post date:** [May 19, 2021, 12:07am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/7 "2021-05-19T00:07:44Z")

</div>

Hi @spolisetty @NVES

For reference the onnx is built from: [[torchvision.models.detection.faster\_rcnn — Torchvision 0.16 documentation](https://pytorch.org/vision/stable/_modules/torchvision/models/detection/faster_rcnn.html#fasterrcnn_resnet50_fpn)]([https://torchvision](https://torchvision) faster-rcnn)

I ran trtexec in the trt container with the following command:

> trtexec --onnx=faster\_rcnn.onnx --verbose --saveEngine=fatser\_rcnn.trt

which again failed with the following traceback:

[05/18/2021-23:39:13] [I] === Model Options ===  
[05/18/2021-23:39:13] [I] Format: ONNX  
[05/18/2021-23:39:13] [I] Model: faster\_rcnn.onnx  
[05/18/2021-23:39:13] [I] Output:  
[05/18/2021-23:39:13] [I] === Build Options ===  
[05/18/2021-23:39:13] [I] Max batch: explicit  
[05/18/2021-23:39:13] [I] Workspace: 16 MiB  
[05/18/2021-23:39:13] [I] minTiming: 1  
[05/18/2021-23:39:13] [I] avgTiming: 8  
[05/18/2021-23:39:13] [I] Precision: FP32  
[05/18/2021-23:39:13] [I] Calibration:  
[05/18/2021-23:39:13] [I] Refit: Disabled  
[05/18/2021-23:39:13] [I] Safe mode: Disabled  
[05/18/2021-23:39:13] [I] Save engine: fatser\_rcnn.trt  
[05/18/2021-23:39:13] [I] Load engine:  
[05/18/2021-23:39:13] [I] Builder Cache: Enabled  
[05/18/2021-23:39:13] [I] NVTX verbosity: 0  
[05/18/2021-23:39:13] [I] Tactic sources: Using default tactic sources  
[05/18/2021-23:39:13] [I] Input(s)s format: fp32:CHW  
[05/18/2021-23:39:13] [I] Output(s)s format: fp32:CHW  
[05/18/2021-23:39:13] [I] Input build shapes: model  
[05/18/2021-23:39:13] [I] Input calibration shapes: model  
[05/18/2021-23:39:13] [I] === System Options ===  
[05/18/2021-23:39:13] [I] Device: 0  
[05/18/2021-23:39:13] [I] DLACore:  
[05/18/2021-23:39:13] [I] Plugins:  
[05/18/2021-23:39:13] [I] === Inference Options ===  
[05/18/2021-23:39:13] [I] Batch: Explicit  
[05/18/2021-23:39:13] [I] Input inference shapes: model  
[05/18/2021-23:39:13] [I] Iterations: 10  
[05/18/2021-23:39:13] [I] Duration: 3s (+ 200ms warm up)  
[05/18/2021-23:39:13] [I] Sleep time: 0ms  
[05/18/2021-23:39:13] [I] Streams: 1  
[05/18/2021-23:39:13] [I] ExposeDMA: Disabled  
[05/18/2021-23:39:13] [I] Data transfers: Enabled  
[05/18/2021-23:39:13] [I] Spin-wait: Disabled  
[05/18/2021-23:39:13] [I] Multithreading: Disabled  
[05/18/2021-23:39:13] [I] CUDA Graph: Disabled  
[05/18/2021-23:39:13] [I] Separate profiling: Disabled  
[05/18/2021-23:39:13] [I] Skip inference: Disabled  
[05/18/2021-23:39:13] [I] Inputs:  
[05/18/2021-23:39:13] [I] === Reporting Options ===  
[05/18/2021-23:39:13] [I] Verbose: Enabled  
[05/18/2021-23:39:13] [I] Averages: 10 inferences  
[05/18/2021-23:39:13] [I] Percentile: 99  
[05/18/2021-23:39:13] [I] Dump refittable layers:Disabled  
[05/18/2021-23:39:13] [I] Dump output: Disabled  
[05/18/2021-23:39:13] [I] Profile: Disabled  
[05/18/2021-23:39:13] [I] Export timing to JSON file:  
[05/18/2021-23:39:13] [I] Export output to JSON file:  
[05/18/2021-23:39:13] [I] Export profile to JSON file:  
[05/18/2021-23:39:13] [I]  
[05/18/2021-23:39:13] [I] === Device Information ===  
[05/18/2021-23:39:13] [I] Selected Device: NVIDIA GeForce RTX 2080 Ti  
[05/18/2021-23:39:13] [I] Compute Capability: 7.5  
[05/18/2021-23:39:13] [I] SMs: 68  
[05/18/2021-23:39:13] [I] Compute Clock Rate: 1.65 GHz  
[05/18/2021-23:39:13] [I] Device Global Memory: 11016 MiB  
[05/18/2021-23:39:13] [I] Shared Memory per SM: 64 KiB  
[05/18/2021-23:39:13] [I] Memory Bus Width: 352 bits (ECC disabled)  
[05/18/2021-23:39:13] [I] Memory Clock Rate: 7 GHz  
[05/18/2021-23:39:13] [I]  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::BatchTilePlugin\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::BatchedNMS\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::CropAndResize version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::DetectionLayer\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::FlattenConcat\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::GenerateDetection\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::GridAnchor\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::GridAnchorRect\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::InstanceNormalization\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::LReLU\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::NMS\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::NMSDynamic\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::Normalize\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::PriorBox\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::ProposalLayer\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::Proposal version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::PyramidROIAlign\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::Region\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::Reorg\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::ResizeNearest\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::RPROI\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::SpecialSlice\_TRT version 1  
[05/18/2021-23:39:13] [V] [TRT] Registered plugin creator - ::Split version 1  
[05/18/2021-23:39:22] [I] [TRT] ----------------------------------------------------------------  
[05/18/2021-23:39:22] [I] [TRT] Input filename: faster\_rcnn.onnx  
[05/18/2021-23:39:22] [I] [TRT] ONNX IR version: 0.0.6  
[05/18/2021-23:39:22] [I] [TRT] Opset version: 11  
[05/18/2021-23:39:22] [I] [TRT] Producer name: pytorch  
[05/18/2021-23:39:22] [I] [TRT] Producer version: 1.8  
[05/18/2021-23:39:22] [I] [TRT] Domain:  
[05/18/2021-23:39:22] [I] [TRT] Model version: 0  
[05/18/2021-23:39:22] [I] [TRT] Doc string:  
[05/18/2021-23:39:22] [I] [TRT] ----------------------------------------------------------------  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::BatchedNMS\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::DetectionLayer\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::FlattenConcat\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::GenerateDetection\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::GridAnchor\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::GridAnchorRect\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::InstanceNormalization\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::LReLU\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::NMS\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::NMSDynamic\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::Normalize\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::PriorBox\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::ProposalLayer\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::Proposal version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::Region\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::Reorg\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::ResizeNearest\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::RPROI\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::SpecialSlice\_TRT version 1  
[05/18/2021-23:39:22] [V] [TRT] Plugin creator already registered - ::Split version 1  
[05/18/2021-23:39:22] [V] [TRT] Adding network input: input with dtype: float32, dimensions: (1, -1, -1, 640)  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: input for ONNX tensor: input  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.downsample.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.downsample.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.downsample.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.downsample.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.0.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.1.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.2.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.inner\_blocks.3.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.0.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.0.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.1.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.1.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.2.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.2.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.3.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.backbone.fpn.layer\_blocks.3.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.conv.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.conv.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.cls\_logits.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.cls\_logits.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.bbox\_pred.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.rpn.head.bbox\_pred.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_head.fc6.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_head.fc6.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_head.fc7.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_head.fc7.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_predictor.cls\_score.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_predictor.cls\_score.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_predictor.bbox\_pred.weight  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: model.roi\_heads.box\_predictor.bbox\_pred.bias  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3221  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3222  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3223  
[05/18/2021-23:39:22] [W] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:227: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3224  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3225  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3226  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3227  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3228  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3229  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3237  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3239  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3247  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3249  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3257  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3259  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3267  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3269  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3277  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3279  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3287  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3289  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3297  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3299  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3307  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3309  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3317  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3319  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3327  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3329  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3337  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3339  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3347  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3349  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3357  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3359  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3367  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3369  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3377  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3379  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3387  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3389  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3397  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3399  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3407  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3409  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3417  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3419  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3427  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3429  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3437  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3439  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3447  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3449  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3457  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3459  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3467  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3469  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3477  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3479  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3487  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3489  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3497  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3499  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3507  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3509  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3517  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3519  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3527  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3529  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3537  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3539  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3547  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3549  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3557  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3559  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3567  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3569  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3577  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3579  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3587  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3589  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3597  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3599  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3607  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3609  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3617  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3619  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3627  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3629  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3637  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3639  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3647  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3649  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3657  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3659  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3667  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3669  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3677  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3679  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3687  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3689  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3697  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3699  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3707  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3709  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3717  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3719  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3727  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3729  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3737  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3739  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3747  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3749  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3757  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3759  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3760  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3761  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3762  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3763  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3764  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3765  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3766  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3767  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3768  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3769  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3770  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3771  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3772  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3773  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3774  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3775  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3776  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3777  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3778  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3779  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3780  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3781  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3782  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3783  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3784  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3785  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3786  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3787  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3788  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3789  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3790  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3791  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3792  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3793  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3794  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3795  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3796  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3797  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3798  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3799  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3800  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3801  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3802  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3803  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3804  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3805  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3806  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3807  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3808  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3809  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3810  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3811  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3812  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3813  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3814  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3815  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3816  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3817  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3818  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3819  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3820  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3821  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3822  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3823  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3824  
[05/18/2021-23:39:22] [V] [TRT] Importing initializer: 3825  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Split\_0 [Split]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: input  
[05/18/2021-23:39:22] [V] [TRT] Split\_0 [Split] inputs: [input → (1, -1, -1, 640)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Split\_0 for ONNX node: Split\_0  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 296 for ONNX tensor: 296  
[05/18/2021-23:39:22] [V] [TRT] Split\_0 [Split] outputs: [296 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Squeeze\_1 [Squeeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 296  
[05/18/2021-23:39:22] [V] [TRT] Squeeze\_1 [Squeeze] inputs: [296 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (\_, \_, \_, _), squeezing to: (_, \_, _)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Squeeze\_1 for ONNX node: Squeeze\_1  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 297 for ONNX tensor: 297  
[05/18/2021-23:39:22] [V] [TRT] Squeeze\_1 [Squeeze] outputs: [297 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_2 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 297  
[05/18/2021-23:39:22] [V] [TRT] Shape\_2 [Shape] inputs: [297 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_2 for ONNX node: Shape\_2  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 298 for ONNX tensor: 298  
[05/18/2021-23:39:22] [V] [TRT] Shape\_2 [Shape] outputs: [298 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_3 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_3 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_3 [Constant] outputs: [299 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_4 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 298  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 299  
[05/18/2021-23:39:22] [V] [TRT] Gather\_4 [Gather] inputs: [298 → (3)], [299 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 299 for ONNX initializer: 299  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_4 for ONNX node: Gather\_4  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 300 for ONNX tensor: 300  
[05/18/2021-23:39:22] [V] [TRT] Gather\_4 [Gather] outputs: [300 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_5 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 297  
[05/18/2021-23:39:22] [V] [TRT] Shape\_5 [Shape] inputs: [297 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_5 for ONNX node: Shape\_5  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 301 for ONNX tensor: 301  
[05/18/2021-23:39:22] [V] [TRT] Shape\_5 [Shape] outputs: [301 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_6 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_6 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_6 [Constant] outputs: [302 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_7 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 301  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 302  
[05/18/2021-23:39:22] [V] [TRT] Gather\_7 [Gather] inputs: [301 → (3)], [302 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 302 for ONNX initializer: 302  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_7 for ONNX node: Gather\_7  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 303 for ONNX tensor: 303  
[05/18/2021-23:39:22] [V] [TRT] Gather\_7 [Gather] outputs: [303 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Split\_8 [Split]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: input  
[05/18/2021-23:39:22] [V] [TRT] Split\_8 [Split] inputs: [input → (1, -1, -1, 640)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Split\_8 for ONNX node: Split\_8  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 304 for ONNX tensor: 304  
[05/18/2021-23:39:22] [V] [TRT] Split\_8 [Split] outputs: [304 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Squeeze\_9 [Squeeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 304  
[05/18/2021-23:39:22] [V] [TRT] Squeeze\_9 [Squeeze] inputs: [304 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (_, \_, \_, _), squeezing to: (_, \_, \_)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Squeeze\_9 for ONNX node: Squeeze\_9  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 305 for ONNX tensor: 305  
[05/18/2021-23:39:22] [V] [TRT] Squeeze\_9 [Squeeze] outputs: [305 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_10 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_10 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_10 [Constant] outputs: [306 → (3, 1, 1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Sub\_11 [Sub]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 305  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 306  
[05/18/2021-23:39:22] [V] [TRT] Sub\_11 [Sub] inputs: [305 → (-1, -1, -1)], [306 → (3, 1, 1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 306 for ONNX initializer: 306  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Sub\_11 for ONNX node: Sub\_11  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 307 for ONNX tensor: 307  
[05/18/2021-23:39:22] [V] [TRT] Sub\_11 [Sub] outputs: [307 → (3, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_12 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_12 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_12 [Constant] outputs: [308 → (3, 1, 1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Div\_13 [Div]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 307  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 308  
[05/18/2021-23:39:22] [V] [TRT] Div\_13 [Div] inputs: [307 → (3, -1, -1)], [308 → (3, 1, 1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 308 for ONNX initializer: 308  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Div\_13 for ONNX node: Div\_13  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 309 for ONNX tensor: 309  
[05/18/2021-23:39:22] [V] [TRT] Div\_13 [Div] outputs: [309 → (3, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_14 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 309  
[05/18/2021-23:39:22] [V] [TRT] Shape\_14 [Shape] inputs: [309 → (3, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_14 for ONNX node: Shape\_14  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 310 for ONNX tensor: 310  
[05/18/2021-23:39:22] [V] [TRT] Shape\_14 [Shape] outputs: [310 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_15 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_15 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_15 [Constant] outputs: [311 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_16 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_16 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_16 [Constant] outputs: [312 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_17 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_17 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647  
[05/18/2021-23:39:22] [W] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:255: One or more weights outside the range of INT32 was clamped  
[05/18/2021-23:39:22] [V] [TRT] Constant\_17 [Constant] outputs: [313 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_18 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_18 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_18 [Constant] outputs: [314 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Slice\_19 [Slice]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 310  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 312  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 313  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 311  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 314  
[05/18/2021-23:39:22] [V] [TRT] Slice\_19 [Slice] inputs: [310 → (3)], [312 → (1)], [313 → (1)], [311 → (1)], [314 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Slice\_19 for ONNX node: Slice\_19  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 315 for ONNX tensor: 315  
[05/18/2021-23:39:22] [V] [TRT] Slice\_19 [Slice] outputs: [315 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ReduceMin\_20 [ReduceMin]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 315  
[05/18/2021-23:39:22] [V] [TRT] ReduceMin\_20 [ReduceMin] inputs: [315 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ReduceMin\_20 for ONNX node: ReduceMin\_20  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 316 for ONNX tensor: 316  
[05/18/2021-23:39:22] [V] [TRT] ReduceMin\_20 [ReduceMin] outputs: [316 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_21 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 316  
[05/18/2021-23:39:22] [V] [TRT] Cast\_21 [Cast] inputs: [316 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_21 for ONNX node: Cast\_21  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 317 for ONNX tensor: 317  
[05/18/2021-23:39:22] [V] [TRT] Cast\_21 [Cast] outputs: [317 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ReduceMax\_22 [ReduceMax]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 315  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_22 [ReduceMax] inputs: [315 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ReduceMax\_22 for ONNX node: ReduceMax\_22  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 318 for ONNX tensor: 318  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_22 [ReduceMax] outputs: [318 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_23 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 318  
[05/18/2021-23:39:22] [V] [TRT] Cast\_23 [Cast] inputs: [318 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_23 for ONNX node: Cast\_23  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 319 for ONNX tensor: 319  
[05/18/2021-23:39:22] [V] [TRT] Cast\_23 [Cast] outputs: [319 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_24 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_24 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_24 [Constant] outputs: [320 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Div\_25 [Div]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 320  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 317  
[05/18/2021-23:39:22] [V] [TRT] Div\_25 [Div] inputs: [320 → ()], [317 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 320 for ONNX initializer: 320  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Div\_25 for ONNX node: Div\_25  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 321 for ONNX tensor: 321  
[05/18/2021-23:39:22] [V] [TRT] Div\_25 [Div] outputs: [321 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_26 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_26 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_26 [Constant] outputs: [322 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_27 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 321  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 322  
[05/18/2021-23:39:22] [V] [TRT] Mul\_27 [Mul] inputs: [321 → ()], [322 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 322 for ONNX initializer: 322  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_27 for ONNX node: Mul\_27  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 323 for ONNX tensor: 323  
[05/18/2021-23:39:22] [V] [TRT] Mul\_27 [Mul] outputs: [323 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_28 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_28 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_28 [Constant] outputs: [324 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Div\_29 [Div]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 324  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 319  
[05/18/2021-23:39:22] [V] [TRT] Div\_29 [Div] inputs: [324 → ()], [319 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 324 for ONNX initializer: 324  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Div\_29 for ONNX node: Div\_29  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 325 for ONNX tensor: 325  
[05/18/2021-23:39:22] [V] [TRT] Div\_29 [Div] outputs: [325 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_30 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_30 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_30 [Constant] outputs: [326 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_31 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 325  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 326  
[05/18/2021-23:39:22] [V] [TRT] Mul\_31 [Mul] inputs: [325 → ()], [326 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 326 for ONNX initializer: 326  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_31 for ONNX node: Mul\_31  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 327 for ONNX tensor: 327  
[05/18/2021-23:39:22] [V] [TRT] Mul\_31 [Mul] outputs: [327 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Min\_32 [Min]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 323  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 327  
[05/18/2021-23:39:22] [V] [TRT] Min\_32 [Min] inputs: [323 → ()], [327 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Min\_32 for ONNX node: Min\_32  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 328 for ONNX tensor: 328  
[05/18/2021-23:39:22] [V] [TRT] Min\_32 [Min] outputs: [328 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_33 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 309  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_33 [Unsqueeze] inputs: [309 → (3, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (3, \_, _), unsqueezing to: (_, \_, \_, _)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_33 for ONNX node: Unsqueeze\_33  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 329 for ONNX tensor: 329  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_33 [Unsqueeze] outputs: [329 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_34 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 329  
[05/18/2021-23:39:22] [V] [TRT] Shape\_34 [Shape] inputs: [329 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_34 for ONNX node: Shape\_34  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 330 for ONNX tensor: 330  
[05/18/2021-23:39:22] [V] [TRT] Shape\_34 [Shape] outputs: [330 → (4)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_35 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_35 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_35 [Constant] outputs: [331 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_36 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 330  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 331  
[05/18/2021-23:39:22] [V] [TRT] Gather\_36 [Gather] inputs: [330 → (4)], [331 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 331 for ONNX initializer: 331  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_36 for ONNX node: Gather\_36  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 332 for ONNX tensor: 332  
[05/18/2021-23:39:22] [V] [TRT] Gather\_36 [Gather] outputs: [332 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_37 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 332  
[05/18/2021-23:39:22] [V] [TRT] Cast\_37 [Cast] inputs: [332 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_37 for ONNX node: Cast\_37  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 333 for ONNX tensor: 333  
[05/18/2021-23:39:22] [V] [TRT] Cast\_37 [Cast] outputs: [333 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_38 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 328  
[05/18/2021-23:39:22] [V] [TRT] Cast\_38 [Cast] inputs: [328 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_38 for ONNX node: Cast\_38  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 334 for ONNX tensor: 334  
[05/18/2021-23:39:22] [V] [TRT] Cast\_38 [Cast] outputs: [334 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_39 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 333  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 334  
[05/18/2021-23:39:22] [V] [TRT] Mul\_39 [Mul] inputs: [333 → ()], [334 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_39 for ONNX node: Mul\_39  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 335 for ONNX tensor: 335  
[05/18/2021-23:39:22] [V] [TRT] Mul\_39 [Mul] outputs: [335 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_40 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 335  
[05/18/2021-23:39:22] [V] [TRT] Cast\_40 [Cast] inputs: [335 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_40 for ONNX node: Cast\_40  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 336 for ONNX tensor: 336  
[05/18/2021-23:39:22] [V] [TRT] Cast\_40 [Cast] outputs: [336 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Floor\_41 [Floor]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 336  
[05/18/2021-23:39:22] [V] [TRT] Floor\_41 [Floor] inputs: [336 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Floor\_41 for ONNX node: Floor\_41  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (1,), squeezing to: ()  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 337 for ONNX tensor: 337  
[05/18/2021-23:39:22] [V] [TRT] Floor\_41 [Floor] outputs: [337 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_42 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 329  
[05/18/2021-23:39:22] [V] [TRT] Shape\_42 [Shape] inputs: [329 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_42 for ONNX node: Shape\_42  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 338 for ONNX tensor: 338  
[05/18/2021-23:39:22] [V] [TRT] Shape\_42 [Shape] outputs: [338 → (4)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_43 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_43 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_43 [Constant] outputs: [339 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_44 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 338  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 339  
[05/18/2021-23:39:22] [V] [TRT] Gather\_44 [Gather] inputs: [338 → (4)], [339 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 339 for ONNX initializer: 339  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_44 for ONNX node: Gather\_44  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 340 for ONNX tensor: 340  
[05/18/2021-23:39:22] [V] [TRT] Gather\_44 [Gather] outputs: [340 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_45 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 340  
[05/18/2021-23:39:22] [V] [TRT] Cast\_45 [Cast] inputs: [340 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_45 for ONNX node: Cast\_45  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 341 for ONNX tensor: 341  
[05/18/2021-23:39:22] [V] [TRT] Cast\_45 [Cast] outputs: [341 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_46 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 328  
[05/18/2021-23:39:22] [V] [TRT] Cast\_46 [Cast] inputs: [328 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_46 for ONNX node: Cast\_46  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 342 for ONNX tensor: 342  
[05/18/2021-23:39:22] [V] [TRT] Cast\_46 [Cast] outputs: [342 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_47 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 341  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 342  
[05/18/2021-23:39:22] [V] [TRT] Mul\_47 [Mul] inputs: [341 → ()], [342 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_47 for ONNX node: Mul\_47  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 343 for ONNX tensor: 343  
[05/18/2021-23:39:22] [V] [TRT] Mul\_47 [Mul] outputs: [343 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_48 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 343  
[05/18/2021-23:39:22] [V] [TRT] Cast\_48 [Cast] inputs: [343 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_48 for ONNX node: Cast\_48  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 344 for ONNX tensor: 344  
[05/18/2021-23:39:22] [V] [TRT] Cast\_48 [Cast] outputs: [344 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Floor\_49 [Floor]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 344  
[05/18/2021-23:39:22] [V] [TRT] Floor\_49 [Floor] inputs: [344 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Floor\_49 for ONNX node: Floor\_49  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (1,), squeezing to: ()  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 345 for ONNX tensor: 345  
[05/18/2021-23:39:22] [V] [TRT] Floor\_49 [Floor] outputs: [345 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_50 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 337  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_50 [Unsqueeze] inputs: [337 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_50 for ONNX node: Unsqueeze\_50  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 346 for ONNX tensor: 346  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_50 [Unsqueeze] outputs: [346 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_51 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 345  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_51 [Unsqueeze] inputs: [345 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_51 for ONNX node: Unsqueeze\_51  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 347 for ONNX tensor: 347  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_51 [Unsqueeze] outputs: [347 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_52 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 346  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 347  
[05/18/2021-23:39:22] [V] [TRT] Concat\_52 [Concat] inputs: [346 → (1)], [347 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_52 for ONNX node: Concat\_52  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 348 for ONNX tensor: 348  
[05/18/2021-23:39:22] [V] [TRT] Concat\_52 [Concat] outputs: [348 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_53 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 329  
[05/18/2021-23:39:22] [V] [TRT] Shape\_53 [Shape] inputs: [329 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_53 for ONNX node: Shape\_53  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 349 for ONNX tensor: 349  
[05/18/2021-23:39:22] [V] [TRT] Shape\_53 [Shape] outputs: [349 → (4)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_54 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_54 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_54 [Constant] outputs: [350 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_55 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_55 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_55 [Constant] outputs: [351 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_56 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_56 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_56 [Constant] outputs: [352 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Slice\_57 [Slice]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 349  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 351  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 352  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 350  
[05/18/2021-23:39:22] [V] [TRT] Slice\_57 [Slice] inputs: [349 → (4)], [351 → (1)], [352 → (1)], [350 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Slice\_57 for ONNX node: Slice\_57  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 353 for ONNX tensor: 353  
[05/18/2021-23:39:22] [V] [TRT] Slice\_57 [Slice] outputs: [353 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_58 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 348  
[05/18/2021-23:39:22] [V] [TRT] Cast\_58 [Cast] inputs: [348 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_58 for ONNX node: Cast\_58  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 354 for ONNX tensor: 354  
[05/18/2021-23:39:22] [V] [TRT] Cast\_58 [Cast] outputs: [354 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_59 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 353  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 354  
[05/18/2021-23:39:22] [V] [TRT] Concat\_59 [Concat] inputs: [353 → (2)], [354 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_59 for ONNX node: Concat\_59  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 355 for ONNX tensor: 355  
[05/18/2021-23:39:22] [V] [TRT] Concat\_59 [Concat] outputs: [355 → (4)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_60 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_60 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_60 [Constant] outputs: [356 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_61 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_61 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_61 [Constant] outputs: [357 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Resize\_62 [Resize]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 329  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 356  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 357  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 355  
[05/18/2021-23:39:22] [V] [TRT] Resize\_62 [Resize] inputs: [329 → (-1, -1, -1, -1)], [356 → ()], [357 → ()], [355 → (4)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Resize\_62 for ONNX node: Resize\_62  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 358 for ONNX tensor: 358  
[05/18/2021-23:39:22] [V] [TRT] Resize\_62 [Resize] outputs: [358 → (-1, -1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_63 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_63 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_63 [Constant] outputs: [359 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_64 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 358  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 359  
[05/18/2021-23:39:22] [V] [TRT] Gather\_64 [Gather] inputs: [358 → (-1, -1, -1, -1)], [359 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 359 for ONNX initializer: 359  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_64 for ONNX node: Gather\_64  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 360 for ONNX tensor: 360  
[05/18/2021-23:39:22] [V] [TRT] Gather\_64 [Gather] outputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_65 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_65 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_65 for ONNX node: Shape\_65  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 361 for ONNX tensor: 361  
[05/18/2021-23:39:22] [V] [TRT] Shape\_65 [Shape] outputs: [361 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_66 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_66 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_66 [Constant] outputs: [362 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_67 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 361  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 362  
[05/18/2021-23:39:22] [V] [TRT] Gather\_67 [Gather] inputs: [361 → (3)], [362 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 362 for ONNX initializer: 362  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_67 for ONNX node: Gather\_67  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 363 for ONNX tensor: 363  
[05/18/2021-23:39:22] [V] [TRT] Gather\_67 [Gather] outputs: [363 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_68 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_68 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_68 for ONNX node: Shape\_68  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 364 for ONNX tensor: 364  
[05/18/2021-23:39:22] [V] [TRT] Shape\_68 [Shape] outputs: [364 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_69 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_69 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_69 [Constant] outputs: [365 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_70 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 364  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 365  
[05/18/2021-23:39:22] [V] [TRT] Gather\_70 [Gather] inputs: [364 → (3)], [365 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 365 for ONNX initializer: 365  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_70 for ONNX node: Gather\_70  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 366 for ONNX tensor: 366  
[05/18/2021-23:39:22] [V] [TRT] Gather\_70 [Gather] outputs: [366 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_71 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_71 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_71 for ONNX node: Shape\_71  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 367 for ONNX tensor: 367  
[05/18/2021-23:39:22] [V] [TRT] Shape\_71 [Shape] outputs: [367 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_72 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_72 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_72 [Constant] outputs: [368 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_73 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 367  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 368  
[05/18/2021-23:39:22] [V] [TRT] Gather\_73 [Gather] inputs: [367 → (3)], [368 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 368 for ONNX initializer: 368  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_73 for ONNX node: Gather\_73  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 369 for ONNX tensor: 369  
[05/18/2021-23:39:22] [V] [TRT] Gather\_73 [Gather] outputs: [369 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_74 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 369  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_74 [Unsqueeze] inputs: [369 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_74 for ONNX node: Unsqueeze\_74  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 370 for ONNX tensor: 370  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_74 [Unsqueeze] outputs: [370 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_75 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 370  
[05/18/2021-23:39:22] [V] [TRT] Concat\_75 [Concat] inputs: [370 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_75 for ONNX node: Concat\_75  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 371 for ONNX tensor: 371  
[05/18/2021-23:39:22] [V] [TRT] Concat\_75 [Concat] outputs: [371 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_76 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 371  
[05/18/2021-23:39:22] [V] [TRT] Cast\_76 [Cast] inputs: [371 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_76 for ONNX node: Cast\_76  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 372 for ONNX tensor: 372  
[05/18/2021-23:39:22] [V] [TRT] Cast\_76 [Cast] outputs: [372 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ReduceMax\_77 [ReduceMax]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 372  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_77 [ReduceMax] inputs: [372 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ReduceMax\_77 for ONNX node: ReduceMax\_77  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 373 for ONNX tensor: 373  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_77 [ReduceMax] outputs: [373 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_78 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 373  
[05/18/2021-23:39:22] [V] [TRT] Cast\_78 [Cast] inputs: [373 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_78 for ONNX node: Cast\_78  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 374 for ONNX tensor: 374  
[05/18/2021-23:39:22] [V] [TRT] Cast\_78 [Cast] outputs: [374 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_79 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_79 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_79 for ONNX node: Shape\_79  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 375 for ONNX tensor: 375  
[05/18/2021-23:39:22] [V] [TRT] Shape\_79 [Shape] outputs: [375 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_80 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_80 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_80 [Constant] outputs: [376 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_81 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 375  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 376  
[05/18/2021-23:39:22] [V] [TRT] Gather\_81 [Gather] inputs: [375 → (3)], [376 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 376 for ONNX initializer: 376  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_81 for ONNX node: Gather\_81  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 377 for ONNX tensor: 377  
[05/18/2021-23:39:22] [V] [TRT] Gather\_81 [Gather] outputs: [377 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_82 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 377  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_82 [Unsqueeze] inputs: [377 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_82 for ONNX node: Unsqueeze\_82  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 378 for ONNX tensor: 378  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_82 [Unsqueeze] outputs: [378 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_83 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 378  
[05/18/2021-23:39:22] [V] [TRT] Concat\_83 [Concat] inputs: [378 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_83 for ONNX node: Concat\_83  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 379 for ONNX tensor: 379  
[05/18/2021-23:39:22] [V] [TRT] Concat\_83 [Concat] outputs: [379 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_84 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 379  
[05/18/2021-23:39:22] [V] [TRT] Cast\_84 [Cast] inputs: [379 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_84 for ONNX node: Cast\_84  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 380 for ONNX tensor: 380  
[05/18/2021-23:39:22] [V] [TRT] Cast\_84 [Cast] outputs: [380 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ReduceMax\_85 [ReduceMax]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 380  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_85 [ReduceMax] inputs: [380 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ReduceMax\_85 for ONNX node: ReduceMax\_85  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 381 for ONNX tensor: 381  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_85 [ReduceMax] outputs: [381 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_86 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 381  
[05/18/2021-23:39:22] [V] [TRT] Cast\_86 [Cast] inputs: [381 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_86 for ONNX node: Cast\_86  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 382 for ONNX tensor: 382  
[05/18/2021-23:39:22] [V] [TRT] Cast\_86 [Cast] outputs: [382 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_87 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_87 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_87 for ONNX node: Shape\_87  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 383 for ONNX tensor: 383  
[05/18/2021-23:39:22] [V] [TRT] Shape\_87 [Shape] outputs: [383 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_88 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_88 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_88 [Constant] outputs: [384 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_89 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 383  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 384  
[05/18/2021-23:39:22] [V] [TRT] Gather\_89 [Gather] inputs: [383 → (3)], [384 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 384 for ONNX initializer: 384  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_89 for ONNX node: Gather\_89  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 385 for ONNX tensor: 385  
[05/18/2021-23:39:22] [V] [TRT] Gather\_89 [Gather] outputs: [385 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_90 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 385  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_90 [Unsqueeze] inputs: [385 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_90 for ONNX node: Unsqueeze\_90  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 386 for ONNX tensor: 386  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_90 [Unsqueeze] outputs: [386 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_91 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 386  
[05/18/2021-23:39:22] [V] [TRT] Concat\_91 [Concat] inputs: [386 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_91 for ONNX node: Concat\_91  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 387 for ONNX tensor: 387  
[05/18/2021-23:39:22] [V] [TRT] Concat\_91 [Concat] outputs: [387 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_92 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 387  
[05/18/2021-23:39:22] [V] [TRT] Cast\_92 [Cast] inputs: [387 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_92 for ONNX node: Cast\_92  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 388 for ONNX tensor: 388  
[05/18/2021-23:39:22] [V] [TRT] Cast\_92 [Cast] outputs: [388 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ReduceMax\_93 [ReduceMax]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 388  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_93 [ReduceMax] inputs: [388 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ReduceMax\_93 for ONNX node: ReduceMax\_93  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 389 for ONNX tensor: 389  
[05/18/2021-23:39:22] [V] [TRT] ReduceMax\_93 [ReduceMax] outputs: [389 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_94 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 389  
[05/18/2021-23:39:22] [V] [TRT] Cast\_94 [Cast] inputs: [389 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_94 for ONNX node: Cast\_94  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 390 for ONNX tensor: 390  
[05/18/2021-23:39:22] [V] [TRT] Cast\_94 [Cast] outputs: [390 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_95 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 382  
[05/18/2021-23:39:22] [V] [TRT] Cast\_95 [Cast] inputs: [382 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_95 for ONNX node: Cast\_95  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 391 for ONNX tensor: 391  
[05/18/2021-23:39:22] [V] [TRT] Cast\_95 [Cast] outputs: [391 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Div\_96 [Div]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 391  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3221  
[05/18/2021-23:39:22] [V] [TRT] Div\_96 [Div] inputs: [391 → ()], [3221 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3221 for ONNX initializer: 3221  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Div\_96 for ONNX node: Div\_96  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 394 for ONNX tensor: 394  
[05/18/2021-23:39:22] [V] [TRT] Div\_96 [Div] outputs: [394 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Ceil\_97 [Ceil]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 394  
[05/18/2021-23:39:22] [V] [TRT] Ceil\_97 [Ceil] inputs: [394 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Ceil\_97 for ONNX node: Ceil\_97  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (1,), squeezing to: ()  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 395 for ONNX tensor: 395  
[05/18/2021-23:39:22] [V] [TRT] Ceil\_97 [Ceil] outputs: [395 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_98 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_98 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_98 [Constant] outputs: [396 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_99 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 395  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 396  
[05/18/2021-23:39:22] [V] [TRT] Mul\_99 [Mul] inputs: [395 → ()], [396 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 396 for ONNX initializer: 396  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_99 for ONNX node: Mul\_99  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 397 for ONNX tensor: 397  
[05/18/2021-23:39:22] [V] [TRT] Mul\_99 [Mul] outputs: [397 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_100 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 397  
[05/18/2021-23:39:22] [V] [TRT] Cast\_100 [Cast] inputs: [397 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_100 for ONNX node: Cast\_100  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 398 for ONNX tensor: 398  
[05/18/2021-23:39:22] [V] [TRT] Cast\_100 [Cast] outputs: [398 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_101 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 390  
[05/18/2021-23:39:22] [V] [TRT] Cast\_101 [Cast] inputs: [390 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: float32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_101 for ONNX node: Cast\_101  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 399 for ONNX tensor: 399  
[05/18/2021-23:39:22] [V] [TRT] Cast\_101 [Cast] outputs: [399 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Div\_102 [Div]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 399  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3222  
[05/18/2021-23:39:22] [V] [TRT] Div\_102 [Div] inputs: [399 → ()], [3222 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3222 for ONNX initializer: 3222  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Div\_102 for ONNX node: Div\_102  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 402 for ONNX tensor: 402  
[05/18/2021-23:39:22] [V] [TRT] Div\_102 [Div] outputs: [402 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Ceil\_103 [Ceil]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 402  
[05/18/2021-23:39:22] [V] [TRT] Ceil\_103 [Ceil] inputs: [402 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Ceil\_103 for ONNX node: Ceil\_103  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (1,), squeezing to: ()  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403  
[05/18/2021-23:39:22] [V] [TRT] Ceil\_103 [Ceil] outputs: [403 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_104 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_104 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_104 [Constant] outputs: [404 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Mul\_105 [Mul]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 403  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 404  
[05/18/2021-23:39:22] [V] [TRT] Mul\_105 [Mul] inputs: [403 → ()], [404 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 404 for ONNX initializer: 404  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Mul\_105 for ONNX node: Mul\_105  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 405 for ONNX tensor: 405  
[05/18/2021-23:39:22] [V] [TRT] Mul\_105 [Mul] outputs: [405 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_106 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 405  
[05/18/2021-23:39:22] [V] [TRT] Cast\_106 [Cast] inputs: [405 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_106 for ONNX node: Cast\_106  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 406 for ONNX tensor: 406  
[05/18/2021-23:39:22] [V] [TRT] Cast\_106 [Cast] outputs: [406 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_107 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_107 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_107 for ONNX node: Shape\_107  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 407 for ONNX tensor: 407  
[05/18/2021-23:39:22] [V] [TRT] Shape\_107 [Shape] outputs: [407 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_108 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_108 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_108 [Constant] outputs: [408 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_109 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 407  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 408  
[05/18/2021-23:39:22] [V] [TRT] Gather\_109 [Gather] inputs: [407 → (3)], [408 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 408 for ONNX initializer: 408  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_109 for ONNX node: Gather\_109  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 409 for ONNX tensor: 409  
[05/18/2021-23:39:22] [V] [TRT] Gather\_109 [Gather] outputs: [409 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_110 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_110 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_110 for ONNX node: Shape\_110  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 410 for ONNX tensor: 410  
[05/18/2021-23:39:22] [V] [TRT] Shape\_110 [Shape] outputs: [410 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_111 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_111 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_111 [Constant] outputs: [411 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_112 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 410  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 411  
[05/18/2021-23:39:22] [V] [TRT] Gather\_112 [Gather] inputs: [410 → (3)], [411 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 411 for ONNX initializer: 411  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_112 for ONNX node: Gather\_112  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 412 for ONNX tensor: 412  
[05/18/2021-23:39:22] [V] [TRT] Gather\_112 [Gather] outputs: [412 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_113 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Shape\_113 [Shape] inputs: [360 → (-1, -1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_113 for ONNX node: Shape\_113  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 413 for ONNX tensor: 413  
[05/18/2021-23:39:22] [V] [TRT] Shape\_113 [Shape] outputs: [413 → (3)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_114 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_114 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_114 [Constant] outputs: [414 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_115 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 413  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 414  
[05/18/2021-23:39:22] [V] [TRT] Gather\_115 [Gather] inputs: [413 → (3)], [414 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 414 for ONNX initializer: 414  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_115 for ONNX node: Gather\_115  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 415 for ONNX tensor: 415  
[05/18/2021-23:39:22] [V] [TRT] Gather\_115 [Gather] outputs: [415 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Sub\_116 [Sub]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 374  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 409  
[05/18/2021-23:39:22] [V] [TRT] Sub\_116 [Sub] inputs: [374 → ()], [409 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Sub\_116 for ONNX node: Sub\_116  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 416 for ONNX tensor: 416  
[05/18/2021-23:39:22] [V] [TRT] Sub\_116 [Sub] outputs: [416 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Sub\_117 [Sub]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 398  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 412  
[05/18/2021-23:39:22] [V] [TRT] Sub\_117 [Sub] inputs: [398 → ()], [412 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Sub\_117 for ONNX node: Sub\_117  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417  
[05/18/2021-23:39:22] [V] [TRT] Sub\_117 [Sub] outputs: [417 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Sub\_118 [Sub]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 406  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 415  
[05/18/2021-23:39:22] [V] [TRT] Sub\_118 [Sub] inputs: [406 → ()], [415 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Sub\_118 for ONNX node: Sub\_118  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 418 for ONNX tensor: 418  
[05/18/2021-23:39:22] [V] [TRT] Sub\_118 [Sub] outputs: [418 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_119 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 418  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_119 [Unsqueeze] inputs: [418 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_119 for ONNX node: Unsqueeze\_119  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 423 for ONNX tensor: 423  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_119 [Unsqueeze] outputs: [423 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_120 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 417  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_120 [Unsqueeze] inputs: [417 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_120 for ONNX node: Unsqueeze\_120  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 425 for ONNX tensor: 425  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_120 [Unsqueeze] outputs: [425 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_121 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 416  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_121 [Unsqueeze] inputs: [416 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_121 for ONNX node: Unsqueeze\_121  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 427 for ONNX tensor: 427  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_121 [Unsqueeze] outputs: [427 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_122 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3223  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 423  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3224  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 425  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3225  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 427  
[05/18/2021-23:39:22] [V] [TRT] Concat\_122 [Concat] inputs: [3223 → (1)], [423 → (1)], [3224 → (1)], [425 → (1)], [3225 → (1)], [427 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3223 for ONNX initializer: 3223  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3224 for ONNX initializer: 3224  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3225 for ONNX initializer: 3225  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_122 for ONNX node: Concat\_122  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 428 for ONNX tensor: 428  
[05/18/2021-23:39:22] [V] [TRT] Concat\_122 [Concat] outputs: [428 → (6)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_123 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 418  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_123 [Unsqueeze] inputs: [418 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_123 for ONNX node: Unsqueeze\_123  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 430 for ONNX tensor: 430  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_123 [Unsqueeze] outputs: [430 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_124 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 417  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_124 [Unsqueeze] inputs: [417 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_124 for ONNX node: Unsqueeze\_124  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 432 for ONNX tensor: 432  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_124 [Unsqueeze] outputs: [432 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Unsqueeze\_125 [Unsqueeze]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 416  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_125 [Unsqueeze] inputs: [416 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (), unsqueezing to: (1,)  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Unsqueeze\_125 for ONNX node: Unsqueeze\_125  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 434 for ONNX tensor: 434  
[05/18/2021-23:39:22] [V] [TRT] Unsqueeze\_125 [Unsqueeze] outputs: [434 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_126 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3226  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 430  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3227  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 432  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3228  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 434  
[05/18/2021-23:39:22] [V] [TRT] Concat\_126 [Concat] inputs: [3226 → (1)], [430 → (1)], [3227 → (1)], [432 → (1)], [3228 → (1)], [434 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3226 for ONNX initializer: 3226  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3227 for ONNX initializer: 3227  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3228 for ONNX initializer: 3228  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_126 for ONNX node: Concat\_126  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 435 for ONNX tensor: 435  
[05/18/2021-23:39:22] [V] [TRT] Concat\_126 [Concat] outputs: [435 → (6)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_127 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_127 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_127 [Constant] outputs: [436 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Shape\_128 [Shape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 428  
[05/18/2021-23:39:22] [V] [TRT] Shape\_128 [Shape] inputs: [428 → (6)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Shape\_128 for ONNX node: Shape\_128  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 437 for ONNX tensor: 437  
[05/18/2021-23:39:22] [V] [TRT] Shape\_128 [Shape] outputs: [437 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Gather\_129 [Gather]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 437  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 436  
[05/18/2021-23:39:22] [V] [TRT] Gather\_129 [Gather] inputs: [437 → (1)], [436 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 436 for ONNX initializer: 436  
[05/18/2021-23:39:22] [V] [TRT] Using Gather axis: 0  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Gather\_129 for ONNX node: Gather\_129  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 438 for ONNX tensor: 438  
[05/18/2021-23:39:22] [V] [TRT] Gather\_129 [Gather] outputs: [438 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Sub\_130 [Sub]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 3229  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 438  
[05/18/2021-23:39:22] [V] [TRT] Sub\_130 [Sub] inputs: [3229 → ()], [438 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering constant layer: 3229 for ONNX initializer: 3229  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Sub\_130 for ONNX node: Sub\_130  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 442 for ONNX tensor: 442  
[05/18/2021-23:39:22] [V] [TRT] Sub\_130 [Sub] outputs: [442 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_131 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 435  
[05/18/2021-23:39:22] [V] [TRT] Cast\_131 [Cast] inputs: [435 → (6)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_131 for ONNX node: Cast\_131  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443  
[05/18/2021-23:39:22] [V] [TRT] Cast\_131 [Cast] outputs: [443 → (6)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: ConstantOfShape\_132 [ConstantOfShape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 442  
[05/18/2021-23:39:22] [V] [TRT] ConstantOfShape\_132 [ConstantOfShape] inputs: [442 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: ConstantOfShape\_132 for ONNX node: ConstantOfShape\_132  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 444 for ONNX tensor: 444  
[05/18/2021-23:39:22] [V] [TRT] ConstantOfShape\_132 [ConstantOfShape] outputs: [444 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Concat\_133 [Concat]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 443  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 444  
[05/18/2021-23:39:22] [V] [TRT] Concat\_133 [Concat] inputs: [443 → (6)], [444 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Concat\_133 for ONNX node: Concat\_133  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 445 for ONNX tensor: 445  
[05/18/2021-23:39:22] [V] [TRT] Concat\_133 [Concat] outputs: [445 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_134 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_134 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_134 [Constant] outputs: [446 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Reshape\_135 [Reshape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 445  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 446  
[05/18/2021-23:39:22] [V] [TRT] Reshape\_135 [Reshape] inputs: [445 → (-1)], [446 → (2)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Reshape\_135 for ONNX node: Reshape\_135  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 447 for ONNX tensor: 447  
[05/18/2021-23:39:22] [V] [TRT] Reshape\_135 [Reshape] outputs: [447 → (-1, 2)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_136 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_136 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_136 [Constant] outputs: [448 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_137 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_137 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_137 [Constant] outputs: [449 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_138 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_138 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Weight at index 0: -9223372036854775807 is out of range. Clamping to: -2147483648  
[05/18/2021-23:39:22] [W] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/onnx2trt\_utils.cpp:255: One or more weights outside the range of INT32 was clamped  
[05/18/2021-23:39:22] [V] [TRT] Constant\_138 [Constant] outputs: [450 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_139 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_139 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_139 [Constant] outputs: [451 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Slice\_140 [Slice]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 447  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 449  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 450  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 448  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 451  
[05/18/2021-23:39:22] [V] [TRT] Slice\_140 [Slice] inputs: [447 → (-1, 2)], [449 → (1)], [450 → (1)], [448 → (1)], [451 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Slice\_140 for ONNX node: Slice\_140  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 452 for ONNX tensor: 452  
[05/18/2021-23:39:22] [V] [TRT] Slice\_140 [Slice] outputs: [452 → (-1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Transpose\_141 [Transpose]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 452  
[05/18/2021-23:39:22] [V] [TRT] Transpose\_141 [Transpose] inputs: [452 → (-1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Transpose\_141 for ONNX node: Transpose\_141  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 453 for ONNX tensor: 453  
[05/18/2021-23:39:22] [V] [TRT] Transpose\_141 [Transpose] outputs: [453 → (-1, -1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_142 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_142 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_142 [Constant] outputs: [454 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Reshape\_143 [Reshape]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 453  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 454  
[05/18/2021-23:39:22] [V] [TRT] Reshape\_143 [Reshape] inputs: [453 → (-1, -1)], [454 → (1)],  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Reshape\_143 for ONNX node: Reshape\_143  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455  
[05/18/2021-23:39:22] [V] [TRT] Reshape\_143 [Reshape] outputs: [455 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Cast\_144 [Cast]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 455  
[05/18/2021-23:39:22] [V] [TRT] Cast\_144 [Cast] inputs: [455 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Casting to type: int32  
[05/18/2021-23:39:22] [V] [TRT] Registering layer: Cast\_144 for ONNX node: Cast\_144  
[05/18/2021-23:39:22] [V] [TRT] Registering tensor: 456 for ONNX tensor: 456  
[05/18/2021-23:39:22] [V] [TRT] Cast\_144 [Cast] outputs: [456 → (-1)],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Constant\_145 [Constant]  
[05/18/2021-23:39:22] [V] [TRT] Constant\_145 [Constant] inputs:  
[05/18/2021-23:39:22] [V] [TRT] Constant\_145 [Constant] outputs: [457 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Parsing node: Pad\_146 [Pad]  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 360  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 456  
[05/18/2021-23:39:22] [V] [TRT] Searching for input: 457  
[05/18/2021-23:39:22] [V] [TRT] Pad\_146 [Pad] inputs: [360 → (-1, -1, -1)], [456 → (-1)], [457 → ()],  
[05/18/2021-23:39:22] [V] [TRT] Original shape: (_, \_, _), unsqueezing to: (_, \_, \_, \_)  
[05/18/2021-23:39:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:703: While parsing node number 146 [Pad → “458”]:  
[05/18/2021-23:39:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:704: — Begin node —  
[05/18/2021-23:39:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:705: input: “360”  
input: “456”  
input: “457”  
output: “458”  
name: “Pad\_146”  
op\_type: “Pad”  
attribute {  
name: “mode”  
s: “constant”  
type: STRING  
}

[05/18/2021-23:39:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:706: — End node —  
[05/18/2021-23:39:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:708: ERROR: /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/builtin\_op\_importers.cpp:2683 In function importPad:  
[8] Assertion failed: inputs.at(1).is\_weights()  
[05/18/2021-23:39:22] [E] Failed to parse onnx file  
[05/18/2021-23:39:22] [E] Parsing model failed  
[05/18/2021-23:39:22] [E] Engine creation failed  
[05/18/2021-23:39:22] [E] Engine set up failed

---

<div class="post-metadata">

**Author:** ![spolisetty](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/spolisetty/32/14047_2.png) [@spolisetty](https://forums.developer.nvidia.com/u/spolisetty)\
**Post date:** [May 25, 2021, 5:39am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/8 "2021-05-25T05:39:15Z")

</div>

Hi @stefan.podg,

There are many incompatibilities in the model (as it is based on Pytorch FasterRCNN), such as dynamic padding, nonzero + ROIAlign operators that TRT does not support. Also Floor ops are being used to calculate the final size of a resize layer, so it’s being marked as unsupported. Perhaps the you can try running the model in ONNXRT-TRT.

Thank you.

---

<div class="post-metadata">

**Author:** ![aarmbruster](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aarmbruster/32/133222_2.png) [@aarmbruster](https://forums.developer.nvidia.com/u/aarmbruster)\
**Post date:** [November 10, 2021, 9:13pm UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/9 "2021-11-10T21:13:08Z")

</div>

Could anyone share any information that might help me debug this error?

```auto
[11/10/2021-15:16:08] [E] Error[9]: [graph.cpp::computeInputExecutionUses::549] Error Code 9: Internal Error (__inference_map_while_ResizeToRange_cond_true_15400_132547_map/while/ResizeToRange/cond/resize/Round: IUnaryLayer cannot be used to compute a shape tensor)

```

I am using TensorRT version 8.2. I find this error confusing because according to the ONNX docs for `Round`, its input must be a float. But my reading of this error is that TensorRT is trying to apply `Round` to a shape tensor, which must have dtype int or bool. Could anyone help me understand what might be going on?

---

<div class="post-metadata">

**Author:** ![watkinsong](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@watkinsong](https://forums.developer.nvidia.com/u/watkinsong)\
**Post date:** [December 22, 2021, 6:06am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/10 "2021-12-22T06:06:02Z")

</div>

> [@stefan.podg](#):
>
> 9:22] [E] [TRT] /workspace/TensorRT/t/oss-cicd/oss/parsers/onnx/ModelImporter.cpp:705: input: “360”  
> input: “456”

I meet the same ERROR, the torch.round, torch.arange, torch.exp, all report this error after converting the pytorch model to ONNX, and then do TRT conversion.

---

<div class="post-metadata">

**Author:** ![junzhe.joseph.zhu](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/junzhe.joseph.zhu/32/143775_2.png) [@junzhe.joseph.zhu](https://forums.developer.nvidia.com/u/junzhe.joseph.zhu)\
**Post date:** [January 16, 2022, 12:11pm UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/11 "2022-01-16T12:11:33Z")

</div>

Did you guys figure this out?

---

<div class="post-metadata">

**Author:** ![sjysjy213](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@sjysjy213](https://forums.developer.nvidia.com/u/sjysjy213)\
**Post date:** [August 12, 2022, 1:02am UTC](https://forums.developer.nvidia.com/t/tensorrt-error-graph-cpp-510/178125/12 "2022-08-12T01:02:58Z")

</div>

I ran into the same error, and I believe it’s coming from the use of torch.reminder().  
Has anyone successfully solved this?