How to Disable IExecutionContext execute() logging

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I am using TensorRT engine for inference using Python api.

with engine.create_execution_context() as context:
       context.debug_sync = False
       # Transfer input data to the GPU.
       cuda.memcpy_htod_async(d_input_1, h_input_1, stream)

       # Run inference.
       context.profiler = trt.Profiler()
       context.execute(batch_size=1, bindings=[int(d_input_1), int(d_output)])
      # Transfer predictions back from the GPU.
       cuda.memcpy_dtoh_async(h_output, d_output, stream)
       # Synchronize the stream
       stream.synchronize()
       # Return the host output.
       out = h_output.reshape((1,-1))
       return out

each time context.execute(batch_size=1, bindings=[int(d_input_1), int(d_output)]) it logs the model layers all of them which make the console not suitable for debugging. I tried to disable it but I couldn’t.
I think the problem is in this method engine.create_execution_context() as documented in the api this return IExecutionContext with debug_sync set to True. I don’t know if this is a bug or not.

I used context.debug_sync = False but it didn’t stop logging the execution layers.
how I could disable logging the execution layers to the console?

Environment

Jetson TX 2, JetPack 4.4
TensorRT Version:
TensorRT 7.1
GPU Type:
Jetosn TX 2
Nvidia Driver Version:
CUDA Version:
CUDNN Version:
Operating System + Version:
Ubuntu 18.04
Python Version (if applicable):
Python 3.6.9

Relevant Files

inference.py

2

Hi @anasmk
Apologies for delayed response.
Can you please share what message context profiler is printing?
Thanks!

3

This is the output for each execution…

Conv2d_1a_3x3/convolution__5: 0.24896ms
Conv2d_1a_3x3/convolution + Conv2d_1a_3x3_Activation/Relu: 0.41968ms
Conv2d_2a_3x3/convolution + Conv2d_2a_3x3_Activation/Relu: 1.04064ms
Conv2d_2b_3x3/convolution + Conv2d_2b_3x3_Activation/Relu: 2.0616ms
MaxPool_3a_3x3/MaxPool: 0.344608ms
Conv2d_3b_1x1/convolution + Conv2d_3b_1x1_Activation/Relu: 0.415392ms
Conv2d_4a_3x3/convolution + Conv2d_4a_3x3_Activation/Relu: 3.45088ms
Conv2d_4b_3x3/convolution + Conv2d_4b_3x3_Activation/Relu: 586.497ms
Block35_1_Branch_0_Conv2d_1x1/convolution + Block35_1_Branch_0_Conv2d_1x1_Activation/Relu || Block35_1_Branch_1_Conv2d_0a_1x1/convolution + Block35_1_Branch_1_Conv2d_0a_1x1_Activation/Relu || Block35_1_Branch_2_Conv2d_0a_1x1/convolution + Block35_1_Branch_2_Conv2d_0a_1x1_Activation/Relu: 0.359264ms
Block35_1_Branch_2_Conv2d_0b_3x3/convolution + Block35_1_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.156896ms
Block35_1_Branch_1_Conv2d_0b_3x3/convolution + Block35_1_Branch_1_Conv2d_0b_3x3_Activation/Relu: 0.13632ms
Block35_1_Branch_2_Conv2d_0c_3x3/convolution + Block35_1_Branch_2_Conv2d_0c_3x3_Activation/Relu: 0.163584ms
Block35_1_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01856ms
Block35_1_Conv2d_1x1/BiasAdd + Block35_1_ScaleSum/add + Block35_1_Activation/Relu: 0.31648ms
Block35_2_Branch_0_Conv2d_1x1/convolution + Block35_2_Branch_0_Conv2d_1x1_Activation/Relu || Block35_2_Branch_1_Conv2d_0a_1x1/convolution + Block35_2_Branch_1_Conv2d_0a_1x1_Activation/Relu || Block35_2_Branch_2_Conv2d_0a_1x1/convolution + Block35_2_Branch_2_Conv2d_0a_1x1_Activation/Relu: 0.33504ms
Block35_2_Branch_2_Conv2d_0b_3x3/convolution + Block35_2_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.15824ms
Block35_2_Branch_1_Conv2d_0b_3x3/convolution + Block35_2_Branch_1_Conv2d_0b_3x3_Activation/Relu: 0.138656ms
Block35_2_Branch_2_Conv2d_0c_3x3/convolution + Block35_2_Branch_2_Conv2d_0c_3x3_Activation/Relu: 0.164704ms
Block35_2_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.016096ms
Block35_2_Conv2d_1x1/BiasAdd + Block35_2_ScaleSum/add + Block35_2_Activation/Relu: 0.321984ms
Block35_3_Branch_0_Conv2d_1x1/convolution + Block35_3_Branch_0_Conv2d_1x1_Activation/Relu || Block35_3_Branch_1_Conv2d_0a_1x1/convolution + Block35_3_Branch_1_Conv2d_0a_1x1_Activation/Relu || Block35_3_Branch_2_Conv2d_0a_1x1/convolution + Block35_3_Branch_2_Conv2d_0a_1x1_Activation/Relu: 0.33552ms
Block35_3_Branch_2_Conv2d_0b_3x3/convolution + Block35_3_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.161856ms
Block35_3_Branch_1_Conv2d_0b_3x3/convolution + Block35_3_Branch_1_Conv2d_0b_3x3_Activation/Relu: 0.13744ms
Block35_3_Branch_2_Conv2d_0c_3x3/convolution + Block35_3_Branch_2_Conv2d_0c_3x3_Activation/Relu: 0.16528ms
Block35_3_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.0168ms
Block35_3_Conv2d_1x1/BiasAdd + Block35_3_ScaleSum/add + Block35_3_Activation/Relu: 0.314784ms
Block35_4_Branch_0_Conv2d_1x1/convolution + Block35_4_Branch_0_Conv2d_1x1_Activation/Relu || Block35_4_Branch_1_Conv2d_0a_1x1/convolution + Block35_4_Branch_1_Conv2d_0a_1x1_Activation/Relu || Block35_4_Branch_2_Conv2d_0a_1x1/convolution + Block35_4_Branch_2_Conv2d_0a_1x1_Activation/Relu: 0.343456ms
Block35_4_Branch_2_Conv2d_0b_3x3/convolution + Block35_4_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.162144ms
Block35_4_Branch_1_Conv2d_0b_3x3/convolution + Block35_4_Branch_1_Conv2d_0b_3x3_Activation/Relu: 0.137696ms
Block35_4_Branch_2_Conv2d_0c_3x3/convolution + Block35_4_Branch_2_Conv2d_0c_3x3_Activation/Relu: 0.16752ms
Block35_4_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.017504ms
Block35_4_Conv2d_1x1/BiasAdd + Block35_4_ScaleSum/add + Block35_4_Activation/Relu: 0.3152ms
Block35_5_Branch_0_Conv2d_1x1/convolution + Block35_5_Branch_0_Conv2d_1x1_Activation/Relu || Block35_5_Branch_1_Conv2d_0a_1x1/convolution + Block35_5_Branch_1_Conv2d_0a_1x1_Activation/Relu || Block35_5_Branch_2_Conv2d_0a_1x1/convolution + Block35_5_Branch_2_Conv2d_0a_1x1_Activation/Relu: 0.341056ms
Block35_5_Branch_2_Conv2d_0b_3x3/convolution + Block35_5_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.163744ms
Block35_5_Branch_1_Conv2d_0b_3x3/convolution + Block35_5_Branch_1_Conv2d_0b_3x3_Activation/Relu: 0.14208ms
Block35_5_Branch_2_Conv2d_0c_3x3/convolution + Block35_5_Branch_2_Conv2d_0c_3x3_Activation/Relu: 0.16432ms
Block35_5_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.0176ms
Block35_5_Conv2d_1x1/BiasAdd + Block35_5_ScaleSum/add + Block35_5_Activation/Relu: 0.32032ms
Mixed_6a_Branch_0_Conv2d_1a_3x3/convolution + Mixed_6a_Branch_0_Conv2d_1a_3x3_Activation/Relu: 2.37056ms
Mixed_6a_Branch_1_Conv2d_0a_1x1/convolution + Mixed_6a_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.55056ms
Mixed_6a_Branch_2_MaxPool_1a_3x3/MaxPool: 0.09792ms
Mixed_6a_Branch_1_Conv2d_0b_3x3/convolution + Mixed_6a_Branch_1_Conv2d_0b_3x3_Activation/Relu: 2.93226ms
Mixed_6a_Branch_1_Conv2d_1a_3x3/convolution + Mixed_6a_Branch_1_Conv2d_1a_3x3_Activation/Relu: 1.31824ms
Block17_1_Branch_0_Conv2d_1x1/convolution + Block17_1_Branch_0_Conv2d_1x1_Activation/Relu || Block17_1_Branch_1_Conv2d_0a_1x1/convolution + Block17_1_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.80832ms
Block17_1_Branch_1_Conv2d_0b_1x7/convolution + Block17_1_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.548ms
Block17_1_Branch_1_Conv2d_0c_7x1/convolution + Block17_1_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.4968ms
Block17_1_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.021824ms
Block17_1_Conv2d_1x1/BiasAdd + Block17_1_ScaleSum/add + Block17_1_Activation/Relu: 0.772096ms
Block17_2_Branch_0_Conv2d_1x1/convolution + Block17_2_Branch_0_Conv2d_1x1_Activation/Relu || Block17_2_Branch_1_Conv2d_0a_1x1/convolution + Block17_2_Branch_1_Conv2d_0a_1x1_Activation/Relu: 1.42678ms
Block17_2_Branch_1_Conv2d_0b_1x7/convolution + Block17_2_Branch_1_Conv2d_0b_1x7_Activation/Relu: 1.46442ms
Block17_2_Branch_1_Conv2d_0c_7x1/convolution + Block17_2_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.508384ms
Block17_2_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.0224ms
Block17_2_Conv2d_1x1/BiasAdd + Block17_2_ScaleSum/add + Block17_2_Activation/Relu: 0.774176ms
Block17_3_Branch_0_Conv2d_1x1/convolution + Block17_3_Branch_0_Conv2d_1x1_Activation/Relu || Block17_3_Branch_1_Conv2d_0a_1x1/convolution + Block17_3_Branch_1_Conv2d_0a_1x1_Activation/Relu: 1.9056ms
Block17_3_Branch_1_Conv2d_0b_1x7/convolution + Block17_3_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.55744ms
Block17_3_Branch_1_Conv2d_0c_7x1/convolution + Block17_3_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.49488ms
Block17_3_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.023104ms
Block17_3_Conv2d_1x1/BiasAdd + Block17_3_ScaleSum/add + Block17_3_Activation/Relu: 0.78416ms
Block17_4_Branch_0_Conv2d_1x1/convolution + Block17_4_Branch_0_Conv2d_1x1_Activation/Relu || Block17_4_Branch_1_Conv2d_0a_1x1/convolution + Block17_4_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.80848ms
Block17_4_Branch_1_Conv2d_0b_1x7/convolution + Block17_4_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.516ms
Block17_4_Branch_1_Conv2d_0c_7x1/convolution + Block17_4_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.477376ms
Block17_4_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01728ms
Block17_4_Conv2d_1x1/BiasAdd + Block17_4_ScaleSum/add + Block17_4_Activation/Relu: 0.748384ms
Block17_5_Branch_0_Conv2d_1x1/convolution + Block17_5_Branch_0_Conv2d_1x1_Activation/Relu || Block17_5_Branch_1_Conv2d_0a_1x1/convolution + Block17_5_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.815456ms
Block17_5_Branch_1_Conv2d_0b_1x7/convolution + Block17_5_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.562304ms
Block17_5_Branch_1_Conv2d_0c_7x1/convolution + Block17_5_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.50144ms
Block17_5_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01984ms
Block17_5_Conv2d_1x1/BiasAdd + Block17_5_ScaleSum/add + Block17_5_Activation/Relu: 0.77424ms
Block17_6_Branch_0_Conv2d_1x1/convolution + Block17_6_Branch_0_Conv2d_1x1_Activation/Relu || Block17_6_Branch_1_Conv2d_0a_1x1/convolution + Block17_6_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.807776ms
Block17_6_Branch_1_Conv2d_0b_1x7/convolution + Block17_6_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.55744ms
Block17_6_Branch_1_Conv2d_0c_7x1/convolution + Block17_6_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.493504ms
Block17_6_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01792ms
Block17_6_Conv2d_1x1/BiasAdd + Block17_6_ScaleSum/add + Block17_6_Activation/Relu: 0.75952ms
Block17_7_Branch_0_Conv2d_1x1/convolution + Block17_7_Branch_0_Conv2d_1x1_Activation/Relu || Block17_7_Branch_1_Conv2d_0a_1x1/convolution + Block17_7_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.78352ms
Block17_7_Branch_1_Conv2d_0b_1x7/convolution + Block17_7_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.550976ms
Block17_7_Branch_1_Conv2d_0c_7x1/convolution + Block17_7_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.505664ms
Block17_7_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.02112ms
Block17_7_Conv2d_1x1/BiasAdd + Block17_7_ScaleSum/add + Block17_7_Activation/Relu: 2.4937ms
Block17_8_Branch_0_Conv2d_1x1/convolution + Block17_8_Branch_0_Conv2d_1x1_Activation/Relu || Block17_8_Branch_1_Conv2d_0a_1x1/convolution + Block17_8_Branch_1_Conv2d_0a_1x1_Activation/Relu: 1.5928ms
Block17_8_Branch_1_Conv2d_0b_1x7/convolution + Block17_8_Branch_1_Conv2d_0b_1x7_Activation/Relu: 2.47638ms
Block17_8_Branch_1_Conv2d_0c_7x1/convolution + Block17_8_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.499296ms
Block17_8_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.016224ms
Block17_8_Conv2d_1x1/BiasAdd + Block17_8_ScaleSum/add + Block17_8_Activation/Relu: 2.41808ms
Block17_9_Branch_0_Conv2d_1x1/convolution + Block17_9_Branch_0_Conv2d_1x1_Activation/Relu || Block17_9_Branch_1_Conv2d_0a_1x1/convolution + Block17_9_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.809056ms
Block17_9_Branch_1_Conv2d_0b_1x7/convolution + Block17_9_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.54928ms
Block17_9_Branch_1_Conv2d_0c_7x1/convolution + Block17_9_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.495904ms
Block17_9_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.022976ms
Block17_9_Conv2d_1x1/BiasAdd + Block17_9_ScaleSum/add + Block17_9_Activation/Relu: 2.32278ms
Block17_10_Branch_0_Conv2d_1x1/convolution + Block17_10_Branch_0_Conv2d_1x1_Activation/Relu || Block17_10_Branch_1_Conv2d_0a_1x1/convolution + Block17_10_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.811776ms
Block17_10_Branch_1_Conv2d_0b_1x7/convolution + Block17_10_Branch_1_Conv2d_0b_1x7_Activation/Relu: 0.57616ms
Block17_10_Branch_1_Conv2d_0c_7x1/convolution + Block17_10_Branch_1_Conv2d_0c_7x1_Activation/Relu: 0.509184ms
Block17_10_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.5696ms
Block17_10_Conv2d_1x1/BiasAdd + Block17_10_ScaleSum/add + Block17_10_Activation/Relu: 0.7744ms
Mixed_7a_Branch_0_Conv2d_0a_1x1/convolution + Mixed_7a_Branch_0_Conv2d_0a_1x1_Activation/Relu || Mixed_7a_Branch_1_Conv2d_0a_1x1/convolution + Mixed_7a_Branch_1_Conv2d_0a_1x1_Activation/Relu || Mixed_7a_Branch_2_Conv2d_0a_1x1/convolution + Mixed_7a_Branch_2_Conv2d_0a_1x1_Activation/Relu: 2.05152ms
Mixed_7a_Branch_3_MaxPool_1a_3x3/MaxPool: 0.0904ms
Mixed_7a_Branch_2_Conv2d_0b_3x3/convolution + Mixed_7a_Branch_2_Conv2d_0b_3x3_Activation/Relu: 0.888896ms
Mixed_7a_Branch_1_Conv2d_1a_3x3/convolution + Mixed_7a_Branch_1_Conv2d_1a_3x3_Activation/Relu: 1.38214ms
Mixed_7a_Branch_0_Conv2d_1a_3x3/convolution + Mixed_7a_Branch_0_Conv2d_1a_3x3_Activation/Relu: 1.47738ms
Mixed_7a_Branch_2_Conv2d_1a_3x3/convolution + Mixed_7a_Branch_2_Conv2d_1a_3x3_Activation/Relu: 1.3287ms
Block8_1_Branch_0_Conv2d_1x1/convolution + Block8_1_Branch_0_Conv2d_1x1_Activation/Relu || Block8_1_Branch_1_Conv2d_0a_1x1/convolution + Block8_1_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.484096ms
Block8_1_Branch_1_Conv2d_0b_1x3/convolution + Block8_1_Branch_1_Conv2d_0b_1x3_Activation/Relu: 0.511584ms
Block8_1_Branch_1_Conv2d_0c_3x1/convolution + Block8_1_Branch_1_Conv2d_0c_3x1_Activation/Relu: 0.458336ms
Block8_1_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.018144ms
Block8_1_Conv2d_1x1/BiasAdd + Block8_1_ScaleSum/add + Block8_1_Activation/Relu: 1.13962ms
Block8_2_Branch_0_Conv2d_1x1/convolution + Block8_2_Branch_0_Conv2d_1x1_Activation/Relu || Block8_2_Branch_1_Conv2d_0a_1x1/convolution + Block8_2_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.461664ms
Block8_2_Branch_1_Conv2d_0b_1x3/convolution + Block8_2_Branch_1_Conv2d_0b_1x3_Activation/Relu: 0.50528ms
Block8_2_Branch_1_Conv2d_0c_3x1/convolution + Block8_2_Branch_1_Conv2d_0c_3x1_Activation/Relu: 0.46368ms
Block8_2_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01728ms
Block8_2_Conv2d_1x1/BiasAdd + Block8_2_ScaleSum/add + Block8_2_Activation/Relu: 1.128ms
Block8_3_Branch_0_Conv2d_1x1/convolution + Block8_3_Branch_0_Conv2d_1x1_Activation/Relu || Block8_3_Branch_1_Conv2d_0a_1x1/convolution + Block8_3_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.47616ms
Block8_3_Branch_1_Conv2d_0b_1x3/convolution + Block8_3_Branch_1_Conv2d_0b_1x3_Activation/Relu: 0.501216ms
Block8_3_Branch_1_Conv2d_0c_3x1/convolution + Block8_3_Branch_1_Conv2d_0c_3x1_Activation/Relu: 2.17216ms
Block8_3_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.01856ms
Block8_3_Conv2d_1x1/BiasAdd + Block8_3_ScaleSum/add + Block8_3_Activation/Relu: 2.88614ms
Block8_4_Branch_0_Conv2d_1x1/convolution + Block8_4_Branch_0_Conv2d_1x1_Activation/Relu || Block8_4_Branch_1_Conv2d_0a_1x1/convolution + Block8_4_Branch_1_Conv2d_0a_1x1_Activation/Relu: 2.26218ms
Block8_4_Branch_1_Conv2d_0b_1x3/convolution + Block8_4_Branch_1_Conv2d_0b_1x3_Activation/Relu: 0.49872ms
Block8_4_Branch_1_Conv2d_0c_3x1/convolution + Block8_4_Branch_1_Conv2d_0c_3x1_Activation/Relu: 0.45536ms
Block8_4_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.013504ms
Block8_4_Conv2d_1x1/BiasAdd + Block8_4_ScaleSum/add + Block8_4_Activation/Relu: 1.10442ms
Block8_5_Branch_0_Conv2d_1x1/convolution + Block8_5_Branch_0_Conv2d_1x1_Activation/Relu || Block8_5_Branch_1_Conv2d_0a_1x1/convolution + Block8_5_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.471424ms
Block8_5_Branch_1_Conv2d_0b_1x3/convolution + Block8_5_Branch_1_Conv2d_0b_1x3_Activation/Relu: 1.4409ms
Block8_5_Branch_1_Conv2d_0c_3x1/convolution + Block8_5_Branch_1_Conv2d_0c_3x1_Activation/Relu: 0.170304ms
Block8_5_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.010816ms
Block8_5_Conv2d_1x1/BiasAdd + Block8_5_ScaleSum/add + Block8_5_Activation/Relu: 0.69568ms
Block8_6_Branch_0_Conv2d_1x1/convolution + Block8_6_Branch_0_Conv2d_1x1_Activation/Relu || Block8_6_Branch_1_Conv2d_0a_1x1/convolution + Block8_6_Branch_1_Conv2d_0a_1x1_Activation/Relu: 0.24368ms
Block8_6_Branch_1_Conv2d_0b_1x3/convolution + Block8_6_Branch_1_Conv2d_0b_1x3_Activation/Relu: 0.193504ms
Block8_6_Branch_1_Conv2d_0c_3x1/convolution + Block8_6_Branch_1_Conv2d_0c_3x1_Activation/Relu: 0.158016ms
Block8_6_Branch_0_Conv2d_1x1_Activation/Relu:0 copy: 0.0064ms
Block8_6_Conv2d_1x1/BiasAdd + Block8_6_ScaleSum/add: 0.332224ms
Transpose__644: 0.024896ms
AvgPool/Mean: 0.04352ms
Bottleneck/MatMul: 0.06784ms
(Unnamed Layer* 377) [Constant] + (Unnamed Layer* 378) [Shuffle] + unsqueeze_node_after_(Unnamed Layer* 377) [Constant] + (Unnamed Layer* 378) [Shuffle] + Bottleneck_BatchNorm/batchnorm_1/mul: 0.012704ms
(Unnamed Layer* 380) [Constant] + (Unnamed Layer* 381) [Shuffle]: 0.00064ms
Bottleneck_BatchNorm/batchnorm_1/add_1: 0.0056ms
4

@AakankshaS please could you help me with this.

5

Can you please try setting the verbosity to higher level?
Thanks!

6

Hey @anasmk . Did you find a way to disable logging the execution layers to the console?

Thanks.

7

@AakankshaS
Can you please help with this? I have same problem.