Hey Hi, Thanks for the response. When i try to optimize graph with help of TensorRT on jetson tx2, i got some error at the end of creating inference graph, its going to killed state. I dont know how to resolve this issue, pls give me some suggestion;
f! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:11.504566: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:11.794660: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:12.547723: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:12.828665: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:13.550364: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:13.840069: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:14.453139: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:14.743532: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:15.497577: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:15.778241: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:17.050586: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:17.347970: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:17.968009: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:18.258632: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:18.762323: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:19.052575: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:19.557068: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:19.846993: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:20.459728: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:20.749851: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:21.283185: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:21.564138: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:22.319042: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:22.600504: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:23.213135: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:23.503008: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:24.226531: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:24.516705: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:25.025812: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:25.321041: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:25.889777: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:26.194687: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:27.010231: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:27.309769: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:27.809845: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:28.100460: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:28.806633: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:29.098834: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:29.739406: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:30.020943: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:30.595564: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:30.880356: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:31.573542: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:31.864970: W tensorflow/contrib/tensorrt/convert/trt_optimization_pass.cc:185] TensorRTOptimizer is probably called on funcdef! This optimizer must *NOT* be called on function objects.
2018-12-11 11:26:32.399643: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: tf_graph
2018-12-11 11:26:32.399875: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 5412 nodes (-491), 9282 edges (-492), time = 1598.47302ms.
2018-12-11 11:26:32.399969: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 5443 nodes (31), 9293 edges (11), time = 851.81ms.
2018-12-11 11:26:32.399994: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4967 nodes (-476), 8817 edges (-476), time = 165193.406ms.
2018-12-11 11:26:32.400022: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4944 nodes (-23), 8817 edges (0), time = 1195.16895ms.
2018-12-11 11:26:32.400043: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4944 nodes (0), 8817 edges (0), time = 2556.87598ms.
2018-12-11 11:26:32.400066: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat/block35_4/Branch_1/my_trt_op_89_native_segment
2018-12-11 11:26:32.400095: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 248.235ms.
2018-12-11 11:26:32.400118: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 4 nodes (0), 3 edges (0), time = 132.236ms.
2018-12-11 11:26:32.400136: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 33.856ms.
2018-12-11 11:26:32.400155: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 243.517ms.
2018-12-11 11:26:32.400183: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 33.689ms.
2018-12-11 11:26:32.400201: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat_1/block17_5/Branch_1/my_trt_op_150_native_segment
2018-12-11 11:26:32.400219: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 235.774ms.
2018-12-11 11:26:32.400236: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 4 nodes (0), 3 edges (0), time = 106.326ms.
2018-12-11 11:26:32.400253: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 33.993ms.
2018-12-11 11:26:32.400270: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 251.653ms.
2018-12-11 11:26:32.400287: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 33.934ms.
2018-12-11 11:26:32.400304: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/my_trt_op_20_native_segment
2018-12-11 11:26:32.400323: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 240.373ms.
2018-12-11 11:26:32.400340: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 5 nodes (0), 4 edges (0), time = 132.394ms.
2018-12-11 11:26:32.400365: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 33.741ms.
2018-12-11 11:26:32.400383: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 243.42ms.
2018-12-11 11:26:32.400402: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 33.685ms.
2018-12-11 11:26:32.400419: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat_1/block17_7/Branch_1/my_trt_op_168_native_segment
2018-12-11 11:26:32.400436: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 235.648ms.
2018-12-11 11:26:32.400454: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 4 nodes (0), 3 edges (0), time = 106.342ms.
2018-12-11 11:26:32.400471: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 34.013ms.
2018-12-11 11:26:32.400490: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 251.178ms.
2018-12-11 11:26:32.400509: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 34.093ms.
2018-12-11 11:26:32.400529: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Mixed_7a/Branch_2/my_trt_op_47_native_segment
2018-12-11 11:26:32.400547: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 240.875ms.
2018-12-11 11:26:32.400564: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 4 nodes (0), 3 edges (0), time = 108.3ms.
2018-12-11 11:26:32.400581: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 34.529ms.
2018-12-11 11:26:32.400599: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 257.974ms.
2018-12-11 11:26:32.400616: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 34.39ms.
2018-12-11 11:26:32.400632: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/my_trt_op_53_native_segment
2018-12-11 11:26:32.400649: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 8 nodes (0), 7 edges (0), time = 241.521ms.
2018-12-11 11:26:32.400666: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 8 nodes (0), 7 edges (0), time = 132.799ms.
2018-12-11 11:26:32.400682: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 8 nodes (0), 7 edges (0), time = 34.171ms.
2018-12-11 11:26:32.400699: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 8 nodes (0), 7 edges (0), time = 244.142ms.
2018-12-11 11:26:32.400716: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 8 nodes (0), 7 edges (0), time = 33.802ms.
2018-12-11 11:26:32.400733: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat/my_trt_op_84_native_segment
2018-12-11 11:26:32.400750: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 23 nodes (0), 22 edges (0), time = 243.283ms.
2018-12-11 11:26:32.400768: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Invalid argument: The graph is already optimized by layout optimizer.
2018-12-11 11:26:32.400785: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 23 nodes (0), 22 edges (0), time = 35.72ms.
2018-12-11 11:26:32.400802: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 23 nodes (0), 22 edges (0), time = 246.508ms.
2018-12-11 11:26:32.400819: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 23 nodes (0), 22 edges (0), time = 35.759ms.
2018-12-11 11:26:32.400835: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat_2/my_trt_op_216_native_segment
2018-12-11 11:26:32.400853: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 19 nodes (0), 18 edges (0), time = 252.621ms.
2018-12-11 11:26:32.400870: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Invalid argument: The graph is already optimized by layout optimizer.
2018-12-11 11:26:32.400888: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 19 nodes (0), 18 edges (0), time = 37.182ms.
2018-12-11 11:26:32.400905: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 19 nodes (0), 18 edges (0), time = 264.772ms.
2018-12-11 11:26:32.400923: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 19 nodes (0), 18 edges (0), time = 37.311ms.
2018-12-11 11:26:32.400940: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: InceptionResnetV1/Repeat_2/block8_3/Branch_1/my_trt_op_205_native_segment
2018-12-11 11:26:32.400958: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] constant folding: Graph size after: 4 nodes (0), 3 edges (0), time = 235.927ms.
2018-12-11 11:26:32.400978: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] layout: Graph size after: 4 nodes (0), 3 edges (0), time = 106.613ms.
2018-12-11 11:26:32.400997: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406] TensorRTOptimizer: Graph size after: 4 nodes (0), 3 edges (0), time = 34.167ms.
Killed