2020-06-24 15:57:13.306180: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.2 2020-06-24 15:57:17.265242: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libnvinfer.so.7 2020-06-24 15:57:17.267596: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libnvinfer_plugin.so.7 2020-06-24 15:57:24.338597: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1 2020-06-24 15:57:24.350070: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.350220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties: pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3 coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s 2020-06-24 15:57:24.350275: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.2 2020-06-24 15:57:24.350376: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10 2020-06-24 15:57:24.358709: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10 2020-06-24 15:57:24.359556: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10 2020-06-24 15:57:24.363972: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10 2020-06-24 15:57:24.367787: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10 2020-06-24 15:57:24.367958: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8 2020-06-24 15:57:24.368179: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.368397: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.368471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1697] Adding visible gpu devices: 0 2020-06-24 15:57:24.389728: W tensorflow/core/platform/profile_utils/cpu_utils.cc:98] Failed to find bogomips in /proc/cpuinfo; cannot determine CPU frequency 2020-06-24 15:57:24.390312: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2df0b990 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2020-06-24 15:57:24.390362: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2020-06-24 15:57:24.472417: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.472715: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2de71490 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2020-06-24 15:57:24.472760: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA Tegra X1, Compute Capability 5.3 2020-06-24 15:57:24.473079: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.473188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties: pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3 coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s 2020-06-24 15:57:24.473253: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.2 2020-06-24 15:57:24.473298: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10 2020-06-24 15:57:24.473357: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10 2020-06-24 15:57:24.473485: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10 2020-06-24 15:57:24.473540: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10 2020-06-24 15:57:24.473581: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10 2020-06-24 15:57:24.473613: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8 2020-06-24 15:57:24.473750: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.473918: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:24.473986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1697] Adding visible gpu devices: 0 2020-06-24 15:57:24.474055: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.2 2020-06-24 15:57:27.702016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1096] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-06-24 15:57:27.702100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] 0 2020-06-24 15:57:27.702127: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] 0: N 2020-06-24 15:57:27.702457: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:27.702700: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:27.702847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1241] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 427 MB memory) -> physical GPU (device: 0, name: NVIDIA Tegra X1, pci bus id: 0000:00:00.0, compute capability: 5.3) 2020-06-24 15:57:30.874434: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.874586: I tensorflow/core/grappler/devices.cc:55] Number of eligible GPUs (core count >= 8, compute capability >= 0.0): 0 2020-06-24 15:57:30.874785: I tensorflow/core/grappler/clusters/single_machine.cc:356] Starting new session 2020-06-24 15:57:30.876099: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.876252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties: pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3 coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s 2020-06-24 15:57:30.876314: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.2 2020-06-24 15:57:30.876368: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10 2020-06-24 15:57:30.876435: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10 2020-06-24 15:57:30.876484: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10 2020-06-24 15:57:30.876528: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10 2020-06-24 15:57:30.876569: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10 2020-06-24 15:57:30.876602: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8 2020-06-24 15:57:30.876772: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.876942: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.877008: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1697] Adding visible gpu devices: 0 2020-06-24 15:57:30.877064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1096] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-06-24 15:57:30.877095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] 0 2020-06-24 15:57:30.877114: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] 0: N 2020-06-24 15:57:30.877326: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.877669: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:948] ARM64 does not support NUMA - returning NUMA node zero 2020-06-24 15:57:30.877779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1241] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 427 MB memory) -> physical GPU (device: 0, name: NVIDIA Tegra X1, pci bus id: 0000:00:00.0, compute capability: 5.3) 2020-06-24 15:57:30.969987: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:841] Optimization results for grappler item: graph_to_optimize 2020-06-24 15:57:30.970066: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:843] function_optimizer: Graph size after: 12 nodes (9), 12 edges (10), time = 4.114ms. 2020-06-24 15:57:30.970088: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:843] function_optimizer: Graph size after: 12 nodes (0), 12 edges (0), time = 2.048ms. 2020-06-24 15:57:30.970107: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:841] Optimization results for grappler item: __inference_TRTEngineOp_0_native_segment_23 2020-06-24 15:57:30.970125: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:843] function_optimizer: function_optimizer did nothing. time = 0.003ms. 2020-06-24 15:57:30.970142: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:843] function_optimizer: function_optimizer did nothing. time = 0.001ms. 2020-06-24 15:57:31.514423: I tensorflow/compiler/tf2tensorrt/kernels/trt_engine_op.cc:736] Building a new TensorRT engine for PartitionedCall/TRTEngineOp_0 with input shapes: [[100,28,28,1]] 2020-06-24 15:57:31.514576: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libnvinfer.so.7 2020-06-24 15:57:31.515111: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libnvinfer_plugin.so.7 2020-06-24 15:57:43.582046: W tensorflow/core/common_runtime/bfc_allocator.cc:424] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.00GiB (rounded to 1073742336). Current allocation summary follows. 2020-06-24 15:57:43.583771: I tensorflow/core/common_runtime/bfc_allocator.cc:894] BFCAllocator dump for GPU_0_bfc 2020-06-24 15:57:43.584210: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (256): Total Chunks: 15, Chunks in use: 14. 3.8KiB allocated for chunks. 3.5KiB in use in bin. 276B client-requested in use in bin. 2020-06-24 15:57:43.584547: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (512): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.584876: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (1024): Total Chunks: 4, Chunks in use: 4. 4.2KiB allocated for chunks. 4.2KiB in use in bin. 3.9KiB client-requested in use in bin. 2020-06-24 15:57:43.585184: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (2048): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.585710: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (4096): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.586058: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.586349: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (16384): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.586626: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (32768): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.586984: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (65536): Total Chunks: 3, Chunks in use: 2. 231.0KiB allocated for chunks. 153.5KiB in use in bin. 153.1KiB client-requested in use in bin. 2020-06-24 15:57:43.587335: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (131072): Total Chunks: 1, Chunks in use: 1. 150.2KiB allocated for chunks. 150.2KiB in use in bin. 76.6KiB client-requested in use in bin. 2020-06-24 15:57:43.587676: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (262144): Total Chunks: 1, Chunks in use: 1. 306.2KiB allocated for chunks. 306.2KiB in use in bin. 306.2KiB client-requested in use in bin. 2020-06-24 15:57:43.587963: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (524288): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.588241: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (1048576): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.588514: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (2097152): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.588783: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.589057: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.589350: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.589882: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.590176: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.590460: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.590612: I tensorflow/core/common_runtime/bfc_allocator.cc:901] Bin (268435456): Total Chunks: 1, Chunks in use: 0. 426.68MiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2020-06-24 15:57:43.590723: I tensorflow/core/common_runtime/bfc_allocator.cc:917] Bin for 1.00GiB was 256.00MiB, Chunk State: 2020-06-24 15:57:43.590879: I tensorflow/core/common_runtime/bfc_allocator.cc:923] Size: 426.68MiB | Requested Size: 76.6KiB | in_use: 0 | bin_num: 20, prev: Size: 306.2KiB | Requested Size: 306.2KiB | in_use: 1 | bin_num: -1 2020-06-24 15:57:43.590989: I tensorflow/core/common_runtime/bfc_allocator.cc:930] Next region of size 448122880 2020-06-24 15:57:43.591128: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eb0000 of size 1280 next 1 2020-06-24 15:57:43.591256: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eb0500 of size 256 next 2 2020-06-24 15:57:43.591374: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eb0600 of size 256 next 24 2020-06-24 15:57:43.591495: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eb0700 of size 256 next 4 2020-06-24 15:57:43.591618: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eb0800 of size 256 next 5 2020-06-24 15:57:43.591745: I tensorflow/core/common_runtime/bfc_allocator.cc:950] Free at f00eb0900 of size 79360 next 6 2020-06-24 15:57:43.591866: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec3f00 of size 256 next 12 2020-06-24 15:57:43.591993: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4000 of size 256 next 8 2020-06-24 15:57:43.592114: I tensorflow/core/common_runtime/bfc_allocator.cc:950] Free at f00ec4100 of size 256 next 9 2020-06-24 15:57:43.592232: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4200 of size 256 next 13 2020-06-24 15:57:43.592353: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4300 of size 256 next 14 2020-06-24 15:57:43.592484: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4400 of size 1024 next 15 2020-06-24 15:57:43.592608: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4800 of size 256 next 16 2020-06-24 15:57:43.592730: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4900 of size 256 next 18 2020-06-24 15:57:43.592852: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4a00 of size 256 next 19 2020-06-24 15:57:43.592971: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4b00 of size 256 next 20 2020-06-24 15:57:43.593095: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4c00 of size 256 next 21 2020-06-24 15:57:43.593220: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4d00 of size 256 next 22 2020-06-24 15:57:43.593340: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec4e00 of size 1024 next 23 2020-06-24 15:57:43.593584: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec5200 of size 1024 next 10 2020-06-24 15:57:43.593726: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00ec5600 of size 153856 next 7 2020-06-24 15:57:43.593801: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00eeaf00 of size 78592 next 17 2020-06-24 15:57:43.593866: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00efe200 of size 78592 next 3 2020-06-24 15:57:43.593923: I tensorflow/core/common_runtime/bfc_allocator.cc:950] InUse at f00f11500 of size 313600 next 11 2020-06-24 15:57:43.593983: I tensorflow/core/common_runtime/bfc_allocator.cc:950] Free at f00f5de00 of size 447410688 next 18446744073709551615 2020-06-24 15:57:43.594039: I tensorflow/core/common_runtime/bfc_allocator.cc:955] Summary of in-use Chunks by size: 2020-06-24 15:57:43.594117: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 14 Chunks of size 256 totalling 3.5KiB 2020-06-24 15:57:43.594197: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 3 Chunks of size 1024 totalling 3.0KiB 2020-06-24 15:57:43.594274: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 1 Chunks of size 1280 totalling 1.2KiB 2020-06-24 15:57:43.594359: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 2 Chunks of size 78592 totalling 153.5KiB 2020-06-24 15:57:43.594449: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 1 Chunks of size 153856 totalling 150.2KiB 2020-06-24 15:57:43.594539: I tensorflow/core/common_runtime/bfc_allocator.cc:958] 1 Chunks of size 313600 totalling 306.2KiB 2020-06-24 15:57:43.594629: I tensorflow/core/common_runtime/bfc_allocator.cc:962] Sum Total of in-use chunks: 617.8KiB 2020-06-24 15:57:43.594716: I tensorflow/core/common_runtime/bfc_allocator.cc:964] total_region_allocated_bytes_: 448122880 memory_limit_: 448122880 available bytes: 0 curr_region_allocation_bytes_: 896245760 2020-06-24 15:57:43.594827: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Stats: Limit: 448122880 InUse: 632576 MaxInUse: 632576 NumAllocs: 87 MaxAllocSize: 313600 2020-06-24 15:57:43.594929: W tensorflow/core/common_runtime/bfc_allocator.cc:429] *___________________________________________________________________________________________________ 2020-06-24 15:57:43.595095: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger Requested amount of GPU memory (1073741824 bytes) could not be allocated. There may not be enough free memory for allocation to succeed. 2020-06-24 15:57:43.595280: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger /home/jenkins/workspace/TensorRT/helpers/rel-7.1/L1_Nightly_Internal/build/source/rtSafe/resources.h (181) - OutOfMemory Error in GpuMemory: 0 2020-06-24 15:57:43.610665: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger /home/jenkins/workspace/TensorRT/helpers/rel-7.1/L1_Nightly_Internal/build/source/rtSafe/resources.h (181) - OutOfMemory Error in GpuMemory: 0 2020-06-24 15:57:43.610845: W tensorflow/compiler/tf2tensorrt/kernels/trt_engine_op.cc:751] Engine creation for PartitionedCall/TRTEngineOp_0 failed. The native segment will be used instead. Reason: Internal: Failed to build TensorRT engine 2020-06-24 15:57:43.615932: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10 2020-06-24 15:57:43.620093: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.8 (100, 10) (100,) Accuracy of predictions = 89.00 % Finished inference; time taken = 36.599 s