(ahn37) [ec2-user@ip-172-16-88-29 gcs-sum_abstract-headnote-service]$ python sagemaker/scripts/tensorrt_compile.py --InputModelDir sagemaker/build/ahn-summarizer-model/1593502000 --OutputModelDir sagemaker/compile/tensorrt/1 TensorFlow version: 1.15.5 2021-01-27 13:50:28.944531: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2021-01-27 13:50:28.968501: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2300030000 Hz 2021-01-27 13:50:28.968907: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x5645d8a8de40 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2021-01-27 13:50:28.968944: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version WARNING:tensorflow:From /home/ec2-user/SageMaker/envs/ahn37/lib/python3.7/site-packages/tensorflow_core/python/compiler/tensorrt/trt_convert.py:494: load (from tensorflow.python.saved_model.loader_impl) is deprecated and will be removed in a future version. Instructions for updating: This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.loader.load or tf.compat.v1.saved_model.load. There will be a new function for importing SavedModels in Tensorflow 2.0. WARNING:tensorflow:From /home/ec2-user/SageMaker/envs/ahn37/lib/python3.7/site-packages/tensorflow_core/python/compiler/tensorrt/trt_convert.py:517: convert_variables_to_constants (from tensorflow.python.framework.graph_util_impl) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.compat.v1.graph_util.convert_variables_to_constants` WARNING:tensorflow:From /home/ec2-user/SageMaker/envs/ahn37/lib/python3.7/site-packages/tensorflow_core/python/framework/graph_util_impl.py:277: extract_sub_graph (from tensorflow.python.framework.graph_util_impl) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.compat.v1.graph_util.extract_sub_graph` 2021-01-27 13:51:09.774633: I tensorflow/core/grappler/devices.cc:60] Number of eligible GPUs (core count >= 8, compute capability >= 0.0): 0 (Note: TensorFlow was not compiled with CUDA support) 2021-01-27 13:51:09.774752: I tensorflow/core/grappler/clusters/single_machine.cc:356] Starting new session 2021-01-27 13:51:42.069747: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:786] Optimization results for grappler item: tf_graph 2021-01-27 13:51:42.069790: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 6126 nodes (-495), 8971 edges (-542), time = 16302.9883ms. 2021-01-27 13:51:42.069815: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] layout: layout did nothing. time = 7.763ms. 2021-01-27 13:51:42.069832: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 6126 nodes (0), 8971 edges (0), time = 7243.35693ms. 2021-01-27 13:51:42.069847: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 6126 nodes (0), 8971 edges (0), time = 5309.99707ms. 2021-01-27 13:51:42.069863: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:786] Optimization results for grappler item: __inference_Dataset_map_Headnotes.decode_example_29 2021-01-27 13:51:42.069879: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 15 nodes (-2), 18 edges (-2), time = 1.322ms. 2021-01-27 13:51:42.069894: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] layout: layout did nothing. time = 0.032ms. 2021-01-27 13:51:42.069911: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 15 nodes (0), 18 edges (0), time = 0.703ms. 2021-01-27 13:51:42.069926: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 15 nodes (0), 18 edges (0), time = 0.737ms. 2021-01-27 13:51:42.069943: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:786] Optimization results for grappler item: __inference_Dataset_map_standardize_shapes_82 2021-01-27 13:51:42.069959: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 17 nodes (0), 14 edges (0), time = 0.588ms. 2021-01-27 13:51:42.070338: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] layout: layout did nothing. time = 0.026ms. 2021-01-27 13:51:42.070373: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 17 nodes (0), 14 edges (0), time = 0.628ms. 2021-01-27 13:51:42.070392: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 17 nodes (0), 14 edges (0), time = 0.638ms. 2021-01-27 13:51:42.070410: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:786] Optimization results for grappler item: __inference_Dataset_map__38 2021-01-27 13:51:42.070426: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 9 nodes (0), 6 edges (0), time = 0.336ms. 2021-01-27 13:51:42.070442: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] layout: layout did nothing. time = 0.015ms. 2021-01-27 13:51:42.070459: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 9 nodes (0), 6 edges (0), time = 0.376ms. 2021-01-27 13:51:42.070475: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 9 nodes (0), 6 edges (0), time = 0.374ms. 2021-01-27 13:51:42.070491: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:786] Optimization results for grappler item: __inference_Dataset_map_cast_ints_to_int32_50 2021-01-27 13:51:42.070508: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 12 nodes (0), 9 edges (0), time = 0.437ms. 2021-01-27 13:51:42.070525: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] layout: layout did nothing. time = 0.018ms. 2021-01-27 13:51:42.070542: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 12 nodes (0), 9 edges (0), time = 0.461ms. 2021-01-27 13:51:42.070558: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:788] constant_folding: Graph size after: 12 nodes (0), 9 edges (0), time = 0.464ms. [libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/message_lite.cc:406] tensorflow.GraphDef exceeded maximum protobuf size of 2GB: 2697675801 (ahn37) [ec2-user@ip-172-16-88-29 gcs-sum_abstract-headnote-service]$