INFO:__main__:Program started. INFO:app.App:Runtime env settings: {'input_folder': '/input', 'output_folder': '/output', 'logs_folder': '/logs', 'publish_folder': '/publish', 'series_selection_folder': '/series_selection', 'trtis_uri': '10.111.163.168:8000', 'config_inference_path': 'app_base_inference_v2/config/config_inference.json', 'nii_extension': '.nii'} INFO:app.App:Config details: {'name': 'LoadNifti', 'args': {'fields': 'image'}} INFO:app.App:Config details: {'name': 'ConvertToChannelsFirst', 'args': {'fields': 'image'}} INFO:app.App:Config details: {'name': 'ScaleBySpacing', 'args': {'fields': 'image', 'target_spacing': [1.0, 1.0, 1.0]}} INFO:app.App:Config details: {'name': 'ScaleIntensityRange', 'args': {'fields': 'image', 'a_min': 1600, 'a_max': 3000, 'b_min': 0.0, 'b_max': 1.0, 'clip': True}} INFO:app.App:Config details: {'name': 'ArgmaxAcrossChannels', 'args': {'fields': 'model'}} INFO:app.App:Config details: {'name': 'RestoreOriginalShape', 'args': {'field': 'model', 'src_field': 'image', 'is_label': True}} INFO:app.App:Config details: {'name': 'CopyProperties', 'args': {'fields': ['model'], 'from_field': 'image', 'properties': ['affine']}} INFO:app.App:Model name:segmentation_chestxray_v1 INFO:app.App:Trying to check TRTIS server health ... INFO:model_loaders.trtis_config.TRTISConfig:output_type set to InferContext.ResultFormat.RAW: (1,) INFO:model_loaders.trtis_config.TRTISConfig:TRTIS Config {"ip": "10.111.163.168", "port": "8000", "protocol": 0, "verbose": false, "streaming": false, "output_type": [1], "shmem": "no", "use_cupy": false} WARNING:app.App:model_loader config item is not used. INFO:app.App:Found only one supported file. INFO:app.App:Selected input file: /input/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.mhd, and its extension: .mhd INFO:root:MHD metadata[ITK_InputFilterName]: MetaImageIO INFO:app.App:Input file converted for transforms: /tmp/tmp433ro8ky/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.nii. Extracted properties: {'Spacing': (1.0, 1.0, 1.0), 'Origin': (0.0, 0.0, 0.0), 'Direction': (1.0, 0.0, 0.0, 0.0, 1.0, 0.0, 0.0, 0.0, 1.0)}. INFO:app.App:File list for transforms: [{'image': '/tmp/tmp433ro8ky/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.nii'}] INFO:app.App:Writer dtype "uint8", field "model", and path "/output/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.mhd" INFO:app.App:Generated Output file name: /output/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.mhd INFO:TRTISScanWindowInferer:model_input_values: {'image': array([[[[[0.], [0.], [0.], ..., [0.], [0.], [0.]], [[0.], [0.], [0.], ..., [0.], [0.], [0.]], [[0.], [0.], [0.], ..., [0.], [0.], [0.]], ..., [[0.], [0.], [0.], ..., [0.], [0.], [0.]], [[0.], [0.], [0.], ..., [0.], [0.], [0.]], [[0.], [0.], [0.], ..., [0.], [0.], [0.]]]]], dtype=float32), 'image.affine': array([[[-1., 0., 0., -0.], [ 0., -1., 0., -0.], [ 0., 0., 1., 0.], [ 0., 0., 0., 1.]]]), 'image.original_affine': array([[[-1., 0., 0., -0.], [ 0., -1., 0., -0.], [ 0., 0., 1., 0.], [ 0., 0., 0., 1.]]]), 'image.file_name': array(['/tmp/tmp433ro8ky/1.2.826.0.1.3680043.2.1125.1.39922379544571101118490265278518193.nii'], dtype=' scan_num = [int(math.ceil(float(image_size[i]) / scan_interval[i])) for i in range(num_spatial_dims)] ZeroDivisionError: float division by zero ERROR:__main__:float division by zero Traceback (most recent call last): File "app_base_inference_v2/main.py", line 54, in execute app.execute() File "/app_base_inference_v2/app.py", line 389, in execute inference_executor.evaluate() File "workflows/evaluators/bulk_evaluator.py", line 454, in evaluate File "workflows/evaluators/bulk_evaluator.py", line 386, in _do_evaluate File "workflows/evaluators/bulk_evaluator.py", line 137, in process File "/app_base_inference_v2/inferers/trtis_sw_inferer.py", line 230, in infer scan_num = [int(math.ceil(float(image_size[i]) / scan_interval[i])) for i in range(num_spatial_dims)] File "/app_base_inference_v2/inferers/trtis_sw_inferer.py", line 230, in scan_num = [int(math.ceil(float(image_size[i]) / scan_interval[i])) for i in range(num_spatial_dims)] ZeroDivisionError: float division by zero Traceback (most recent call last): File "/usr/local/lib/python3.6/dist-packages/nvidia_clara_pipeline_driver/driver.py", line 209, in nvidia_clara_python_cpd_execute_callback success = driver.run_execute_handler(payload) File "/usr/local/lib/python3.6/dist-packages/nvidia_clara_pipeline_driver/driver.py", line 154, in run_execute_handler return self._execute_handler(self, payload) {"event": {"category": "operator", "name":"processing_started", "level": "info", "timestamp": "20211126T083238.317Z"}, "message": "AI-base_inference"} File "app_base_inference_v2/main.py", line 54, in execute app.execute() [PERF] AI-base_inference Start Time: 1637915558318 {"event": {"category": "operator", "name":"processing_started", "level": "info", "timestamp": "20211126T083239.329Z", "stage": "application setup"}, "message": "AI-base_inference Application setup"} File "/app_base_inference_v2/app.py", line 389, in execute [PERF] AI-base_inference Application setup Start Time: 1637915559329 inference_executor.evaluate() {"event": {"category": "operator","name":"processing_ended", "level": "info", "timestamp": "20211126T083240.714Z", "elapsed_time": 1385, "stage": "application setup"},"message":"AI-base_inference Application setup"} File "workflows/evaluators/bulk_evaluator.py", line 454, in evaluate [PERF] AI-base_inference Application setup End Time: 1637915560714 File "workflows/evaluators/bulk_evaluator.py", line 386, in _do_evaluate [PERF] AI-base_inference Application setup Elapsed Time (ms): 1385 File "workflows/evaluators/bulk_evaluator.py", line 137, in process {"event": {"category": "operator", "name":"processing_started", "level": "info", "timestamp": "20211126T083240.714Z", "stage": "application execute"}, "message": "AI-base_inference Application execute"} [PERF] AI-base_inference Application execute Start Time: 1637915560714 File "/app_base_inference_v2/inferers/trtis_sw_inferer.py", line 230, in infer {"event": {"category": "operator", "name":"processing_started", "level": "info", "timestamp": "20211126T083240.714Z", "stage": "input selection and conversion"}, "message": "AI-base_inference Input selection and conversion"} scan_num = [int(math.ceil(float(image_size[i]) / scan_interval[i])) for i in range(num_spatial_dims)] [PERF] AI-base_inference Input selection and conversion Start Time: 1637915560714 File "/app_base_inference_v2/inferers/trtis_sw_inferer.py", line 230, in {"event": {"category": "operator","name":"processing_ended", "level": "info", "timestamp": "20211126T083240.749Z", "elapsed_time": 35, "stage": "input selection and conversion"},"message":"AI-base_inference Input selection and conversion"} scan_num = [int(math.ceil(float(image_size[i]) / scan_interval[i])) for i in range(num_spatial_dims)] [PERF] AI-base_inference Input selection and conversion End Time: 1637915560749 ZeroDivisionError: float division by zero [PERF] AI-base_inference Input selection and conversion Elapsed Time (ms): 35 [driver] Pipeline driver `execute` callback returned error code (1). (1, is_err=True) {"event": {"category": "operator", "name":"processing_started", "level": "info", "timestamp": "20211126T083240.749Z", "stage": "transforms and inference"}, "message": "AI-base_inference Transforms and Inference"} [driver] Pipeline-driver execution completed with 1 error(s). (-1, is_err=True) [PERF] AI-base_inference Transforms and Inference Start Time: 1637915560749 [driver] nvidia_clara_cpd__wait_for_completion() is deprecated. Previously evaluated: 0 ; To be evaluated: 1 Clara Pipeline Driver no longer expects applications to wait for completion. (0, is_err=True) {"event": {"category": "operator", "name":"processing_ended", "level": "info", "timestamp": "20211126T083241.574Z", "elapsed_time": 3256}, "message": "AI-base_inference"} [PERF] AI-base_inference End Time: 1637915561574 INFO:__main__:Program exited. [PERF] AI-base_inference Elapsed Time (ms): 3256