TAO Toolkit - FPENet - Dataset_Convert error

Hi there,

I am running the TAO via the instructions on the QuickStart Guide and TAO Launcher here.

I am running the fpenet notebook in the [tao_launcher_starter_kit/fpenet/fpenet.ipynb] directory.

Tao appears to be installed successfully.

# View the versions of the TAO launcher
!tao info

Configuration of the TAO Toolkit Instance
dockers: ['nvidia/tao/tao-toolkit']
format_version: 2.0
toolkit_version: 4.0.1
published_date: 03/06/2023

However, at the step
!tao model fpenet dataset_convert -e $SPECS_DIR/$DATASET_CONFIG -r $USER_EXPERIMENT_DIR

I get the following error:

usage: tao [-h]
           {list,stop,info,action_recognition,augment,bpnet,classification_tf1,classification_tf2,converter,deformable_detr,detectnet_v2,dssd,efficientdet_tf1,efficientdet_tf2,emotionnet,faster_rcnn,fpenet,gazenet,gesturenet,heartratenet,intent_slot_classification,lprnet,mask_rcnn,multitask_classification,n_gram,pointpillars,pose_classification,punctuation_and_capitalization,question_answering,re_identification,retinanet,segformer,spectro_gen,speech_to_text,speech_to_text_citrinet,speech_to_text_conformer,ssd,text_classification,token_classification,unet,vocoder,yolo_v3,yolo_v4,yolo_v4_tiny}
           ...
tao: error: invalid choice: 'model' (choose from 'list', 'stop', 'info', 'action_recognition', 'augment', 'bpnet', 'classification_tf1', 'classification_tf2', 'converter', 'deformable_detr', 'detectnet_v2', 'dssd', 'efficientdet_tf1', 'efficientdet_tf2', 'emotionnet', 'faster_rcnn', 'fpenet', 'gazenet', 'gesturenet', 'heartratenet', 'intent_slot_classification', 'lprnet', 'mask_rcnn', 'multitask_classification', 'n_gram', 'pointpillars', 'pose_classification', 'punctuation_and_capitalization', 'question_answering', 're_identification', 'retinanet', 'segformer', 'spectro_gen', 'speech_to_text', 'speech_to_text_citrinet', 'speech_to_text_conformer', 'ssd', 'text_classification', 'token_classification', 'unet', 'vocoder', 'yolo_v3', 'yolo_v4', 'yolo_v4_tiny')

I just asked for something similar, remove “model” from the command.

Thanks for this. I tried this and now get a timeout error…

2023-10-03 17:32:55,716 [INFO] root: Registry: ['nvcr.io']
2023-10-03 17:32:55,778 [INFO] tlt.components.instance_handler.local_instance: Running command in container: nvcr.io/nvidia/tao/tao-toolkit:4.0.0-tf1.15.5
2023-10-03 17:32:55,816 [WARNING] tlt.components.docker_handler.docker_handler: 
Docker will run the commands as root. If you would like to retain your
local host permissions, please add the "user":"UID:GID" in the
DockerOptions portion of the "/home/brad/.tao_mounts.json" file. You can obtain your
users UID and GID by using the "id -u" and "id -g" commands on the
terminal.
Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 461, in _make_request
    httplib_response = conn.getresponse()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 1379, in getresponse
    response.begin()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 311, in begin
    version, status, reason = self._read_status()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 272, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/requests/adapters.py", line 450, in send
    timeout=timeout
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 799, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 721, in urlopen
    chunked=chunked,
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 468, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 358, in _raise_timeout
    self, url, "Read timed out. (read timeout=%s)" % timeout_value
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/bin/tao", line 8, in <module>
    sys.exit(main())
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/tlt/entrypoint/tao.py", line 116, in main
    args[1:]
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/tlt/components/instance_handler/local_instance.py", line 319, in launch_command
    docker_handler.run_container(command)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/tlt/components/docker_handler/docker_handler.py", line 289, in run_container
    self.start_container(volumes, env_variables, docker_options)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/tlt/components/docker_handler/docker_handler.py", line 271, in start_container
    **docker_args
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/models/containers.py", line 816, in run
    container.start()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/models/containers.py", line 404, in start
    return self.client.api.start(self.id, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/api/container.py", line 1107, in start
    res = self._post(url)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/docker/api/client.py", line 224, in _post
    return self.post(url, **self._set_request_timeout(kwargs))
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/requests/sessions.py", line 577, in post
    return self.request('POST', url, data=data, json=json, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/requests/sessions.py", line 529, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/requests/sessions.py", line 645, in send
    r = adapter.send(request, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/requests/adapters.py", line 532, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

I also tried

export DOCKER_CLIENT_TIMEOUT=600
export COMPOSE_HTTP_TIMEOUT=600
sudo systemctl restart docker

And have the same issue

I think that this issue is with the host permissions to run docker, you followed the post docker installation instructions?

Yes, I can run Docker successfully. (Even in the training notebook)

!docker run hello-world

Hello from Docker!
This message shows that your installation appears to be working correctly.

To generate this message, Docker took the following steps:
 1. The Docker client contacted the Docker daemon.
 2. The Docker daemon pulled the "hello-world" image from the Docker Hub.
    (amd64)
 3. The Docker daemon created a new container from that image which runs the
    executable that produces the output you are currently reading.
 4. The Docker daemon streamed that output to the Docker client, which sent it
    to your terminal.

To try something more ambitious, you can run an Ubuntu container with:
 $ docker run -it ubuntu bash

Share images, automate workflows, and more with a free Docker ID:
 https://hub.docker.com/

For more examples and ideas, visit:
 https://docs.docker.com/get-started/

Next cell---->

!tao fpenet dataset_convert -e $SPECS_DIR/$DATASET_CONFIG -r $USER_EXPERIMENT_DIR

2023-10-03 18:23:56,183 [INFO] root: Registry: ['nvcr.io']
2023-10-03 18:23:56,248 [INFO] tlt.components.instance_handler.local_instance: Running command in container: nvcr.io/nvidia/tao/tao-toolkit:4.0.0-tf1.15.5
2023-10-03 18:23:56,311 [WARNING] tlt.components.docker_handler.docker_handler: 
Docker will run the commands as root. If you would like to retain your
local host permissions, please add the "user":"UID:GID" in the
DockerOptions portion of the "/home/brad/.tao_mounts.json" file. You can obtain your
users UID and GID by using the "id -u" and "id -g" commands on the
terminal.
Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/site-packages/urllib3/connectionpool.py", line 461, in _make_request
    httplib_response = conn.getresponse()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 1379, in getresponse
    response.begin()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 311, in begin
    version, status, reason = self._read_status()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/http/client.py", line 272, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/brad/miniconda3/envs/launcher/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

etc etc

When I run the dataset convert command in other example I don’t have any warning at all:

Converting the training set to TFRecords.
2023-10-03 08:18:16,626 [INFO] root: Registry: ['nvcr.io']
2023-10-03 08:18:16,711 [INFO] tlt.components.instance_handler.local_instance: Running command in container: nvcr.io/nvidia/tao/tao-toolkit:4.0.0-tf1.15.5
Using TensorFlow backend.

Where did you execute the Docker commands? I believe they should be run on the host PC, not within the Docker container.

In both the notebook and in local environment (not in notebook). I get the same issue.

Hi,

In other post someone pointed that if you create an environment with Python 3.7 instead of 3.6 the commands from the notebook works, maybe you can change that and try again…

Thank you for the suggestion.

I reran the notebook under 3.7. Now it doesn’t need model command removed. But the same issue occurs.

!tao model fpenet dataset_convert -e $SPECS_DIR/$DATASET_CONFIG -r $USER_EXPERIMENT_DIR
2023-10-04 09:23:41,469 [TAO Toolkit] [INFO] root 160: Registry: ['nvcr.io']
2023-10-04 09:23:41,525 [TAO Toolkit] [INFO] nvidia_tao_cli.components.instance_handler.local_instance 361: Running command in container: nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5
2023-10-04 09:23:41,574 [TAO Toolkit] [WARNING] nvidia_tao_cli.components.docker_handler.docker_handler 267: 
Docker will run the commands as root. If you would like to retain your
local host permissions, please add the "user":"UID:GID" in the
DockerOptions portion of the "/home/brad/.tao_mounts.json" file. You can obtain your
users UID and GID by using the "id -u" and "id -g" commands on the
terminal.
2023-10-04 09:23:41,574 [TAO Toolkit] [INFO] nvidia_tao_cli.components.docker_handler.docker_handler 275: Printing tty value True
Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 461, in _make_request
    httplib_response = conn.getresponse()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/http/client.py", line 1373, in getresponse
    response.begin()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/http/client.py", line 319, in begin
    version, status, reason = self._read_status()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/http/client.py", line 280, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/requests/adapters.py", line 497, in send
    chunked=chunked,
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 799, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 721, in urlopen
    chunked=chunked,
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 468, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/urllib3/connectionpool.py", line 358, in _raise_timeout
    self, url, "Read timed out. (read timeout=%s)" % timeout_value
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/brad/miniconda3/envs/launcher/bin/tao", line 8, in <module>
    sys.exit(main())
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/entrypoint/tao_launcher.py", line 137, in main
    args[2:]
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/instance_handler/local_instance.py", line 382, in launch_command
    docker_handler.run_container(command)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/docker_handler/docker_handler.py", line 309, in run_container
    self.start_container(volumes, env_variables, docker_options)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/docker_handler/docker_handler.py", line 287, in start_container
    **docker_args
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/models/containers.py", line 816, in run
    container.start()
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/models/containers.py", line 404, in start
    return self.client.api.start(self.id, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/api/container.py", line 1107, in start
    res = self._post(url)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/docker/api/client.py", line 224, in _post
    return self.post(url, **self._set_request_timeout(kwargs))
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/requests/sessions.py", line 637, in post
    return self.request("POST", url, data=data, json=json, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/home/brad/miniconda3/envs/launcher/lib/python3.7/site-packages/requests/adapters.py", line 532, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Could you open a new terminal instead of notebook, and then run follow command?
$ docker run --runtime=nvidia -it --rm nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5 /bin/bash
then
# fpenet dataset_convert xxx

Hi there,

I ended up getting this working on an EC2 with much effort. However steps still fail. In particular the part where it installs pycocotools from the deps directory.

Regards,

Brad

Please share the latest full log.

The line

# Install requirement
!pip3 install -r $SAMPLES_DIR/deps/requirements-pip.txt

Never passes

/usr/bin/pip3:6: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
  from pkg_resources import load_entry_point
Collecting numpy<=1.19.5,>=1.17.0
  Using cached numpy-1.19.5-cp38-cp38-manylinux2010_x86_64.whl (14.9 MB)
Collecting opencv-python<=4.5.5.64,>=3.4.0.12
  Using cached opencv_python-4.5.5.64-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (60.5 MB)
Collecting pillow<=9.0.1,>=8.1.0
  Using cached Pillow-9.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB)
Collecting matplotlib<=3.5.1,>=3.1.1
  Using cached matplotlib-3.5.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (11.3 MB)
Collecting scipy<=1.8.0,>=1.5.4
  Using cached scipy-1.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (41.6 MB)
Collecting h5py<=3.6.0,>=3.1.0
  Using cached h5py-3.6.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (4.5 MB)
Collecting joblib<=1.1.0,>=1.0.1
  Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting pycocotools<=2.0.4,>=2.0.2
  Using cached pycocotools-2.0.4.tar.gz (106 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting wandb<=0.13.3,>=0.12.17
  Using cached wandb-0.13.3-py2.py3-none-any.whl (1.8 MB)
Requirement already satisfied: urllib3<2.0.0,>=1.26.15 in /home/ubuntu/.local/lib/python3.8/site-packages (from -r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 10)) (1.26.17)
Collecting cycler>=0.10
  Using cached cycler-0.12.0-py3-none-any.whl (8.2 kB)
Collecting fonttools>=4.22.0
  Using cached fonttools-4.43.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB)
Collecting kiwisolver>=1.0.1
  Using cached kiwisolver-1.4.5-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.2 MB)
Requirement already satisfied: packaging>=20.0 in /home/ubuntu/.local/lib/python3.8/site-packages (from matplotlib<=3.5.1,>=3.1.1->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 4)) (23.2)
Collecting pyparsing>=2.2.1
  Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Requirement already satisfied: python-dateutil>=2.7 in /home/ubuntu/.local/lib/python3.8/site-packages (from matplotlib<=3.5.1,>=3.1.1->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 4)) (2.8.2)
Requirement already satisfied: Click!=8.0.0,>=7.0 in /usr/lib/python3/dist-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (7.0)
Collecting GitPython>=1.0.0
  Using cached GitPython-3.1.37-py3-none-any.whl (190 kB)
Requirement already satisfied: requests<3,>=2.0.0 in /home/ubuntu/.local/lib/python3.8/site-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (2.31.0)
Processing /home/ubuntu/.cache/pip/wheels/54/aa/01/724885182f93150035a2a91bce34a12877e8067a97baaf5dc8/promise-2.3-py3-none-any.whl
Collecting shortuuid>=0.5.0
  Using cached shortuuid-1.0.11-py3-none-any.whl (10 kB)
Requirement already satisfied: psutil>=5.0.0 in /home/ubuntu/.local/lib/python3.8/site-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (5.9.5)
Collecting sentry-sdk>=1.0.0
  Using cached sentry_sdk-1.31.0-py2.py3-none-any.whl (224 kB)
Requirement already satisfied: six>=1.13.0 in /home/ubuntu/.local/lib/python3.8/site-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (1.15.0)
Requirement already satisfied: docker-pycreds>=0.4.0 in /home/ubuntu/.local/lib/python3.8/site-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (0.4.0)
Collecting protobuf<4.0dev,>=3.12.0
  Using cached protobuf-3.20.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: PyYAML in /usr/lib/python3/dist-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (5.3.1)
Processing /home/ubuntu/.cache/pip/wheels/4c/8e/7e/72fbc243e1aeecae64a96875432e70d4e92f3d2d18123be004/pathtools-0.1.2-py3-none-any.whl
Collecting setproctitle
  Using cached setproctitle-1.3.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31 kB)
Requirement already satisfied: setuptools in /home/ubuntu/.local/lib/python3.8/site-packages (from wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (68.2.2)
Collecting gitdb<5,>=4.0.1
  Using cached gitdb-4.0.10-py3-none-any.whl (62 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/ubuntu/.local/lib/python3.8/site-packages (from requests<3,>=2.0.0->wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (3.3.0)
Requirement already satisfied: idna<4,>=2.5 in /home/ubuntu/.local/lib/python3.8/site-packages (from requests<3,>=2.0.0->wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in /home/ubuntu/.local/lib/python3.8/site-packages (from requests<3,>=2.0.0->wandb<=0.13.3,>=0.12.17->-r /home/ubuntu/getting_started_v5.0.0/notebooks/tao_launcher_starter_kit/deps/requirements-pip.txt (line 9)) (2023.7.22)
Collecting smmap<6,>=3.0.1
  Using cached smmap-5.0.1-py3-none-any.whl (24 kB)
Building wheels for collected packages: pycocotools
  Building wheel for pycocotools (PEP 517) ... error
  ERROR: Command errored out with exit status 1:
   command: /usr/bin/python3 /tmp/tmpeyjbzxih build_wheel /tmp/tmpenpxnl_2
       cwd: /tmp/pip-install-r_gayit4/pycocotools
  Complete output (25 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-cpython-38
  creating build/lib.linux-x86_64-cpython-38/pycocotools
  copying pycocotools/__init__.py -> build/lib.linux-x86_64-cpython-38/pycocotools
  copying pycocotools/mask.py -> build/lib.linux-x86_64-cpython-38/pycocotools
  copying pycocotools/coco.py -> build/lib.linux-x86_64-cpython-38/pycocotools
  copying pycocotools/cocoeval.py -> build/lib.linux-x86_64-cpython-38/pycocotools
  running build_ext
  Compiling pycocotools/_mask.pyx because it changed.
  [1/1] Cythonizing pycocotools/_mask.pyx
  building 'pycocotools._mask' extension
  creating build/common
  creating build/temp.linux-x86_64-cpython-38
  creating build/temp.linux-x86_64-cpython-38/common
  creating build/temp.linux-x86_64-cpython-38/pycocotools
  x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/tmp/pip-build-env-ffjdiit6/overlay/lib/python3.8/site-packages/numpy/core/include -I./common -I/usr/include/python3.8 -c ../common/maskApi.c -o build/temp.linux-x86_64-cpython-38/../common/maskApi.o -Wno-cpp -Wno-unused-function -std=c99
  x86_64-linux-gnu-gcc: error: ../common/maskApi.c: No such file or directory
  x86_64-linux-gnu-gcc: fatal error: no input files
  compilation terminated.
  /tmp/pip-build-env-ffjdiit6/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:384: FutureWarning: Cython directive 'language_level' not set, using '3str' for now (Py3). This has changed from earlier releases! File: /tmp/pip-install-r_gayit4/pycocotools/pycocotools/_mask.pyx
    tree = Parsing.p_module(s, pxd, full_module_name)
  error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1
  ----------------------------------------
  ERROR: Failed building wheel for pycocotools
Failed to build pycocotools
ERROR: Could not build wheels for pycocotools which use PEP 517 and cannot be installed directly

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

The log are from running in AWS EC2, right? Can you check if it meets the software requirement? Is it Ubuntu 20.04?
Share another topic which can work on EC2: Mismatch in python environment on AWS EC2 image - #9 by tom_s

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.