Hi @Morganh ,
Output for command: tao info --verbose
Configuration of the TAO Toolkit Instance
dockers:
nvidia/tao/tao-toolkit-tf:
v3.21.11-tf1.15.5-py3:
docker_registry: nvcr.io
tasks:
1. augment
2. bpnet
3. classification
4. dssd
5. emotionnet
6. efficientdet
7. fpenet
8. gazenet
9. gesturenet
10. heartratenet
11. lprnet
12. mask_rcnn
13. multitask_classification
14. retinanet
15. ssd
16. unet
17. yolo_v3
18. yolo_v4
19. yolo_v4_tiny
20. converter
v3.21.11-tf1.15.4-py3:
docker_registry: nvcr.io
tasks:
1. detectnet_v2
2. faster_rcnn
nvidia/tao/tao-toolkit-pyt:
v3.21.11-py3:
docker_registry: nvcr.io
tasks:
1. speech_to_text
2. speech_to_text_citrinet
3. text_classification
4. question_answering
5. token_classification
6. intent_slot_classification
7. punctuation_and_capitalization
8. action_recognition
v3.22.02-py3:
docker_registry: nvcr.io
tasks:
1. spectro_gen
2. vocoder
nvidia/tao/tao-toolkit-lm:
v3.21.08-py3:
docker_registry: nvcr.io
tasks:
1. n_gram
format_version: 2.0
toolkit_version: 3.22.02
published_date: 02/28/2022
Output for command: tao list
Traceback (most recent call last):
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 426, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 421, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.6/http/client.py", line 1377, in getresponse
response.begin()
File "/usr/lib/python3.6/http/client.py", line 320, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.6/http/client.py", line 281, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 727, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/util/retry.py", line 403, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/packages/six.py", line 735, in reraise
raise value
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 677, in urlopen
chunked=chunked,
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 428, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
self, url, "Read timed out. (read timeout=%s)" % timeout_value
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/soundarrajan/Envs/tao_exp_venv/bin/tao", line 8, in <module>
sys.exit(main())
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/tlt/entrypoint/entrypoint.py", line 110, in main
parsed_args
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/tlt/components/instance_handler/local_instance.py", line 329, in launch_command
self.list_running_jobs()
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/tlt/components/instance_handler/local_instance.py", line 188, in list_running_jobs
container_list = self._get_running_containers()
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/tlt/components/instance_handler/local_instance.py", line 167, in _get_running_containers
return [container for container in self._docker_client.containers.list()
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/models/containers.py", line 951, in list
containers.append(self.get(r['Id']))
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/models/containers.py", line 887, in get
resp = self.client.api.inspect_container(container_id)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/api/container.py", line 771, in inspect_container
self._get(self._url("/containers/{0}/json", container)), True
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/docker/api/client.py", line 228, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/requests/sessions.py", line 543, in get
return self.request('GET', url, **kwargs)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/requests/sessions.py", line 530, in request
resp = self.send(prep, **send_kwargs)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/requests/sessions.py", line 643, in send
r = adapter.send(request, **kwargs)
File "/home/soundarrajan/Envs/tao_exp_venv/lib/python3.6/site-packages/requests/adapters.py", line 529, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Output for command: tao detectnet_v2 --help
Running more than 1 hour showing the same output as below.
2022-06-02 11:54:51,708 [INFO] root: Registry: ['nvcr.io']
2022-06-02 11:54:51,794 [INFO] tlt.components.instance_handler.local_instance: Running command in container: nvcr.io/nvidia/tao/tao-toolkit-tf:v3.21.11-tf1.15.4-py3
2022-06-02 11:54:52,122 [INFO] tlt.components.docker_handler.docker_handler: The required docker doesn't exist locally/the manifest has changed. Pulling a new docker.
2022-06-02 11:54:52,123 [INFO] tlt.components.docker_handler.docker_handler: Pulling the required container. This may take several minutes if you're doing this for the first time. Please wait here.
...
Pulling from repository: nvcr.io/nvidia/tao/tao-toolkit-tf
checked nvcr.io login using command: docker login
Login Succeeded.
Anything i’m missing? Kindly help to identify and fix