this is the result.
I tried increasing the iteration and wait time but to no avail.
im running everything on ubuntu 20.4 and latest docker version
Is it that i cant run on my GPU?
Hi @toothsy,
As per logs it seems it failed to access'jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased ', but I don’t see any such model downloaded (In READY) state.
Did you make any updated in config/settings file? If yes, could you please share it so we can help better?
Thanks
I have not actually, could a slow/unstable internet could have caused the issue?
can you point out which part of ./jarvis_start.sh I’m supposed to edit?
Hi @toothsy,
You can modify the config.sh file with your preferred configuration. (which models to retrieve from NGC).
Thanks
Have you solved it?
No it did not, I gave up,basically.
I got the same error and have not solution for now, still trying…, trying only with one model dont help, the same error appear, my GTX1070TI 8G not grow more than 2G of memory used and still fail. PC cpu and memory the same.
Hi @limbail,
Could you please share the error/console log so that we can help better?
Meanwhile, if you are getting any INVALID_CONFIG related errors please try to run jarvis_clean.sh and then jarvis_init.sh.
Thanks
When I run the jarvis_start.sh, i find it need /data/plugins：“ld_preload+=$(docker run --init -it --rm -v $jarvis_model_loc:/data --entrypoint “/bin/bash” $image_speech_api -c “find /data/plugins/*.so -type f ! -size 0 2>/dev/null” | sed ‘s/\r//g’ | paste -sd ‘:’ -)” ， but i have run the jarvis_init.sh, this folder is not exist。
Hi @zhongjieyu,
Could you please share the log and complete command output so we can help better?
Thanks
…
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:45.046134 69 server.cc:235] Timeout 29: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:46.046320 69 server.cc:235] Timeout 28: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:47.046513 69 server.cc:235] Timeout 27: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:48.046726 69 server.cc:235] Timeout 26: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:49.046928 69 server.cc:235] Timeout 25: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:50.047145 69 server.cc:235] Timeout 24: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:51.047340 69 server.cc:235] Timeout 23: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:52.047538 69 server.cc:235] Timeout 22: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:53.047750 69 server.cc:235] Timeout 21: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:54.047964 69 server.cc:235] Timeout 20: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:55.048199 69 server.cc:235] Timeout 19: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:56.048405 69 server.cc:235] Timeout 18: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:57.048634 69 server.cc:235] Timeout 17: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:58.048832 69 server.cc:235] Timeout 16: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:18:59.049007 69 server.cc:235] Timeout 15: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:00.049203 69 server.cc:235] Timeout 14: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:01.049401 69 server.cc:235] Timeout 13: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:02.049596 69 server.cc:235] Timeout 12: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:03.049803 69 server.cc:235] Timeout 11: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:04.050008 69 server.cc:235] Timeout 10: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:05.050200 69 server.cc:235] Timeout 9: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:06.050394 69 server.cc:235] Timeout 8: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:03.049803 69 server.cc:235] Timeout 11: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:04.050008 69 server.cc:235] Timeout 10: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:05.050200 69 server.cc:235] Timeout 9: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:06.050394 69 server.cc:235] Timeout 8: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:07.050589 69 server.cc:235] Timeout 7: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:08.050797 69 server.cc:235] Timeout 6: Found 1 live models and 0 in-flight non-inference requests
I0426 06:19:09.050994 69 server.cc:235] Timeout 5: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:10.051188 69 server.cc:235] Timeout 4: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:11.051381 69 server.cc:235] Timeout 3: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:12.051581 69 server.cc:235] Timeout 2: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:13.051791 69 server.cc:235] Timeout 1: Found 1 live models and 0 in-flight non-inference requests
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0426 06:19:14.051988 69 server.cc:235] Timeout 0: Found 1 live models and 0 in-flight non-inference requests
error: creating server: Internal - failed to load all models
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Triton server died before reaching ready state. Terminating Jarvis startup.
Check Triton logs with: docker logs
/opt/jarvis/bin/start-jarvis: line 1: kill: (69) - No such process
And, I find the docker container will been closed, when i run the jarvis_start.sh
when i run the jarvis_init.sh, In jarvis_model_loc, these three folders is generated.
but i don’t know why generate ld_preload based on what’s deployed in /data/plugins in jarvis_start.sh?
Could you please attach the complete output of docker logs jarvis-speech?
Also, please share the system details on which your are trying to deploy this (GPU type, CUDA version etc)
Hi Sunil, great job with moderating and making recommendations! It has painstakingly made it to this point, and since I am not in the tech industry, find this to be a foreign language. I am however determined to take advantage of NVIDIA’s amazing resources. I am attaching 2 screenshots to show you where I am at, and I feel as though it’s close, like I can taste, but not quite yet! :-) Any help would be greatly appreciated, grazi!
And then he is another, for your reference, thank you kindly…still waiting to connect to a server, and have faith it will work, Sunil! ;-)
Hi @carlo.raj
Based on the shared logs it seems you deployment is failing due to
could not select device driver “” with capabilities: [[gpu]]
Please refer below link in case it helps
