DLI "Building RAG Agents with LLMs" with problems

ihs221176 · March 3, 2025, 11:25am

I’m taking the “Building RAG Agents with LLMs” course on DLI, but I’m facing an issue. When I click the frontend button, I get an ERR_CONNECTION_REFUSED error, and the course doesn’t proceed properly.

ihs221176 · March 3, 2025, 11:30am

{“logs”:“[2025-03-03 08:29:19 +0000] [6] [INFO] Starting gunicorn 23.0.0\n[2025-03-03 08:29:19 +0000] [6] [INFO] Listening at: http://0.0.0.0:8090 (6)\n[2025-03-03 08:29:19 +0000] [6] [INFO] Using worker: uvicorn.workers.UvicornWorker\n[2025-03-03 08:29:19 +0000] [7] [INFO] Booting worker with pid: 7\n[2025-03-03 08:29:19 +0000] [8] [INFO] Booting worker with pid: 8\n[2025-03-03 08:29:19 +0000] [9] [INFO] Booting worker with pid: 9\n[2025-03-03 08:29:41 +0000] [7] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 08:29:41 +0000] [7] [INFO] Worker exiting (pid: 7)\n[2025-03-03 08:29:41 +0000] [8] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 08:29:41 +0000] [8] [INFO] Worker exiting (pid: 8)\n[2025-03-03 08:29:41 +0000] [9] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 08:29:41 +0000] [9] [INFO] Worker exiting (pid: 9)\n[2025-03-03 08:29:42 +0000] [6] [ERROR] Worker (pid:8) exited with code 3\n[2025-03-03 08:29:42 +0000] [6] [ERROR] Worker (pid:9) was sent SIGTERM!\n[2025-03-03 08:29:42 +0000] [6] [ERROR] Worker (pid:7) was sent SIGTERM!\n[2025-03-03 08:29:42 +0000] [6] [ERROR] Shutting down: Master\n[2025-03-03 08:29:42 +0000] [6] [ERROR] Reason: Worker failed to boot.\n[2025-03-03 11:25:00 +0000] [6] [INFO] Starting gunicorn 23.0.0\n[2025-03-03 11:25:00 +0000] [6] [INFO] Listening at: http://0.0.0.0:8090 (6)\n[2025-03-03 11:25:00 +0000] [6] [INFO] Using worker: uvicorn.workers.UvicornWorker\n[2025-03-03 11:25:00 +0000] [7] [INFO] Booting worker with pid: 7\n[2025-03-03 11:25:00 +0000] [8] [INFO] Booting worker with pid: 8\n[2025-03-03 11:25:00 +0000] [9] [INFO] Booting worker with pid: 9\n[2025-03-03 11:25:07 +0000] [8] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 11:25:07 +0000] [8] [INFO] Worker exiting (pid: 8)\n[2025-03-03 11:25:07 +0000] [7] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 11:25:07 +0000] [7] [INFO] Worker exiting (pid: 7)\n[2025-03-03 11:25:07 +0000] [9] [ERROR] Exception in worker process\nTraceback (most recent call last):\n File "/usr/local/lib/python3.11/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker\n worker.init_process()\n File "/usr/local/lib/python3.11/site-packages/uvicorn/workers.py", line 75, in init_process\n super().init_process()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 135, in init_process\n self.load_wsgi()\n File "/usr/local/lib/python3.11/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi\n self.wsgi = self.app.wsgi()\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/base.py", line 66, in wsgi\n self.callable = self.load()\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 57, in load\n return self.load_wsgiapp()\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp\n return util.import_app(self.app_uri)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/site-packages/gunicorn/util.py", line 370, in import_app\n mod = importlib.import_module(module)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "", line 1204, in _gcd_import\n File "", line 1176, in _find_and_load\n File "", line 1147, in _find_and_load_unlocked\n File "", line 690, in _load_unlocked\n File "", line 940, in exec_module\n File "", line 241, in _call_with_frames_removed\n File "/web/frontend_server.py", line 17, in \n from frontend_block import get_demo\n File "/web/frontend_block.py", line 22, in \n from langserve import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/init.py", line 8, in \n from langserve.client import RemoteRunnable\n File "/usr/local/lib/python3.11/site-packages/langserve/client.py", line 24, in \n from httpx._types import AuthTypes, CertTypes, CookieTypes, HeaderTypes, VerifyTypes\nImportError: cannot import name ‘VerifyTypes’ from ‘httpx._types’ (/usr/local/lib/python3.11/site-packages/httpx/_types.py)\n[2025-03-03 11:25:07 +0000] [9] [INFO] Worker exiting (pid: 9)\n[2025-03-03 11:25:07 +0000] [6] [ERROR] Worker (pid:8) exited with code 3\n[2025-03-03 11:25:07 +0000] [6] [ERROR] Worker (pid:7) was sent SIGTERM!\n[2025-03-03 11:25:07 +0000] [6] [ERROR] Worker (pid:9) was sent SIGTERM!\n[2025-03-03 11:25:07 +0000] [6] [ERROR] Shutting down: Master\n[2025-03-03 11:25:07 +0000] [6] [ERROR] Reason: Worker failed to boot.\n”}

this is log… When will the issue with the httpx library be fixed? I wasted an entire day because of this.

TomNVIDIA · March 3, 2025, 3:24pm

Hello @ihs221176

Welcome to the forums. This issue will require someone from the DLI team to investigate. They have been tagged here, please allow them some time to respond.

vkudlay · March 5, 2025, 7:53pm

Hey @ihs221176. Sorry about the issue. I found out about the issue yesterday and patched it, but didn’t see this message. Messaging here to close the loop.

Frontend microservice not running in “Building RAG Agents with LLMs” and other issues - AI & Data Science / AI Foundation Models and Endpoints - NVIDIA Developer Forums

system · March 19, 2025, 7:12pm

This topic was automatically closed 60 minutes after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Difficulty with Building RAG Agents with LLMs (Gradio) AI Foundation Models and Endpoints dli	13	1637	May 23, 2025
Dont understand how to finish - DLI Course ‘Building RAG Agents for LLMs’ Base Command Manager	38	1690	May 3, 2025
Course "Get Started with Deep Learning" don't show ( it said "apps.learn.learn.nvidia.com refused to connect") JAX	13	609	June 17, 2025
DLI Course 'Building RAG Agents for LLMs' - Assessment Support Storage dli	36	3245	May 23, 2025
Launching error TensorRT	6	38	April 21, 2025
Building RAG Agents with LLMs Environment not loading NVIDIA AI Workbench	5	50	March 18, 2025
'Building RAG Agents for LLMs' Bad Request Error During Assessment AI Foundation Models and Endpoints dli	3	563	June 13, 2024
Unable to launch my task: Error. We encountered an error. Please try again Forum Feedback	11	145	April 2, 2025
DLI course not loading Teaching and Curriculum Support	1	18	June 27, 2025
Chat With RTX no functional and with the error panel AI Foundation Models and Endpoints	3	1870	February 27, 2024

DLI "Building RAG Agents with LLMs" with problems

Related topics