Rapid Application Development with Large Language Models (LLMs) code not working, won't connect to llms

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Getting MaxRetryError: HTTPConnectionPool(host=‘0.0.0.0’, port=9004): Max retries exceeded with url: /v1/chat/completions (Caused by NewConnectionError(‘<urllib3.connection.HTTPConnection object at 0x7ff9b01abb50>: Failed to establish a new connection: [Errno 111] Connection refused’))

At the invoke of any llms from notebooks 6 to 8. Looking for any help as I have little time to complete this course.

2

Hey @pauldhillon11. If you’re talking about the self-paced version, you need to make sure to run Notebook 6.5 all the way through. This should kickstart the local server process which hosts all of these.