Lab: Evaluation and Light Customization of Large Language Models -> ERROR NIM Not operational

AI & Data Science NVIDIA NIM Access/Accounts
1

I am doing the lab in the recent course: Evaluation and Light Customization of Large Language Models.

I get this error when I run the first cell in the notebook:

Waiting for service to be ready... (Error: HTTPConnectionPool(host='llama3-2-3b-instruct.local', port=80): Max retries exceeded with url: /v1/health/ready (Caused by NameResolutionError("<urllib3.connection.HTTPConnection object at 0x73afbd5f7340>: Failed to resolve 'llama3-2-3b-instruct.local' ([Errno -3] Temporary failure in name resolution)")) )

Code excuted:

import time
import requests
from IPython.display import clear_output

url = “http://llama3-2-3b-instruct.local/v1/health/ready”

while True:
try:
response = requests.get(url)
if response.status_code == 200:
clear_output(wait=True)
print(“Service is up and running!”)
break
else:
clear_output(wait=True)
print(“Waiting for service to be ready… (Status code:”, response.status_code,“)”)
except requests.exceptions.RequestException as e:
clear_output(wait=True)
print(“Waiting for service to be ready… (Error:”, e,“)”)
time.sleep(10)