Agent Studio uses other Hugging Face model fail

[YC912]

Hi,

I tried to use microsoft/phi-2 model at Agent studio. After the download is complete, Agent Studio does not respond and no components appear. How can I use microsoft/phi-2 model at Agent Studio?

Thanks your help.

[AastaLLL]

Hi,

Could you try it with dustynv/mlc:r36.4.0 container?
In our testing, the phi-3 can work well with that container:

Models - NVIDIA Jetson AI Lab

Thanks.

[YC912]

Hi,

I already used dustynv/mlc:r36.4.0 container. Try to test phi-3 get the following logs.
Refer to this url NanoLLM/docs/models.md at main · dusty-nv/NanoLLM · GitHub , agent studio supports phi-2

---------------------------------Logs-----------------------------------------------------------
raise _format(RepositoryNotFoundError, message, response) from e
huggingface_hub.errors.RepositoryNotFoundError: 404 Client Error. (Request ID: Root=1-68639119-367af09e137f45535385af08;de1cbbc1-4642-4356-808c-e73256231bb9)

Repository Not Found for url: https://huggingface.co/api/models/microsoft/phi-3/revision/main.
Please make sure you specified the correct repo_id and repo_type.
If you are trying to access a private or gated repo, make sure you are authenticated.

Thanks

[AastaLLL]

Hi,

It looks like the naming is incorrect.

microsoft (Microsoft)

There is no “microsoft/phi-3” model although there is a “microsoft/phi-2”.
Could you try to use one of the phi-3 variants to see if it can work? Ex. “microsoft/Phi-3-mini-4k-instruct”

Thanks.