Jetson-containers run (LLaVA sample project)

[pieterc]

Continuing the discussion from Jetson-containers run (LLaVA sample project):

Good day, I’m trying to run the LLaVA sample project but keep getting permission denied on two files/folders:

jetson-containers run --workdir=/opt/text-generation-webui $(autotag text-generation-webui)
python3 download-model.py --output=/data/models/text-generation-webui
TheBloke/llava-v1.5-13B-GPTQ
bash: /root/bin/autotag: Permission denied
bash: /usr/local/bin/jetson-containers: Permission denied

URL: LLaVA - NVIDIA Jetson AI Lab

Tried a few chmod commands, but no luck unfortunately

Thank you

[pieterc]

Hi again ,same issue for the dusty-nv project:

root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# sudo jetson-containers run $(autotag cosmos)
bash: /root/bin/autotag: Permission denied
sudo: jetson-containers: command not found
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# sudo chown root:root /usr/local/bin/jetson-containers
chown: changing ownership of ‘/usr/local/bin/jetson-containers’: Operation not permitted
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# ls -l /usr/local/bin/jetson-containers
**lrwxrwxrwx 1 root root 86 Nov 5 12:06 /usr/local/bin/jetson-containers → /media/kopbeen/steek2_0/jetson-containers/dusty-nv/jetson-containers/jetson-containers
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# ls -l /root/bin/autotag
lrwxrwxrwx 1 root root 67 Nov 5 09:07 /root/bin/autotag → /media/kopbeen/steek2_0/jetson-containers/jetson-containers/autotag

[pieterc]

More info on the “permission denied”

Tried:

1. Failed to start docker.service: Unit is masked - General - Docker Community Forums
2. Unmasking: Google search “Failed to restart docker.service: Unit docker.service is masked.”

``
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# sudo jq ‘. + {“default-runtime”: “nvidia”}’ /etc/docker/daemon.json | sudo tee /etc/docker/daemon.json.tmp && sudo mv /etc/docker/daemon.json.tmp /etc/docker/daemon.json
{
“default-runtime”: “nvidia”,
“runtimes”: {
“nvidia”: {
“args”: ,
“path”: “nvidia-container-runtime”
}
}
}
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# docker ps -q
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dusty-nv# jetson-containers run --workdir=/opt/text-generation-webui $(autotag text-generation-webui)
python3 server.py --listen
–model-dir /data/models/text-generation-webui
–model TheBloke_llava-v1.5-13B-GPTQ
–multimodal-pipeline llava-v1.5-13b
–loader autogptq
–disable_exllama
–verbose
bash: /root/bin/autotag: Permission denied
bash: /usr/local/bin/jetson-containers: Permission denied
root@ubuntu:/media/kopbeen/steek2_0/jetson-containers/dust

[Aharpster]

Hi pieterc,

I have moved your post to the Jetson projects section of the forum to get you some better visibility.

Cheers,

Aharpster

[pieterc]

Thanks a million

Pieter Claassens

Software Engineer

SHOCK Electro-Optic Systems

Cell: +27 83 561 8577

WhatsApp: +27 68 742 8101

[pieterc]

Good day, Aharpster.

Can you please share the link where the post is now located ? Still permission denied when trying to launch the container…

bash: /usr/local/bin/autotag: Permission denied
bash: /usr/local/bin/jetson-containers: Permission denied

.. tried the sudo chmod -R 777 command on the above mentioned folder/files - but no luck … maybe I am missing something trivial ?

[pieterc]

This command: jetson-containers run --workdir=/opt/text-generation-webui $(autotag text-generation-webui)
python3 download-model.py --output=/data/models/text-generation-webui
TheBloke/llava-v1.5-13B-GPTQ

[pieterc]

@pieterc

sudo chmod -R 777

root@jetson-host:/media/kopbeen/STK_WIN_LIN/test/nvidia/dusty-nv/jetson-containers# jetson-containers run --workdir=/opt/text-generation-webui $(autotag text-generation-webui) python3 server.py --listen --model-dir /data/models/text-generation-webui --model TheBloke_llava-v1.5-13B-GPTQ --multimodal-pipeline llava-v1.5-13b --loader autogptq --disable_exllama --verbose --cap-add LINUX_IMMUTABLE
bash: /usr/local/bin/autotag: Permission denied
bash: /usr/local/bin/jetson-containers: Is a directory (yes it is ?)

[AastaLLL]

Hi,

Could you login with a USER account and install jetson-container with the below command:

git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh

Thanks.