Is it possible to copy triton module between containers?

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
1

Hi group,

I know that docker containers are for building from pieces not copping files between them but is it possible to copy triton module from container openai-triton to container stable-diffusion-webui ???

Thank you,

tj

2

*** Please note that this reply is generated by LLM automatically ***

Yes, it is possible to copy files between Docker containers, including the Triton module from the openaitriton container to the stablediffusionwebui container.

Docker containers are designed to be isolated from each other, but there are ways to share files between them. Here are a few approaches:

  1. Volume mounting: You can mount a shared volume between the two containers. This allows you to share files between the containers. For example, you can create a shared volume named triton-module and mount it to both containers:
docker run -d --name openaitriton -v triton-module:/triton-module openaitriton
docker run -d --name stablediffusionwebui -v triton-module:/triton-module stablediffusionwebui

Then, you can copy the Triton module from the openaitriton container to the shared volume:

docker exec -it openaitriton cp /path/to/triton/module /triton-module/

Finally, you can access the Triton module from the stablediffusionwebui container:

docker exec -it stablediffusionwebui ls /triton-module/
  1. Docker cp: You can use the docker cp command to copy files between containers. For example:
docker cp openaitriton:/path/to/triton/module stablediffusionwebui:/path/to/triton/module

This will copy the Triton module from the openaitriton container to the stablediffusionwebui container.
3. Dockerfile: You can also create a new Docker image that includes the Triton module by using a Dockerfile. For example:

FROM openaitriton
COPY /path/to/triton/module /triton-module/

Then, you can build the new image and use it to create a container:

docker build -t my-image .
docker run -d --name stablediffusionwebui my-image

In summary, while Docker containers are designed to be isolated, there are ways to share files between them. You can use volume mounting, docker cp, or create a new Docker image to copy the Triton module from the openaitriton container to the stablediffusionwebui container.

Note that the Jetson AGX Orin Developer Kit uses Docker containers to manage software dependencies and provide a consistent development environment. The openaitriton and stablediffusionwebui containers are likely used to provide specific software dependencies and environments for AI and machine learning applications.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

5

Hi,

Usually, you can install the extra files on either one as a base image.

Could you share why you need to do this?
Ideally, you can install Triton module on the stable-diffusion-webui image.

Thanks.

6

Hi Aasta,

I just want to run project Hi3DGen (converts images to 3d mesh)

So, I need to run all together following modules

torch, torchvision, diffusers, gradio, accelerate, spconv, triton, transformers, xformers

looks that it is impossible to collect them on jetpack 6.0 agx orin in versions which let them work all together…

for example now i collected all modules on image stable-diffusion-webui but xformers gives an error

transformers ModuleNotFoundError: No module named ‘triton.ops’

So, I though that maybe if compiling of some package version is immpossible i just copy it from other container.

( in this case, because i can compile only last release of triton but i’m unable to compile older releases. so, i thought that maybe copying old version of trition package form openai-triton image could solve the problem.)

Thank you

tj

7

Hi,

Most of the packages you need are supported in the link below:

Maybe you can try to set up locally or create a new container based on a standard Ubuntu image?

Thanks.