Libbitsandbytes_cpu.so not found during bitsandbytes installation

[kevinaseegobin]

I am on the latest version of jetpack on jetson orin agx and trying to install and use flux using this tutorial:
Flux & ComfyUI - NVIDIA Jetson AI Lab

On the step where i attempt to import bitsandbytes as bnb, i get the error “bitsandbytes/bitsandbytes/libbitsandbytes_cpu.so: cannot open shared object file: No such file or directory.”

At the directory that it is searching for libbitsandbytes_cpu.so, i only see these files:

What is the reason i do not have libbitsandbytes_cpu.so? is it that i have to change something for the import to call what i do have?

[dusty_nv]

Hi @kevinaseegobin, the author of the Flux/ComfyUI tutorial @asier is out of the office right now, but I have sent him your post and asked about the bitsandbytes setup. In the meantime, you can also try installing this precompiled bitsandbytes wheel for Jetson Orin, JetPack 6, and CUDA 12.2:

http://jetson.webredirect.org/jp6/cu122/bitsandbytes/0.39.1

Let us know if that works or if you encounter further errors, thanks!

[johnnynunez]

Hello, the container is on jetson container, and finally I added comfyui manager.
You can try to run it.

CUDA_VERSION=12.6 jetson-containers build comfyui