Hi,
Yes, there will be a public release for r35 as well.
Thanks
Just wanted to say thank you. This got me working again and thanks to Ashwin for the original work, you guys are amazing
1 Like
ggilman, the script worked flawlessly for me as well and resolved the CUDA allocation error/memory fragmentation issues. Thank you for sharing it.
Is there still no official guidance? I’m uncomfortable running community scripts that have such a deep effect.
2 Likes
They released 36.5.. supposed to be fixing this.. I am still trying it now but thought I update this thread
Update: it worked!
Thanks for the info. I follow the instructions. Looks like I can run the bigger models again, yay! By bigger models I mean up to 8.0B.
BTW I followed the instruction on the update link, but could not run: sudo apt install --fix-broken -o Dpkg: :=“–force-overwrite”
Received the following error: E: Option Dpkg:: Configuration item specification must have an =.
I’m not sure it matters cause everything seems to running ok, will monitor and report back with any issues.
try this:
sudo apt install --fix-broken -o Dpkg::Options::=“–force-overwrite”