Ok after consulting with ChatGPT, I found the solution. If anyone has the same problem, you can consider this one:
Clear Isaac Sim’s extscache in the venv (this is where the compiled extension shims live)
rm -rf ~/path/to/python3.11/site-packages/isaacsim/extscache