Flash_attn_2_cuda.cpython-310-aarch64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

[bigbighu]

After installing flash_attn via the website jp6/cu122 index, I get a runtime error “*python3.10/site-packages/flash_attn_2_cuda.cpython-310-aarch64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi”

Platform: JetPack 6.0
cuda version: release 12.2, V12.2.140
torch version: 2.4.0 and sha256sum:caa8de487371c7f66b566025700635c30728032e0a3acf1c3183cec7c2787f94
sha256sum of theflash_attn-2.5.7-cp310-cp310-linux_aarch64.whl :b9448fc2bf0a753288d9567ca2e289f1a9126164f036a40f4b553531164e50f1

[AastaLLL]

Hi,

Could you check if you can solve the compatible issue by building from the source?

undefined symbol: _ZN3c104cuda9SetDeviceEi

Thanks.