Gds error (gdsio)

I have a RAID-0 NVMe mounted via NFS+RDMA

mount | grep nfs
10.10.10.108:/tertiary on /nfs/tertiary type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=rdma,port=20049,timeo=600,retrans=2,sec=sys,clientaddr=10.10.10.64,local_lock=none,addr=10.10.10.108)

So it seems that RDMA is enabled. However when running the test:
gdsio -D /nfs/tertiary -d 0 -w 32 -s 1G -i 1M -x 0 -I 0 -T 120
I get the error:

unable to open file /nfs/tertiary/gdsio.0, error:No such file or directory

I use Ubuntu 22.04 LTS and cuda 11.7. Anybody knows what’s going wrong here?

1 Like

The problem was the following: when using the -D option with read mode (β€œ-I 0”) one has to make sure that there are enough files available in the directory. E.g. just run in write mode (β€œ-I 1”) with same amount of workers to create the files and read them afterwards.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.