device to device bandwidth; a weird crash...

Hi all,

i have an ASUS M4A79 Deluxe motherboard that has 4 PCIe x16 slots (blue,black,blue,black). On this board, i have 2 Tesla C1060 GPUs (on first blue and black) and a GeForce 8400 GS (on secon blue) for display. but i face a problem with one of the Tesla’s. deviceQuery in SDK sees both of them, but when i launch bandwidthTest, one Tesla (device=0) do not perform Device to Device Bandwidth test. it is okey with Host to Device and Device to Host test. while printing Device to Device result, it crashes. Display of deviceQuery and bandwidthTest are seen below:
By the way, my OS is Ubuntu 8.04 64bit.

bulent@bulent-desktop:~/NVIDIA_CUDA_SDK/bin/linux/release$ ./deviceQuery
CUDA Device Query (Runtime API) version (CUDART static linking)
There are 3 devices supporting CUDA

Device 0: “Tesla C1060”
CUDA Capability Major revision number: 1
CUDA Capability Minor revision number: 3
Total amount of global memory: 4294705152 bytes
Number of multiprocessors: 30
Number of cores: 240
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 16384 bytes
Total number of registers available per block: 16384
Warp size: 32
Maximum number of threads per block: 512
Maximum sizes of each dimension of a block: 512 x 512 x 64
Maximum sizes of each dimension of a grid: 65535 x 65535 x 1
Maximum memory pitch: 262144 bytes
Texture alignment: 256 bytes
Clock rate: 1.30 GHz
Concurrent copy and execution: Yes
Run time limit on kernels: No
Integrated: No
Support host page-locked memory mapping: Yes
Compute mode: Default (multiple host threads can use this device simultaneously)


Press ENTER to exit…

bulent@bulent-desktop:~/NVIDIA_CUDA_SDK/bin/linux/release$ ./bandwidthTest --device=0
Running on…
device 0:Tesla C1060
Quick Mode
Host to Device Bandwidth for Pageable memory
Transfer Size (Bytes) Bandwidth(MB/s)
33554432 2546.0

Quick Mode
Device to Host Bandwidth for Pageable memory
Transfer Size (Bytes) Bandwidth(MB/s)
33554432 2032.9

Quick Mode
Device to Device Bandwidth

–>> After tihis point it crashes!!

is there anybody facing this problem before or I’d like to listen to your ideas about this problem.
i searched the forum but i could not find anything on this subject.

thanks in advance…