Buffer Overflow Detected

Hi Guys,

I am able to compile my GPU code and run it. However, my code crashes after a few iterations with the following error under. I am calling my gpu kernel from a function that allocates gpu memory, calls the kernel, copies the results back to the host memory and finally "cudaFree"s the gpu memory.

*** buffer overflow detected ***: ./gpumuscle terminated
======= Backtrace: =========
/lib/libc.so.6(__fortify_fail+0x37)[0x7f262667d217]
/lib/libc.so.6(+0xfe0d0)[0x7f262667c0d0]
/lib/libc.so.6(+0xfd539)[0x7f262667b539]
/lib/libc.so.6(_IO_default_xsputn+0xcc)[0x7f26265f3d1c]
/lib/libc.so.6(_IO_vfprintf+0x628)[0x7f26265c39c8]
/lib/libc.so.6(__vsprintf_chk+0x99)[0x7f262667b5d9]
/lib/libc.so.6(__sprintf_chk+0x7f)[0x7f262667b51f]
./gpumuscle[0x433258]
./gpumuscle[0x432cad]
./gpumuscle[0x40fc4e]
./gpumuscle[0x410269]
./gpumuscle[0x41f565]
/lib/libc.so.6(__libc_start_main+0xfd)[0x7f262659cc4d]
./gpumuscle[0x4027a9]
======= Memory map: ========
00400000-00461000 r-xp 00000000 08:05 1197653 /home/vivek/bioinformatics_folder/y_muscle3.8.31/src/gpumuscle
00660000-00661000 r–p 00060000 08:05 1197653 /home/vivek/bioinformatics_folder/y_muscle3.8.31/src/gpumuscle
00661000-0066d000 rw-p 00061000 08:05 1197653 /home/vivek/bioinformatics_folder/y_muscle3.8.31/src/gpumuscle
0066d000-006c9000 rw-p 00000000 00:00 0
014b8000-01f72000 rw-p 00000000 00:00 0 [heap]
200000000-600000000 —p 00000000 00:00 0
7f262391d000-7f262391f000 rw-p 00000000 00:00 0
7f262391f000-7f2623a1f000 rw-s 1326f2000 00:05 5927 /dev/nvidia1
7f2623a1f000-7f2623b1f000 rw-s 140082000 00:05 5927 /dev/nvidia1
7f2623b1f000-7f2623c1f000 rw-s 12fb7a000 00:05 5927 /dev/nvidia1
7f2623c1f000-7f2623d1f000 rw-s 1041c6000 00:05 5927 /dev/nvidia1
7f2623d1f000-7f2623e1f000 rw-s 144b4e000 00:05 5927 /dev/nvidia1
7f2623e1f000-7f2623e20000 rw-s e3ee3000 00:05 5927 /dev/nvidia1
7f2623e20000-7f2623e21000 rw-s 138596000 00:05 5927 /dev/nvidia1
7f2623e21000-7f2624223000 rw-s 10278f000 00:05 5927 /dev/nvidia1
7f2624223000-7f2624224000 rw-s e3ee2000 00:05 5927 /dev/nvidia1
7f2624224000-7f2624225000 rw-s 1342c8000 00:05 5927 /dev/nvidia1
7f2624225000-7f2624627000 rw-s 1343f4000 00:05 5927 /dev/nvidia1
7f2624627000-7f2624a29000 rw-s 13fb65000 00:05 5927 /dev/nvidia1
7f2624a29000-7f2624a3f000 r-xp 00000000 08:05 1310914 /lib/libz.so.1.2.3.3
7f2624a3f000-7f2624c3e000 —p 00016000 08:05 1310914 /lib/libz.so.1.2.3.3
7f2624c3e000-7f2624c3f000 r–p 00015000 08:05 1310914 /lib/libz.so.1.2.3.3
7f2624c3f000-7f2624c40000 rw-p 00016000 08:05 1310914 /lib/libz.so.1.2.3.3
7f2624c40000-7f2625442000 r-xp 00000000 08:05 3146929 /usr/lib/libcuda.so.270.41.06
7f2625442000-7f2625642000 —p 00802000 08:05 3146929 /usr/lib/libcuda.so.270.41.06
7f2625642000-7f2625712000 rw-p 00802000 08:05 3146929 /usr/lib/libcuda.so.270.41.06
7f2625712000-7f2625737000 rw-p 00000000 00:00 0
7f2625752000-7f2625753000 r–s e4009000 00:05 5927 /dev/nvidia1
7f2625753000-7f2625754000 r–s ea009000 00:05 5919 /dev/nvidia0
7f2625754000-7f2625f55000 rw-p 00000000 00:00 0
7f2625f55000-7f2625f5c000 r-xp 00000000 08:05 1310970 /lib/librt-2.11.1.so
7f2625f5c000-7f262615b000 —p 00007000 08:05 1310970 /lib/librt-2.11.1.so
7f262615b000-7f262615c000 r–p 00006000 08:05 1310970 /lib/librt-2.11.1.so
7f262615c000-7f262615d000 rw-p 00007000 08:05 1310970 /lib/librt-2.11.1.so
7f262615d000-7f2626175000 r-xp 00000000 08:05 1310968 /lib/libpthread-2.11.1.so
7f2626175000-7f2626374000 —p 00018000 08:05 1310968 /lib/libpthread-2.11.1.so
7f2626374000-7f2626375000 r–p 00017000 08:05 1310968 /lib/libpthread-2.11.1.so
7f2626375000-7f2626376000 rw-p 00018000 08:05 1310968 /lib/libpthread-2.11.1.so
7f2626376000-7f262637a000 rw-p 00000000 00:00 0
7f262637a000-7f262637c000 r-xp 00000000 08:05 1310957 /lib/libdl-2.11.1.so
7f262637c000-7f262657c000 —p 00002000 08:05 1310957 /lib/libdl-2.11.1.so
7f262657c000-7f262657d000 r–p 00002000 08:05 1310957 /lib/libdl-2.11.1.so
7f262657d000-7f262657e000 rw-p 00003000 08:05 1310957 /lib/libdl-2.11.1.so
7f262657e000-7f26266f8000 r-xp 00000000 08:05 1310806 /lib/libc-2.11.1.so
7f26266f8000-7f26268f7000 —p 0017a000 08:05 1310806 /lib/libc-2.11.1.so
7f26268f7000-7f26268fb000 r–p 00179000 08:05 1310806 /lib/libc-2.11.1.so
7f26268fb000-7f26268fc000 rw-p 0017d000 08:05 1310806 /lib/libc-2.11.1.so
7f26268fc000-7f2626901000 rw-p 00000000 00:00 0
7f2626901000-7f2626917000 r-xp 00000000 08:05 1310799 /lib/libgcc_s.so.1
7f2626917000-7f2626b16000 —p 00016000 08:05 1310799 /lib/libgcc_s.so.1
7f2626b16000-7f2626b17000 r–p 00015000 08:05 1310799 /lib/libgcc_s.so.1
7f2626b17000-7f2626b18000 rw-p 00016000 08:05 1310799 /lib/libgcc_s.so.1
7f2626b18000-7f2626b9a000 r-xp 00000000 08:05 1310958 /lib/libm-2.11.1.so
7f2626b9a000-7f2626d99000 —p 00082000 08:05 1310958 /lib/libm-2.11.1.so
7f2626d99000-7f2626d9a000 r–p 00081000 08:05 1310958 /lib/libm-2.11.1.so
7f2626d9a000-7f2626d9b000 rw-p 00082000 08:05 1310958 /lib/libm-2.11.1.so
7f2626d9b000-7f2626e91000 r-xp 00000000 08:05 3149487 /usr/lib/libstdc++.so.6.0.13
7f2626e91000-7f2627091000 —p 000f6000 08:05 3149487 /usr/lib/libstdc++.so.6.0.13
7f2627091000-7f2627098000 r–p 000f6000 08:05 3149487 /usr/lib/libstdc++.so.6.0.13
7f2627098000-7f262709a000 rw-p 000fd000 08:05 3149487 /usr/lib/libstdc++.so.6.0.13
7f262709a000-7f26270af000 rw-p 00000000 00:00 0
7f26270af000-7f26270fa000 r-xp 00000000 08:05 3279125 /usr/local/cuda/lib64/libcudart.so.3.2.16Aborted