I’ve found a bug in 32-bit toolkit installer: it puts incorrect directories in PATH, CUDA_BIN_PATH and CUDA_LIB_PATH environment variables when run on a machine with x64 OS (Windows 7 in my case). They point to bin64 and lib64 folders, which do not exist in this version of toolkit. I’m not sure where should I report this, so let it just be here for the records.
I believe nowadays cuda installs both 32 and 64 bit libraries on 64bit platforms. You can compile and link 32bit code on a 64bit platform after installing the 64bit toolkit. I know my colleague is doing just that on 64bit linux.