Building 64bit Cuda apps on 32bit environment

Another snaffoo in getting Cuda cleanly integrated into my build environment; We have a single 32bit build machine that builds all the binaries for our products. This includes building the 64bit binaries. This has been a common practice in all the shops I’ve worked at it. Last time I tried it was not possible to get the 32bit Cuda environment to build 64bit binaries. Am I missing something? Anyone have, know of a workaround?