Compiling for the right architecture

You neglect to mention exactly what it is that you are trying to accomplish.

I build apps for maximum compatibility with both sm_11 and sm_20 targets - see the Fermi compatibility guide for the command line options.