Tesla K20 vs Titan X performance for the same code

TCC vs. WDDM may make a difference. Try putting the titan in TCC mode. You should be able to do this with nvidia-smi