Initialization time

I am trying out CUDA and I am noticing a discrepancy during initialization.

If a vnc client is connected to my computer, the CUT_DEVICE_INIT takes around 20 (+/- 10%) milliseconds (timed using cutGetTimerValue), however if no vnc client is connect, the same call takes around 55 ms (+/- 10%).
(No mistake here: without a vnc client, finding and setting a cuda device takes longer.)

GPU: 8600 GTS with driver 169.21 on Windows XP SP2.
VNC: TightVNC 1.3.9 with the Mirage driver installed.

Anyone else who can confirm this? Am I doing something wrong?