Multi GPU initialization time

Situation
- Acceleration with 2 GPU(K20) using multi-thread(CPU)
- I used Hyper-Q(stream)
- There is a result below table
Problem
- Even though I used 2 multi-thread, it takes 2 times than using single GPU
- I think each CPU can take care each GPU, but it takes 2 times.
- As you can see the result, processing time is faster than single GPU
Question
- Is there any way to reduce “Initialization” time(warm-up)?
- Is it common to see this kind of result? If it is, please tell the technical reason.

======================================

80 images

  • GPU
    …GPU init : 0.32
    …processing : 0.63
    …total : 0.92
  • Multi GPU
    …GPU init : 0.65
    …processing : 0.29
    …total : 0.94

160 images

  • GPU
    …GPU init : 0.32
    …processing : 1.24
    …total : 1.53
  • Multi GPU
    …GPU init : 0.65
    …processing : 0.7
    …total : 1.35