Emissive material not visible through glass

I am having problems with seeing transparent glass material with the emissive background behind it.

I had to turn off visibility of all the glasses in order to see my animated, emissive background. But because of it I am loosing all of the nice specular reflections of the interior windows.