Result video of 3D tracking video is not ideal

Please refer this topic for how to calculate projection matrix: SV3DT: projection matrix - #9 by kesong.