Wow, thanks a lot for the reply, you saved my day!
I totally forgot about the SBTs stuff. After add code to change the SBT bind pointer, it totally works as expect. Infect I even didn’t need multiple pipelines, just pack or raygen program into one pipeline and change the entry pointer of SBTs would do it.
I used to suppose that when multiple raygen programs exist, Optix will trigger all raygen programs at the same time. Well I was wrong about that, only one entry points a time I guess~