The slave option makes sure that Xavier B does not control deserializer, in that sense to achieve your use-case you would need to make sure that Xavier A initializes and controls both cameras respectively.
Please refer to below use-case. Thanks.
Xavier A : Camera Group A, 0 port
./sample_drivenetNcameras --input-type=camera --camera-type=ar0231-rccb-bae-sf3324 --selector-mask=0011
Xavier B : Camera Group A, 1 port
./sample_camera_gmsl --camera-group=a --tegra-slave=1