Hi akshayparab,
You have configured CAN correctly on xavier.
Since you are receiving messages with one ID and not from other ID.
Can you please share your message details or any script you are running. I want to see sequence of steps you are following so that I can check the same with my setup.
Thanks,
Shubhi