I am working on getting a simulation running where my robot goes to a photo capture position captures a pic determines the location of the object (through our internal company software) and gets the robot to make a pick in the simulation.
I am successfully able to make the robot reach the correct position and orientation to grasp the object but the actual picking is failing.
I am using some of the assets provided and have modified them to have a physicx material and a convex decomposition based collision mesh, I am also using the franka robot for the picks. I have attached a video of the behavior, I have also tried mimicking the same properties as the pickplace examples have but that doesnt seem to work.