Surprising orientation of April Tag Texture

I’m trying to use the April-Tag texture in a scene and had some issues because my April Tag detectors didn’t agree with the ground truth data I got from Isaac. I used the demo-markers from Assets/Isaac/4.2/Isaac/Samples/ROS/Scenario/april_tag.usd and finally noticed that all markers are rotated clockwise by 90 deg.

Same result for Assets/Isaac/4.2/Isaac/Samples/ROS2/Scenario/carter_warehouse_apriltags_worker.usd

This is the mosaic-file that is used for the textures:

I really think that the Asset Markers should not rotate the tag images.

Isaac Sim Version

4.2.0

Is it possible to resolve this issue by rotating the objects?

Hey!

A mere rotation of the object does not help because this would also rotate the tf-frame. The orientation of the tag in the local frame of the prim has to change.

I created a new marker that fixes the issue by scaling the cube in z to 0.0001 instead of x. I then published the image (and the tag on /tf) and ran apriltag_ros. Now the frame published by IsaacSim and apriltag_ros are aligned.

This is the usda of my marker: I also added a back cover to make sure that the tag on the back side is not visible so make sure that I don’t put the marker on a wall in the wrong direction and run into new weird effects of a flipped coordinate system.

If you want to repeat the experiment with apriltag_ros, make sure to set the marker size of 0.8.

april_tag_00.txt (22.1 KB)