AR Device Localisation and Pose

Gaming and Visualization Technologies XR – VR/AR/MR CloudXR (VR and AR Streaming)
1

Hi everyone,

Quick question, this may be a simple question. For AR applications, how does CloudXR handle device localisation? I know a pose matrix is sent back to the server application, but is localisation data also sent back somehow? Looking at the AR Core example client, it looks like the initial pose is set when the client is first launched. Then the pose matrix is called through the callback GetTrackingState(). How is the localisation maintained in the OpenVR app without the scene drifting?

2

I don’t know the answer to this but I also have mixed results with the scene drifting in tablet mode.

1 Like
3

Hi Bryan,

Thanks for chasing this down with us via email. I am going to post the response here:

You can send arbitrary data, like SLAM data, from the client to the server via this struct:

typedef struct cxrGenericUserInputEvent

{

uint8_t* data;

uint32_t sizeInBytes;

} cxrGenericUserInputEvent;

See more here: Miscellaneous Features — NVIDIA CloudXR SDK documentation

1 Like