Face landmark tracking and using face masks

We have tested the NVIDIA MAXINE AR SDK for face landmark tracking. While the landmarks detection works smoothly for an uncovered face, we noticed that, if the person is using a face mask covering mouth and nose (typical COVID-19 pandemic situation), the landmark tracking severely deteriorates for uncovered points (for example, eye landmarks).

Any idea how we can get around this limitation?

Hello, I put this request into the development team for the ARSDK. There are a couple of potential paths I’m thinking of for solutions to this, but they aren’t currently available to recommend. I’ll bounce this request off of the team beyond the request for enhancement to see if they have any ideas.

1 Like

Well, we’ll be looking forward to your feedback, this limitation with the use of face masks really had a major impact on landmarks.