How to relate data to RGB code and show over/pointing when replay a 3D-video

Regullary we inspect hazardous and confined sites, like tunnels and sinkholes, equipment or materials to asure quality status and/or certificate useful of them, capturing photos and videos, nowadays with drones, finally our quality experts make reports (papers) based on these media, if they were not on the site. Now, there are many solutions for making 3D-video and replay them, but I am looking for interact with this 3D-video adding one or more layers wich shows different values based on RGB codes when user is navigating and point an area or a point.