Hi Liila,
Sorry but still confused a little.
We are currently only using data output from a SegmentationCameraProto which has components instanceImage and labelImage which are what I have referred to throughout. We are just using Matlab to visualise the output images from this SegmentationCameraProto.
From my understanding the output from the SegmentationCameraProto is what you are referring to in your most recent responses about class images and instance images.
What is the segmentation image that you refer to that you say gives the class number in R and the instance number in GB? What type of Proto is that image being sent along and what codelet translates from the raw SegmentationCameraProto to provide this image?