Please advise recommended way of capturing images with logitech c920 camera for jetson-inference

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

Hi

Apologies for asking again but I still have not received any usable advice regarding this issue.

The logitech c920 is the recommended camera for use with the jetson-inference program. There are no instructions on how to capture images with it to make new datasets for training in digits.

Please advise the recommended image capture approach including capture program, RGB formats etc.

Regards

2

Hi RoboRoss,

If you want a pipeline similar to jetson_inference to save image for training, you can refer to below link:
[url]https://developer.download.nvidia.com/embedded/L4T/r31_Release_v1.0/Docs/Accelerated_GStreamer_User_Guide.pdf?j7sIm4DSsqY2mwVptK2v0A3Okv3TTn_C85n8V3QYadZ17-m1xSa0fMsehT-0iwqiN95h5cxKW8hXdIaE-LsDsumzedbYTHr6paQlV6Ktm10mdnE4QH7sG5VmYXO2LsKL22kHJ08Yg_0fpRHBN2QCxAJNxDuKFSTQpLTvypi-BeORxX2L_to[/url]

Thanks

3

Is such a pipeline even needed? @dusty_nv 's page only cites needing jpeg, tiff, bmp or png (with reference to retraining an existing network with images).

Does pixel format have any bearing on running inference on a newly trained dataset, given that you can train a network on random internet images and use any camera to run inference?

4

Hi,

I think the pixel format doesn’t make too much different on it if they are all in the RGB color space.
Suppose a model should be robust enough on the visually identical images.

But you are afraid of the capturing process, color conversion, …, will cause a slight difference in the model.
You can use the same pipeline to save image for training.

Thanks.

5

Ok thank you. I am having trouble getting a trained network to function well, hence the questions. The test data set returns 100% accuracy, but with the exact same camera setup the inference is really struggling. I wanted to make sure that the colorspace was not a factor, and I think the message I am getting from you guys is it probably doesn’t have an impact, but is worth testing to see if it makes a difference.

Perhaps it could just be some quirk of my training settings, I am not sure. Anyway thank you for your help.

6

Hi,

It sounds like an overfitting issue to me.
Accuracy should not reach 100%. Your model may try to memorize the input data rather than learn to classify.

Thanks.

7

Hi

The accuracy was on a separate test set, images not used for training or validation. Doesn’t this rule out overfitting?

Thanks!