Transfer Learning with PyTorch, I have a Problem

[WiSi-Testpilot]

Hi Dustin,
I have installed JP441 and the Jetson-Inference on my nano.
The tutorial and your videos are very good.
Thank you!

I would like retrain a network with meteor scatter spectrograms for the semantic segmentation. The jetson nano is connected to a PC via a HDMI-USB3 link, so that segnet-camera for example can fetch the incoming echoes.
Now I have retrained the cat/dog example. I trained 10 epochs. Everything went without problems.
However the retrained resnet18 detects everything (even a full screen cat from the internet) as 67% dog.
Using SegNet camera everything is red. I would expect, that only one class is red.
This was the command line:

willi@willis:~/jetson-inference/python/training/classification$ imagenet --model=models/cat_dog/resnet18.onnx --labels=data/cat_dog/labels.txt --input_blob=input_0 --output_blob=output_0 /dev/video1

I tested ImageNet and SegNet, see images.

It would be very nice if you could help me.
Best regards,
Wilhelm

[AastaLLL]

Hi,

Sorry that I’m not familiar with the spectrogram images.

Does this kind of data contain color information? Like RGB, YCbCr, …, etc.
If it mainly captures the luminance frequency, you will need a very different setting/model.

Thanks.

[WiSi-Testpilot]

Hi AastaLLL,
thank you for the information. Currently it does not work with color images from cats and dogs.
But yes, the spectrograms mainly have one or two colors, see the attached image.
What kind of model would you suggest?
Best regards,
Wilhelm

[dusty_nv]

Hi @WiSi-Testpilot, the segmentation networks (FCN-ResNet18) are different than the classification networks (ResNet18), so loading a classification model with segnet program would not work.

Re-training the segmentation models with PyTorch isn’t yet part of the Hello AI World tutorial, but you can find some resources about it here:

• https://www.highvoltagecode.com/post/edge-ai-semantic-segmentation-on-nvidia-jetson
• https://github.com/dusty-nv/pytorch-segmentation/tree/dev

[WiSi-Testpilot]

Hello Dustin,
thank you for the very interesting information.
Is it possible, that you add it to the Hello AI World tutorial?
Best regards,
Wilhelm

[dusty_nv]

The datasets that I used for training the segmentation models in Hello AI World were larger, so I didn’t do that training onboard Jetson (rather my PC + GPU card). At some point I will have to do some experimentation to see if it is stable on smaller user-created datasets to train simpler segmentation models onboard Jetson.

[WiSi-Testpilot]

Dustin, my suggestion is to make only two classes with the cats and dogs images. Then we can learn the procedure.
Tomorrow I’ll get a Xavier NX.
Best regards,
Wilhelm

[WiSi-Testpilot]

An Update:
I got the Xavier NX. The cat/dog retraining is four times faster than with my Nano.
Very nice.
Best regards,
Wilhelm