NVIDIA Developer Forums

Tao mask_rcnn training exits with NaN loss

Accelerated Computing Intelligent Video Analytics TAO Toolkit

adithya.ajith September 9, 2024, 4:54am 11

Training started when I updated the init_learning rate with a much lower value of 0.0005

Low accuracy for MS COCO dataset in tao maskrcnn model training

Topic		Replies	Views	Activity
Low accuracy for MS COCO dataset in tao maskrcnn model training TAO Toolkit	10	56	September 17, 2024
Model diverged with loss = nan TAO Toolkit	2	586	May 16, 2023
MaskRCNN Input to reshape is a tensor with 3135248 values, but the requested shape has 2691200 TAO Toolkit	38	1124	May 9, 2023
Retraining Error after pruning the Mask RCNN model with TAO Toolkit TAO Toolkit tao	5	509	May 10, 2022
Error retraining the pruned Mask RCNN model with TAO Toolkit TAO Toolkit	2	419	January 20, 2024
TAO Toolkit TAO Toolkit	2	384	November 21, 2022
Basic questions about transfer learning with TAO Toolkit TAO Toolkit	2	465	January 12, 2023
Mask R-CNN stops abruptly while training using custom coco dataset TAO Toolkit	12	1390	February 22, 2022
ValueError: Total size of new array must be unchanged for box_head/class-predict/kernel lh_shape: [(1024, 1)], rh_shape: [(1024, 2)] TAO Toolkit	7	955	October 12, 2021
Tao unet model outputs only one class TAO Toolkit	6	30	August 15, 2024