Hi there, I’m trying to train resnet10 using ssd using tlt but everytime getting the following assertion error, can you please help me out? Thanks. Details : ssd_train_resnet10_kitti.txt : random_seed: 42 ssd_config { aspect_ratios_global: “[1.0, 2.0, 0.5, 3.0, 1.0/3.0]” scales: “[0.05, 0.1, 0.…

Please check if the setting meets requirement. For TLT3.0, See Transfer Learning Toolkit — Transfer Learning Toolkit 3.0 documentation For TLT 2.0, see Requirements and Installation — Transfer Learning Toolkit 2.0 documentation

Correction: Commad : tlt ssd train --gpus 1 --gpu_index=$GPU_INDEX -e $SPECS_DIR/ssd_train_resnet10_kitti.txt -r $USER_EXPERIMENT_DIR/experiment_dir_unpruned -k $KEY -m $USER_EXPERIMENT_DIR/pretrained_resnet10/tlt_pretrained_object_detection_vresnet10/resnet_10.hdf5

The gpu is a bit old. Please refer to Training on Custom Dataset using TLT

Thank you very much. Let me try out a different GPU.

I am facing the same issue…sometimes the tensorflow gets stuck. How can it be resolved if we cannot get new GPUs?

Unable to train | tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC

Accelerated Computing Intelligent Video Analytics TAO Toolkit

saketm2408 June 3, 2021, 6:40am 4

Tesla K80

TAO Toolkit - NVIDIA Tesla K80

Topic		Replies	Views
Error with tlt train in official Jupyter notebook TLT 3.0 TAO Toolkit	6	937	May 7, 2021
Unable to train SSD-Resnet-18 TAO Toolkit	15	2190	November 8, 2019
SSD: custom tlt training result in AP:0 for all my classes TAO Toolkit ssd , ai-training	5	1196	August 28, 2020
Slow GPU workaround for NHWC error when training TAO Toolkit	6	1373	October 28, 2020
TLT Detectnet TrafficCamNet training not working TAO Toolkit	9	2672	July 2, 2021
Error while training on tlt TAO Toolkit	3	815	July 7, 2021
Training on Custom Dataset using TLT TAO Toolkit	1	934	September 18, 2020
SSD - SqueezeNet: Invalid loss, terminating training TAO Toolkit	4	1056	October 3, 2020
Unable to train SSD-Resnet-34 TAO Toolkit ssd	8	1081	June 9, 2020
Training Peoplent on custom data TAO Toolkit ai-training	18	3129	July 5, 2021

Unable to train | tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC

Related topics