Access Cloud Storage Data in TLT

Accelerated Computing Intelligent Video Analytics TAO Toolkit
#1

Hi,

I am looking to convert a large number of images from google cloud storage into TFRecords using tlt-dataset-convert for object detection model training. I don’t currently see a way to do this - specifying gcs path in spec file throws an error -

                      OSError: [Errno 2] No such file or directory: '/root/datasets/gs:/jpg-for-all/images'

Seems like it is looking for dataset stored in local machine. Having to copy/mount the large dataset seems painful. Am I missing anything?

Thanks,
Anusha

#2

Hi 010akv,
Can you paste your TFrecords conversion spec file when you run “tlt-dataset-convert”?

Mounting images into a local path should work.

#3

Never mind, mounting worked. Thanks!

#4