Loading Raw Training data in Text-Generation-Webui

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Good evening all.

I’m running Text Generation Webui from the NVIDIA Container. I want to do some training, but am unable to locate the training/datasets folder where I am supposed to - per the oobooga instructions - put the raw text file. I’ve tried to create it as a subfolder of the Text-generation-webui folder, and so on.

This is frustrating because it should be very simple. Any suggestions?

Thank you!

3

Hi,
Here are some suggestions for the common issues:

1. Performance

Please run the below command before benchmarking deep learning use case:

$ sudo nvpmodel -m 0
$ sudo jetson_clocks

2. Installation

Installation guide of deep learning frameworks on Jetson:

3. Tutorial

Startup deep learning tutorial:

4. Report issue

If these suggestions don’t help and you want to report an issue to us, please attach the model, command/step, and the customized app (if any) with us to reproduce locally.

Thanks!

4

Hi Harrison.schramm:
Can you please share more info about how you setup the env?
Like, if you are using jetson-ai-lab, you might need to modify the start up script to mount your dataset folder to the docker?

PS: AI rookie here. I don’t think using Jetson Orin to train an AI model is OK. Orin indeed have a large GPU memory, but the CUDA cores is pretty poor compare to other GPU cards.

5

There is no update from you for a period, assuming this is not an issue anymore.
Hence, we are closing this topic. If need further support, please open a new one.
Thanks

Hi,

Could you share the steps you run and the output error log so we can know more about your issue?

Thanks