5. Start an EC2 Virtual Machine Instance. For running TAO Toolkit , use the NVIDIA Deep Learning Amazon Machine Instance (AMI). To use this AMI, select the **AWS Marketplace** and search for the **NVIDIA Deep Learning AMI**.
**Note** The Amazon EC2 P3 and G4 instances are optimized for the NVIDIA Volta/Turing GPUs.
6. Select one of the Amazon EC2 P3 and G4 instance types according to your P3 and G4 instance types.
I have to select one from the following available list:
so my guess is to use:
Q : is this guess correct?
if i copy that ami across to my own account and run it has a version of python installed ( Python 3.8.10 ) that is not supported by the TAO toolkit (python >=3.6.9<3.7 ) Q: Is this correct ? what do i need to do to get this working ?
Small note: in step 2. Once you have logged in, select **Compute** under EC2.
there is no Compute option in the EC2 (anymore?)
Q: If i do use that AMI, what is already installed of the prerequisites and which one isn’t ?
Q: Is there a single docker image available that i can run on that AMI so all prerequisites are already installed ?
Are there no single end to end steps described here what to do to get a working TAO-Toolkit ?
I tried to pause the video but some of those commands that were entered were on the screen for a few frames. even then i tried to follow them and failed.
Can the exact steps be added to a script or at least a list of the commands please ?
would it be easier for everyone to have all these instructions in 1 location in the documentation that people can follow step by step so people don’t have to ask ?
I’m a bit confused whether to install miniconda or not. it’s not in the requirements, but i guess because the particular NVIdia AMI has a newer version of python installed i should ?
So the software requirement for the nvidia-driver is 525 if installing TAO 5.0. Are there more of these dependent versions ? So is it correct that that particular AMI that i found in the AWS Marketplace has the wrong version of nvidia-driver installed ?
How does everyone else get TAO Toolkit 5.0 running ? I have a feeling i’m missing something (might be some brain cells on my part)
For TAO 5.0, the nvidia-smi result is expected to >520. You can check with $nvidia-smi . Actually when it is lower than 520, some networks can also work without any issue. Suggesting >520 is in order to make sure every networks can work.