With a correct verification, but the same result trying to deploy.
Try to use kubernetes CONNAISSEUR, but worst that other solutions. Not recognize when use the public-key and alwais launch the message: Error from server: admission webhook "connaisseur-svc.connaisseur.svc" denied the request: Failed to find signature in transparency log.
I’m not at kubernetes expert, and I continuisly fighting to try test our TAO solution, but with the last versions, we are doing back steps…
Double checked before start using the notebooks that the new version not include changes in the manage of the API. I’m using the samples notebooks: nvidia/tao/tao-getting-started:5.0.0
Send it by PM.
Also attach TF1 run.
$ docker run nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5
=======================
=== TAO Toolkit TF1 ===
=======================
NVIDIA Release 5.0.0-TF1 (build 52693369)
TAO Toolkit Version 5.0.0
Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
This container image and its contents are governed by the TAO Toolkit End User License Agreement.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/tao-toolkit-software-license-agreement
NOTE: The SHMEM allocation limit is set to the default of 64MB. This may be
insufficient for TAO Toolkit. NVIDIA recommends the use of the following flags:
docker run --gpus all --ipc=host --ulimit memlock=-1 --ulimit stack=67108864 ...
Also attach the log when the pod of the JOB is created:
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Pulling 26m (x90 over 17h) kubelet Pulling image "nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5"
Warning Failed 3m40s (x90 over 17h) kubelet Failed to pull image "nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5": rpc error: code = Unknown desc = failed to pull and unpack image "nvcr.io/nvidia/tao/tao-toolkit:5.0.0-tf1.15.5": failed to copy: httpReadSeeker: failed open: server message: invalid_token: authorization failed
Warning Failed 3m40s (x91 over 17h) kubelet Error: ErrImagePull
Login to NGC via docker (using the user’s API Key)
docker login nvcr.io
username: $oauthtoken # Yes, "$oauthtoken" is the username that should be used
password: <Your-API-Key>
The expected output should roughly include the following:
WARNING! Your password will be stored unencrypted in `/$USER/.docker/config.json`.
…
Login Succeeded
Extract the auth token from docker’s file. In this example it is located at /$USER/.docker/config.json as shown above.
The config file should look roughly like this:
{
"auths": {
"nvcr.io": {
"auth": "<long hexa-decimal string. This is the token we need.>"
}
}
}
Update containerd’s configuration file at /etc/containerd/config.toml:
Remove the comments from the 3 configuration lines.
Insert your auth token as described in the line itself.
Add the nvcr.io auth token (taken from docker’s config.json file above)
...
[plugins."io.containerd.grpc.v1.cri".registry.mirrors."nvcr.io"]
endpoint = ["https://nvcr.io"]
[plugins."io.containerd.grpc.v1.cri".registry.configs]
[plugins."io.containerd.grpc.v1.cri".registry.configs."nvcr.io".auth]
auth = "<auth token as copied from docker's config.json file>"
...
Note: The file is extremely sensitive to spaces and indentation. Please make sure to use only spaces (’ '), and to use two spaces per indentation level.
Restart the containerd service to apply your changes: systemctl restart containerd