If I use Tensorrt-LLM for business use, do we need any license?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

I want to host a small LLM using tensorrt-llm on an Nvidia a10 GPU.

tensorrt-llm has tensorrt as a dependency.

The wheel file for tensorrt has the license as “other/proprietary” (Client Challenge) but the github (GitHub - NVIDIA/TensorRT: NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.) says apache 2.0.

Can I pip install tensorrt-llm along with tensorrt and use it for commercial purposes or do i need a license ?

6

Kindly let me know

7

Hi @plsomasundaram93,

You can find the license agreement for TensorRT here LICENSE AGREEMENT — NVIDIA TensorRT Documentation and the license for TensorRT-llm here TensorRT-LLM/LICENSE at main · NVIDIA/TensorRT-LLM · GitHub.

Best,

Sophie