NVIDIA TensorRT LLM

Infrastructure service

A library and runtime for optimizing large-language-model inference on NVIDIA GPUs.

Find alternatives to NVIDIA TensorRT LLM

TypeInfrastructure service
RoleStandalone tool
AvailabilityFreely available
DeploymentSelf-hosted
Intended forDeveloper
SecurityNot recorded
StatusActive
Sold withinSold on its own
PricingOpen source — official pricing ↗

What it does

developer.nvidia.com

Sources

Pricing

Official documentation · 16 Oct 2026

"NVIDIA TensorRT™ LLM is an open-source library"

Description

Official documentation · 16 Oct 2026

"real-time inference optimization for large language models"

What it does

Official documentation · 16 Oct 2026

"real-time inference optimization for large language models"

Sold within

Official documentation · 16 Oct 2026

"NVIDIA TensorRT™ LLM is an open-source library"

Name

Official documentation · 16 Oct 2026

"NVIDIA TensorRT™ LLM is an open-source library"

URL

Official documentation · 16 Oct 2026

"NVIDIA TensorRT™ LLM is an open-source library"

Deployment

Official documentation · 16 Oct 2026

"Install TensorRT LLM on Linux"

Interfaces

Official documentation · 18 Oct 2026

Page: 'The architecture provides easy-to-use Python APIs, a simple CLI, PyTorch model authorship'.

Intended for

Official documentation · 18 Oct 2026

Page: 'purpose-built to streamline the developer experience'.

Also from NVIDIA

Open NVIDIA in the directory

Something wrong here? Send a correction — quote this product id: nvidia-tensorrt-llm.