Transformer Engine

Developer tool

Transformer Engine accelerates Transformer model training and inference on NVIDIA GPUs using low-precision formats.

Find alternatives to Transformer Engine

TypeDeveloper tool
RoleStandalone tool
AvailabilityFreely available
DeploymentSelf-hosted
Intended for—
SecurityNot recorded
StatusActive
Sold withinSold on its own
PricingOpen source — official pricing ↗

What it does

docs.nvidia.com

Sources

Pricing

Official documentation · 15 Oct 2026

"is an open source library"

Description

Official documentation · 15 Oct 2026

"accelerating Transformer models on NVIDIA GPUs"

What it does

Official documentation · 15 Oct 2026

"both training and inference"

Sold within

Official documentation · 15 Oct 2026

"framework agnostic C++ API"

Name

Official documentation · 15 Oct 2026

"Transformer Engine (TE) is a library"

URL

Official documentation · 15 Oct 2026

"Transformer Engine (TE) is a library"

Deployment

Official documentation · 15 Oct 2026

"Transformer Engine can be directly installed"

Interfaces

Official documentation · 18 Oct 2026

Page: 'It provides a Python API consisting of modules to easily build a Transformer layer'.

Also from NVIDIA

Open NVIDIA in the directory

Something wrong here? Send a correction — quote this product id: nvidia-transformer-engine.