piwheels

tensorrt-llm

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install tensorrt-llm

Dependencies

• None

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
1.3.0rc10 pre-release	2026-03-31
1.3.0rc9 pre-release	2026-03-24
1.3.0rc8 pre-release	2026-03-17
1.3.0rc7 pre-release	2026-03-10
1.3.0rc6 pre-release	2026-03-03
1.3.0rc5.post1 pre-release	2026-03-06
1.3.0rc5 pre-release	2026-02-24
1.3.0rc4 pre-release	2026-02-17
1.3.0rc3 pre-release	2026-02-12
1.3.0rc2 pre-release	2026-02-03
1.3.0rc1 pre-release	2026-01-27
1.3.0rc0 pre-release	2026-01-22
1.2.0	2026-03-12
1.2.0rc8 pre-release	2026-01-15
1.2.0rc7 pre-release	2026-01-08
1.2.0rc6.post3 pre-release	2026-02-05
1.2.0rc6.post2 pre-release	2026-01-22
1.2.0rc6.post1 pre-release	2026-01-11
1.2.0rc6 pre-release	2025-12-23
1.2.0rc5 pre-release	2025-12-10
1.2.0rc4 pre-release	2025-11-25
1.2.0rc3 pre-release	2025-11-21
1.2.0rc2.post2 pre-release	2026-02-05
1.2.0rc2 pre-release	2025-11-07
1.2.0rc1 pre-release	2025-10-22
1.2.0rc0 pre-release	2025-09-30
1.1.0	2025-12-19
1.1.0rc5 pre-release	2025-09-17
1.1.0rc4 pre-release	2025-09-10
1.1.0rc3 pre-release	2025-09-04
1.1.0rc2 pre-release	2025-08-30
1.1.0rc1 pre-release	2025-08-22
1.1.0rc0 pre-release	2025-08-15
1.0.0	2025-09-24
1.0.0rc6 pre-release	2025-08-07
1.0.0rc5 pre-release	2025-08-04
1.0.0rc4 pre-release	2025-07-22
1.0.0rc3 pre-release	2025-07-16
1.0.0rc2 pre-release	2025-07-08
1.0.0rc1 pre-release	2025-07-01
1.0.0rc0 pre-release	2025-06-25
0.21.0	2025-08-04
0.21.0rc2 pre-release	2025-06-18
0.21.0rc1 pre-release	2025-06-11
0.21.0rc0 pre-release	2025-06-04
0.20.0	2025-06-19
0.20.0rc3 pre-release	2025-05-20
0.20.0rc2 pre-release	2025-05-13
0.20.0rc1 pre-release	2025-04-29
0.20.0rc0 pre-release	2025-04-23
0.19.0	2025-05-09
0.19.0rc0 pre-release	2025-04-16
0.19.0.dev2025040800 pre-release	2025-04-08
0.19.0.dev2025040100 pre-release	2025-04-01
0.19.0.dev2025032500 pre-release	2025-03-26
0.19.0.dev2025031800 pre-release	2025-03-18
0.18.2	2025-04-16
0.18.1	2025-04-09
0.18.0	2025-04-02
0.18.0.dev2025031100 pre-release	2025-03-12
0.18.0.dev2025030400 pre-release	2025-03-05
0.18.0.dev2025022500 pre-release	2025-02-26
0.18.0.dev2025021800 pre-release	2025-02-19
0.18.0.dev2025021101 pre-release	2025-02-13
0.18.0.dev2025021100 pre-release	2025-02-13
0.18.0.dev2025020400 pre-release	2025-02-07
0.17.0.post1	2025-02-02
0.17.0 yanked	2025-01-30
0.17.0.dev2024121700 pre-release	2024-12-17
0.16.0	2024-12-24
0.16.0.dev2024121000 pre-release	2024-12-12
0.16.0.dev2024120300 pre-release	2024-12-05
0.16.0.dev2024112600 pre-release	2024-11-26
0.16.0.dev2024111900 pre-release	2024-11-20
0.15.0	2024-12-04
0.15.0.dev2024111200 pre-release	2024-11-12
0.15.0.dev2024110500 pre-release	2024-11-05
0.15.0.dev2024102900 pre-release	2024-10-30
0.15.0.dev2024102200 pre-release	2024-10-22
0.15.0.dev2024101500 pre-release	2024-10-15
0.14.0	2024-11-01
0.14.0.dev2024100800 pre-release	2024-10-08
0.14.0.dev2024100100 pre-release	2024-09-30
0.14.0.dev2024092401 pre-release	2024-09-26
0.14.0.dev2024092400 pre-release	2024-09-24
0.14.0.dev2024091700 pre-release	2024-09-18
0.14.0.dev2024091000 pre-release	2024-09-10
0.13.0	2024-09-30
0.13.0.dev2024090300 pre-release	2024-09-04
0.13.0.dev2024082700 pre-release	2024-08-27
0.13.0.dev2024082000 pre-release	2024-08-20
0.13.0.dev2024081300 pre-release	2024-08-14
0.12.0	2024-08-29
0.12.0.dev2024080600 pre-release	2024-08-07
0.12.0.dev2024073000 pre-release	2024-07-30
0.12.0.dev2024072302 pre-release	2024-07-29
0.12.0.dev2024072301 pre-release	2024-07-25
0.12.0.dev2024072300 pre-release	2024-07-24
0.12.0.dev2024071600 pre-release	2024-07-16
0.12.0.dev2024070900 pre-release	2024-07-09
0.12.0.dev2024070200 pre-release	2024-07-04
0.11.0	2024-07-17
0.11.0.dev2024062500 pre-release	2024-06-25
0.11.0.dev2024061800 pre-release	2024-06-18
0.11.0.dev2024061100 pre-release	2024-06-12
0.11.0.dev2024060400 pre-release	2024-06-05
0.11.0.dev2024052800 pre-release	2024-05-28
0.11.0.dev2024052100 pre-release	2024-05-21
0.11.0.dev2024051400 pre-release	2024-05-14
0.10.0	2024-06-05
0.10.0.dev2024050700 pre-release	2024-05-07
0.10.0.dev2024043000 pre-release	2024-04-30
0.10.0.dev2024042300 pre-release	2024-04-24
0.10.0.dev2024041600 pre-release	2024-04-16
0.9.0	2024-04-11
0.9.0.dev2024040900 pre-release	2024-04-09
0.9.0.dev2024040200 pre-release	2024-04-01
0.9.0.dev2024032600 pre-release	2024-03-26
0.9.0.dev2024031900 pre-release	2024-03-19
0.9.0.dev2024031200 pre-release	2024-03-13
0.9.0.dev2024030500 pre-release	2024-03-05
0.9.0.dev2024022700 pre-release	2024-02-27
0.9.0.dev2024022000 pre-release	2024-02-21
0.9.0.dev2024020600 pre-release	2024-02-06
0.8.0	2024-02-29
0.8.0.dev2024013000 pre-release	2024-02-01
0.8.0.dev2024012302 pre-release	2024-01-31
0.8.0.dev2024012301 pre-release	2024-01-24
0.8.0.dev2024011601 pre-release	2024-01-17
0.8.0.dev20240123 pre-release	2024-01-24
0.8.0.dev20240116 pre-release	2024-01-17
0.7.1	2023-12-28
0.7.0	2023-12-20
0.6.1	2023-12-05
0.5.0.post1	2023-11-01
0.5.0	2023-10-20

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue