tensor-parallel
Automatically shard your large model between multiple GPUs, works without torch.distributed
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install tensor-parallel
Dependencies
Releases
| Version | Released | Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|
| 2.0.0 | 2023-08-06 | |||
| 1.3.2 | 2023-07-27 | |||
| 1.3.1 | 2023-07-26 | |||
| 1.3.0 | 2023-07-22 | |||
| 1.2.9 | 2023-07-21 | |||
| 1.2.8 | 2023-06-23 | |||
| 1.2.7 | 2023-06-20 | |||
| 1.2.6 | 2023-06-19 | |||
| 1.2.5 | 2023-06-14 | |||
| 1.2.4 | 2023-05-14 | |||
| 1.2.3 | 2023-05-14 | |||
| 1.2.2 | 2023-04-17 | |||
| 1.2.1 | 2023-04-10 | |||
| 1.2.0 | 2023-04-03 | |||
| 1.1.4 | 2023-03-27 | |||
| 1.1.3 | 2023-03-23 | |||
| 1.1.2 yanked | 2023-03-22 | |||
| 1.1.1 | 2023-03-15 | |||
| 1.1.0 | 2023-03-06 | |||
| 1.0.25 | 2023-02-21 | |||
| 1.0.24 | 2023-01-12 | |||
| 1.0.23 | 2023-01-03 | |||
| 1.0.22 | 2022-12-30 | |||
| 1.0.21.dev0 pre-release | 2022-12-22 | |||
| 1.0.19 | 2022-12-26 | |||
| 1.0.18 | 2022-12-15 | |||
| 1.0.17 | 2022-12-14 | |||
| 1.0.16 | 2022-12-14 | |||
| 1.0.15 | 2022-12-14 | |||
| 1.0.14 | 2022-12-14 | |||
| 1.0.3 | 2022-12-22 | |||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue