piwheels

petals

Easy way to efficiently run 100B+ language models without high-end GPUs

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install petals

Dependencies

• humanfriendly
• safetensors
• async-timeout
• huggingface-hub
• dijkstar
• speedtest-cli
• torch
• accelerate
• peft
• transformers
• cpufeature
• hivemind
• sentencepiece
• pydantic
• bitsandbytes
• tokenizers
• packaging
• tensor-parallel

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
2.2.0.post1	2023-11-20
petals-2.2.0.post1-py3-none-any.whl (114 KB)
2.2.0	2023-09-06
petals-2.2.0-py3-none-any.whl (113 KB)
2.1.0	2023-08-24
petals-2.1.0-py3-none-any.whl (104 KB)
2.0.1.post2	2023-08-11
petals-2.0.1.post2-py3-none-any.whl (103 KB)
2.0.1.post1	2023-08-03
petals-2.0.1.post1-py3-none-any.whl (102 KB)
2.0.1	2023-07-23
petals-2.0.1-py3-none-any.whl (102 KB)
2.0.0.post3	2023-07-20
petals-2.0.0.post3-py3-none-any.whl (101 KB)
2.0.0.post2	2023-07-20
petals-2.0.0.post2-py3-none-any.whl (101 KB)
2.0.0.post1	2023-07-19
petals-2.0.0.post1-py3-none-any.whl (101 KB)
2.0.0	2023-07-19
petals-2.0.0-py3-none-any.whl (100 KB)
1.1.5	2023-05-09
petals-1.1.5-py3-none-any.whl (85 KB)
1.1.4	2023-04-21
petals-1.1.4-py3-none-any.whl (86 KB)
1.1.3	2023-03-01
petals-1.1.3-py3-none-any.whl (91 KB)
1.1.2	2023-01-30
petals-1.1.2-py3-none-any.whl (90 KB)
1.1.1	2023-01-13
petals-1.1.1-py3-none-any.whl (89 KB)
1.1.0	2023-01-10
petals-1.1.0-py3-none-any.whl (84 KB)
1.0.0	2022-12-30
petals-1.0.0-py3-none-any.whl (79 KB)
0.0.1	2022-12-27
petals-0.0.1-py3-none-any.whl (1 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue