sglang
SGLang is a fast serving framework for large language models and vision language models.
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install sglang
Dependencies
- uvloop
- packaging
- scipy
- blobfile
- psutil
- sentencepiece
- xgrammar
- tiktoken
- watchfiles
- requests
- openai
- smg-grpc-servicer
- torch-memory-saver
- torchaudio
- torchcodec
- ipython
- pydantic
- einops
- sglang-kernel
- pyzmq
- torch
- cuda-python
- torchvision
- tqdm
- mistral-common
- aiohttp
- apache-tvm-ffi
- openai-harmony
- uvicorn
- interegular
- nvidia-cutlass-dsl
- nvidia-ml-py
- ninja
- av
- pillow
- flashinfer-python
- python-multipart
- py-spy
- fastapi
- prometheus-client
- transformers
- llguidance
- compressed-tensors
- build
- decord2
- datasets
- soundfile
- timm
- orjson
- flash-attn-4
- pybase64
- partial-json-parser
- torchao
- anthropic
- modelscope
- setproctitle
- msgspec
- quack-kernels
- gguf
- numpy
- outlines
- flashinfer-cubin
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 0.5.10.post1 | 2026-04-08 | ||||
| 0.5.10 | 2026-04-05 | ||||
| 0.5.10rc0 pre-release | 2026-03-27 | ||||
| 0.5.9 | 2026-02-23 | ||||
| 0.5.8.post1 | 2026-02-05 | ||||
| 0.5.8 | 2026-01-23 | ||||
| 0.5.7 | 2026-01-01 | ||||
| 0.5.6.post2 | 2025-12-11 | ||||
| 0.5.6.post1 | 2025-12-08 | ||||
| 0.5.6 | 2025-12-03 | ||||
| 0.5.5.post3 | 2025-11-17 | ||||
| 0.5.5.post2 | 2025-11-12 | ||||
| 0.5.5.post1 | 2025-11-10 | ||||
| 0.5.5 | 2025-11-06 | ||||
| 0.5.4.post3 | 2025-11-05 | ||||
| 0.5.4.post2 | 2025-11-01 | ||||
| 0.5.4.post1 | 2025-10-27 | ||||
| 0.5.4 | 2025-10-24 | ||||
| 0.5.3.post3 | 2025-10-16 | ||||
| 0.5.3.post2 | 2025-10-15 | ||||
| 0.5.3.post1 | 2025-10-09 | ||||
| 0.5.3 | 2025-10-06 | ||||
| 0.5.3rc2 pre-release | 2025-10-06 | ||||
| 0.5.3rc0 pre-release | 2025-09-15 | ||||
| 0.5.2 | 2025-09-11 | ||||
| 0.5.2rc2 pre-release | 2025-09-05 | ||||
| 0.5.2rc1 pre-release | 2025-09-02 | ||||
| 0.5.2rc0 pre-release | 2025-09-01 | ||||
| 0.5.1.post3 | 2025-08-27 | ||||
| 0.5.1.post2 | 2025-08-25 | ||||
| 0.5.1.post1 | 2025-08-24 | ||||
| 0.5.1 | 2025-08-23 | ||||
| 0.5.0rc2 pre-release | 2025-08-14 | ||||
| 0.5.0rc1 pre-release | 2025-08-13 | ||||
| 0.5.0rc0 pre-release | 2025-08-08 | ||||
| 0.4.10.post2 | 2025-08-03 | ||||
| 0.4.10.post1 | 2025-08-01 | ||||
| 0.4.10 | 2025-07-31 | ||||
| 0.4.9.post6 | 2025-07-29 | ||||
| 0.4.9.post5 | 2025-07-28 | ||||
| 0.4.9.post4 | 2025-07-26 | ||||
| 0.4.9.post3 | 2025-07-22 | ||||
| 0.4.9.post2 | 2025-07-12 | ||||
| 0.4.9.post1 | 2025-07-09 | ||||
| 0.4.9 | 2025-07-06 | ||||
| 0.4.8.post1 | 2025-06-26 | ||||
| 0.4.8 | 2025-06-24 | ||||
| 0.4.7.post1 | 2025-06-16 | ||||
| 0.4.7 | 2025-06-10 | ||||
| 0.4.6.post5 | 2025-05-24 | ||||
| 0.4.6.post4 | 2025-05-13 | ||||
| 0.4.6.post3 | 2025-05-09 | ||||
| 0.4.6.post2 | 2025-05-01 | ||||
| 0.4.6.post1 | 2025-04-28 | ||||
| 0.4.6 | 2025-04-27 | ||||
| 0.4.5.post3 | 2025-04-22 | ||||
| 0.4.5.post2 | 2025-04-20 | ||||
| 0.4.5.post1 | 2025-04-16 | ||||
| 0.4.5 | 2025-04-07 | ||||
| 0.4.4.post4 | 2025-04-05 | ||||
| 0.4.4.post3 | 2025-03-29 | ||||
| 0.4.4.post2 | 2025-03-27 | ||||
| 0.4.4.post1 | 2025-03-14 | ||||
|
|||||
| 0.4.4 | 2025-03-13 | ||||
|
|||||
| 0.4.3.post4 | 2025-03-06 | ||||
|
|||||
| 0.4.3.post3 | 2025-03-06 | ||||
|
|||||
| 0.4.3.post2 | 2025-02-17 | ||||
|
|||||
| 0.4.3.post1 | 2025-02-17 | ||||
|
|||||
| 0.4.3 | 2025-02-14 | ||||
|
|||||
| 0.4.2.post4 | 2025-02-10 | ||||
|
|||||
| 0.4.2.post3 | 2025-02-07 | ||||
|
|||||
| 0.4.2.post2 | 2025-02-05 | ||||
|
|||||
| 0.4.2.post1 | 2025-01-31 | ||||
|
|||||
| 0.4.2 | 2025-01-27 | ||||
|
|||||
| 0.4.1.post7 | 2025-01-20 | ||||
|
|||||
| 0.4.1.post6 | 2025-01-15 | ||||
|
|||||
| 0.4.1.post5 | 2025-01-11 | ||||
|
|||||
| 0.4.1.post4 | 2025-01-05 | ||||
|
|||||
| 0.4.1.post3 | 2024-12-29 | ||||
|
|||||
| 0.4.1.post2 | 2024-12-29 | ||||
|
|||||
| 0.4.1.post1 | 2024-12-27 | ||||
|
|||||
| 0.4.1 | 2024-12-25 | ||||
|
|||||
| 0.4.0.post2 | 2024-12-21 | ||||
|
|||||
| 0.4.0.post1 | 2024-12-06 | ||||
|
|||||
| 0.4.0 | 2024-12-03 | ||||
|
|||||
| 0.3.6.post3 | 2024-11-29 | ||||
|
|||||
| 0.3.6.post2 | 2024-11-27 | ||||
|
|||||
| 0.3.6.post1 | 2024-11-26 | ||||
|
|||||
| 0.3.6 | 2024-11-22 | ||||
|
|||||
| 0.3.5.post2 | 2024-11-15 | ||||
|
|||||
| 0.3.5.post1 | 2024-11-13 | ||||
|
|||||
| 0.3.5 | 2024-11-03 | ||||
|
|||||
| 0.3.4.post2 | 2024-10-25 | ||||
|
|||||
| 0.3.4.post1 | 2024-10-22 | ||||
|
|||||
| 0.3.4 | 2024-10-19 | ||||
|
|||||
| 0.3.3.post1 | 2024-10-11 | ||||
|
|||||
| 0.3.3 | 2024-10-08 | ||||
|
|||||
| 0.3.2 | 2024-09-25 | ||||
|
|||||
| 0.3.1.post3 | 2024-09-21 | ||||
|
|||||
| 0.3.1.post2 | 2024-09-19 | ||||
|
|||||
| 0.3.1.post1 | 2024-09-17 | ||||
|
|||||
| 0.3.1 | 2024-09-15 | ||||
|
|||||
| 0.3.0 | 2024-09-03 | ||||
|
|||||
| 0.2.15 | 2024-09-02 | ||||
|
|||||
| 0.2.14.post2 | 2024-08-28 | ||||
|
|||||
| 0.2.14.post1 | 2024-08-28 | ||||
|
|||||
| 0.2.14 | 2024-08-26 | ||||
|
|||||
| 0.2.13 | 2024-08-15 | ||||
|
|||||
| 0.2.12 | 2024-08-12 | ||||
|
|||||
| 0.2.11 | 2024-08-07 | ||||
|
|||||
| 0.2.10 | 2024-08-04 | ||||
|
|||||
| 0.2.9.post1 | 2024-08-02 | ||||
|
|||||
| 0.2.9 | 2024-08-02 | ||||
|
|||||
| 0.2.8 | 2024-08-01 | ||||
|
|||||
| 0.2.7 | 2024-07-30 | ||||
|
|||||
| 0.2.6 | 2024-07-28 | ||||
|
|||||
| 0.2.5 | 2024-07-26 | ||||
|
|||||
| 0.2.4 | 2024-07-26 | ||||
|
|||||
| 0.2.3 | 2024-07-26 | ||||
|
|||||
| 0.2.2 | 2024-07-26 | ||||
|
|||||
| 0.2.1 | 2024-07-26 | ||||
|
|||||
| 0.2.0 | 2024-07-25 | ||||
|
|||||
| 0.1.26 | 2024-07-25 | ||||
|
|||||
| 0.1.25 | 2024-07-25 | ||||
|
|||||
| 0.1.24 | 2024-07-24 | ||||
|
|||||
| 0.1.22 | 2024-07-20 | ||||
|
|||||
| 0.1.21 | 2024-07-15 | ||||
|
|||||
| 0.1.20 | 2024-07-14 | ||||
|
|||||
| 0.1.19 | 2024-07-09 | ||||
|
|||||
| 0.1.18 | 2024-07-04 | ||||
|
|||||
| 0.1.17 | 2024-06-08 | ||||
|
|||||
| 0.1.16 | 2024-05-14 | ||||
|
|||||
| 0.1.15 | 2024-05-12 | ||||
|
|||||
| 0.1.14 | 2024-03-22 | ||||
|
|||||
| 0.1.13 | 2024-03-11 | ||||
|
|||||
| 0.1.12 | 2024-02-11 | ||||
|
|||||
| 0.1.11 | 2024-02-03 | ||||
|
|||||
| 0.1.10 | 2024-01-30 | ||||
|
|||||
| 0.1.9 | 2024-01-24 | ||||
|
|||||
| 0.1.7 | 2024-01-21 | ||||
|
|||||
| 0.1.6 | 2024-01-21 | ||||
|
|||||
| 0.1.5 | 2024-01-18 | ||||
|
|||||
| 0.1.4 | 2024-01-16 | ||||
|
|||||
| 0.1.3 | 2024-01-16 | ||||
|
|||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue