sglang-router

SGLang router is a standalone module implemented in Rust to achieve data parallelism across SGLang instances.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install sglang-router

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.4 2025-01-24    
0.1.3 2025-01-20    
0.1.2 2025-01-19    
0.1.1 2024-12-12    
0.1.0 2024-12-11    
0.0.11 2024-12-03    
0.0.10 2024-11-27    
0.0.9 2024-11-26    
0.0.8 2024-11-25    
0.0.7 2024-11-24    
0.0.6 2024-11-23    
0.0.5 2024-11-23    
0.0.4 2024-11-11    
0.0.3 2024-11-11    
0.0.2 2024-11-11    
0.0.1 2024-11-10    

Issues with this package?

Page last updated 2025-01-24 07:26:28 UTC