sollol

Intelligent Load Balancer for Ollama Clusters - Adaptive Parallelism + VRAM-Aware GPU Routing + Ray/Dask/llama.cpp Distribution

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install sollol

Dependencies

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.9.66 2025-11-03      
0.9.64 2025-10-27      
0.9.60 2025-10-27      
0.9.59 2025-10-25      
0.9.56 2025-10-21      
0.9.54 2025-10-14      
0.9.53 2025-10-14      
0.9.49 2025-10-13      
0.9.48 2025-10-13      
0.9.47 2025-10-11      
0.9.30 2025-10-07      
0.9.29 2025-10-07      
0.9.28 2025-10-07      
0.9.27 2025-10-07      
0.9.26 2025-10-07      
0.9.25 2025-10-07      
0.9.24 2025-10-07      
0.9.23 2025-10-07      
0.9.22 2025-10-07      
0.9.21 2025-10-07      
0.9.20 2025-10-07      
0.9.19 2025-10-07      
0.9.17 2025-10-07      
0.9.16 2025-10-07      
0.9.15 2025-10-07      
0.9.14 2025-10-07      
0.9.13 2025-10-07      
0.9.12 2025-10-07      
0.9.11 2025-10-07      
0.9.10 2025-10-07      
0.9.9 2025-10-07      
0.9.8 2025-10-07      
0.9.7 2025-10-07      
0.9.6 2025-10-07      
0.9.5 2025-10-07      
0.9.4 2025-10-07      
0.9.3 2025-10-07      
0.9.2 2025-10-07      
0.9.1 2025-10-07      
0.9.0 2025-10-07      
0.8.1 2025-10-07      
0.8.0 2025-10-07      
0.7.1 2025-10-06      
0.7.0 2025-10-06      
0.4.1 2025-10-06      
0.4.0 2025-10-06      
0.3.6 2025-10-06      
0.3.5 2025-10-04      
0.3.4 2025-10-04      
0.3.3 2025-10-04      
0.3.2 2025-10-04      
0.3.1 2025-10-04      
0.3.0 2025-10-04      

Issues with this package?

Page last updated 2025-11-13 11:22:55 UTC