ray-vllm

Deploy vLLM models to a ray cluster

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install ray-vllm

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.9.2 2025-03-22    

Issues with this package?

Page last updated 2025-03-22 23:42:11 UTC