lmcache-vllm

lmcache_vllm: LMCache's wrapper for vllm

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install lmcache-vllm

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.6.2.3 2024-12-10
0.6.2.2 2024-10-29
0.6.2.1 2024-09-24
0.6.2 2024-09-20
0.6.1 2024-09-20
0.6.1rc2 pre-release 2024-09-20
0.6.1rc1 pre-release 2024-09-20

Issues with this package?

Page last updated 2024-12-10 19:58:24 UTC