piwheels

mlx-llm-server

server to serve mlx model as an OpenAI compatible API

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install mlx-llm-server

Dependencies

• None

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
0.1.10	2024-03-24
0.1.9	2024-03-02
0.1.8	2024-03-02
0.1.7	2024-02-16
0.1.6	2024-02-13
0.1.5	2024-01-26
0.1.4	2024-01-26
0.1.3 yanked	2024-01-25
0.1.2	2024-01-21

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue