← All tools

Tag #serving

vLLM

vLLM

PyTorch Foundation

High-throughput serving engine for running open LLMs with an OpenAI-compatible API

v0.25.12026-07-14PythonApache-2.0
#llm #serving #inference #python
86.9k Completely free Open source