README.md1 min read
vLLM is a fast inference and serving engine for LLMs, using PagedAttention for high throughput — the production choice when you outgrow single-request local inference.
pip install vllm
Explore / vLLM
vllm-project
vLLM
High-throughput, memory-efficient inference and serving engine for LLMs.
92,864 22,758 Python Apache-2.0updated 3 days ago
Continue your stack
What teams reach for next — and why each earns a place beside vLLM. Ranked by curator confidence.
pairs wellalternativebuilt withpick a node for the why · open it from the panel