1
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
About vllm-project/vllm
vllm-project/vllm is an open-source project on GitHub, mainly written in Python. A high-throughput and memory-efficient inference and serving engine for LLMs It currently holds 94,071 stars and 0 forks with 0 open issues, and was last pushed on an unknown date (repository created unknown).
Project Overview
AI Homed tracks it on the AI Models & LLM Tools board, currently at rank #34 with 0 new stars today.
GitHub Repository Details
README
(README not available)
GitHub Stars & Activity
94,071Stars
0Forks
0Open issues
PythonLanguage
GitHub Popularity
GitHub stars94,071
Forks0
Open issues0
Primary languagePython
License-
Stars gained today0
Created-
Last pushed-
Trending History
Daily boardrank #34 · ▲ 0 stars
Weekly boardrank #34 · ▲ 0 stars
Monthly boardrank #34 · ▲ 0 stars
Related AI Projects
2
3
4
5
6
7
8