1
→About ggml-org/llama.cpp
ggml-org/llama.cpp is an open-source project on GitHub, mainly written in C++. LLM inference in C/C++ It currently holds 128,381 stars and 23,246 forks with 2,489 open issues, and was last pushed on 2026-09-16 (repository created 2023-03-10).
Project Overview
AI Homed tracks it on the Today's Trending board, currently at rank #34 with 128 new stars today.
GitHub Repository Details
README
llama.cpp
LLM inference in C/C++
ggml / ops / maintainer PRs%20sort%3Aupdated-desc) / dev stats / lib llama API / llama-server REST API
Quick start
A few options to get llama.cpp installed on your machine:
- Visit https://llama.app and follow the instructions
- Run with Docker - see our Docker documentation
- Download pre-built binaries from the releases page
- Build from source by cloning this repository - check out our build guide
# Download and run a model directly from Hugging Face
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF
Launch OpenAI-compatible API server
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF
|
|
|
