llama.cpp vs LiteLLM

A detailed comparison of llama.cpp and LiteLLM across 11 dimensions.

llama.cpp

C/C++ LLM inference engine

brew install llama.cpp

Unified LLM API proxy (100+ model providers)

pip install litellm

Tool	Price	GitHub Stars	Open Source	Models	Max Context	Multi-file Edit	Git Integration	MCP Support	Sub-agents
llama.cpp🔓 C/C++ LLM inference engine	Free (local)	121K+	✓	GGUF models (Llama, Mistral, Qwen, etc.)	可配置（最高 128K+）	—	—	—	—
LiteLLM🔓 Unified LLM API proxy (100+ model providers)	Free (BYOK) + Enterprise	54K+	✓	100+ models (OpenAI, Anthropic, Google, local, etc.)	依模型而定	—	—	—	—

llama.cppbrew install llama.cpp

LiteLLMpip install litellm