llama.cpp

ggml-org/llama.cpp

C/C++ inference. CPU, GPU, Apple Silicon. Foundation of local AI

C++ MIT

View on GitHub → Find it in the atlas

Install

irm https://llama.app/install.ps1 | iex

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for llama.cpp
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsYesStated in the project's own README, install route, CI config or release assets.
WSL2NoNo evidence of support anywhere in the project.
macOSYesStated in the project's own README, install route, CI config or release assets.
LinuxNoNo evidence of support anywhere in the project.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 3 of the 39 lists the atlas merges, independently of each other.

How it is classified

One topic, 1 harness. Each link is a prerendered page of everything else in that slice.

Harnesses & Runtime InfraLocal / Ollama

Related in Harnesses & Runtime Infra

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • Ollamaollama/ollamaOllama is a tool for running large language models locally, offering easy setup for macOS, Windows, Linux, and Docker, along with a library of…
  • LobeChatlobehub/lobehubLobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen)…
  • vLLMvllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
  • Kaitokaito-project/kaitoA Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning…
  • KinBotMarlBurroW/kinbotSelf-hosted AI agent platform with persistent memory, 23+ LLM providers, plugin store, mini-apps SDK, cron scheduling, and 6 messaging channels…
  • KubeAIkubeai-project/kubeaiAI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text
  • Llamafilemozilla-ai/llamafileMozilla project that packages LLMs into single executable files that run anywhere
  • Open WebUIopen-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)