vLLM (vllm-project/vllm) — Harnesses & Runtime Infra

Install

git clone https://github.com/vllm-project/vllm.git

Repository reader

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub

Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
Platform	Runs here	On what evidence
Windows	Likely	Inferred from the language or runtime. Nothing in the project says so.
WSL2	Likely	Inferred from the language or runtime. Nothing in the project says so.
macOS	Likely	Inferred from the language or runtime. Nothing in the project says so.
Linux	Likely	Inferred from the language or runtime. Nothing in the project says so.
Docker	No	No evidence of support anywhere in the project.

Named by 3 of the 39 lists the atlas merges, independently of each other.

One topic, 1 harness. Each link is a prerendered page of everything else in that slice.

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

Ollamaollama/ollamaOllama is a tool for running large language models locally, offering easy setup for macOS, Windows, Linux, and Docker, along with a library of…
llama.cppggml-org/llama.cppC/C++ inference. CPU, GPU, Apple Silicon. Foundation of local AI
LobeChatlobehub/lobehubLobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen)…
Kaitokaito-project/kaitoA Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning…
KinBotMarlBurroW/kinbotSelf-hosted AI agent platform with persistent memory, 23+ LLM providers, plugin store, mini-apps SDK, cron scheduling, and 6 messaging channels…
KubeAIkubeai-project/kubeaiAI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text
Llamafilemozilla-ai/llamafileMozilla project that packages LLMs into single executable files that run anywhere
Open WebUIopen-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)