Ollama Herd

geeks-accelerator/ollama-herd

Routes LLM, image, speech-to-text and embedding requests across a fleet of machines you own. Auto-discovers nodes over mDNS and scores each on memory fit, thermal state, queue depth and already-loaded models. OpenAI-, Ollama- and Anthropic-compatible

Python MIT

View on GitHub → Find it in the atlas

Install

pip install ollama-herd

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for Ollama Herd
GitHub's social card — no screenshot was found for this project, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsNoNo evidence of support anywhere in the project.
WSL2NoNo evidence of support anywhere in the project.
macOSYesStated in the project's own README, install route, CI config or release assets.
LinuxNoNo evidence of support anywhere in the project.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 1 of the 39 lists the atlas merges.

  • LLMOps (InftyAI)

How it is classified

One topic, 4 harnesses. Each link is a prerendered page of everything else in that slice.

Harnesses & Runtime InfraClaude CodeClaude / AnthropicCodex / OpenAILocal / Ollama

Related in Harnesses & Runtime Infra

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • llm-swarm-routermatthewdcage/llm-swarm-routerSelf-hosted mesh router for local LLM backends — OpenAI /v1 + Anthropic Messages on :11400, mDNS LAN peers. Complements cloud gateways with local…
  • opencodexlidge-jun/opencodex(8.5k ⭐) - A local provider proxy and dashboard that routes Codex CLI, the Codex app, SDKs, and Claude Code to multiple LLM providers
  • Rapid-MLXraullenchai/Rapid-MLXOpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching
  • zen-mcp-serverBeehiveInnovations/pal-mcp-server(11.6k ⭐) - The power of Claude Code + Gemini / OpenAI / Grok / OpenRouter / Ollama / Custom Model working as one
  • ccmanagerkbwo/ccmanagerCoding agent session manager supporting Claude Code, Gemini CLI, Codex, Cursor, Copilot, Cline, OpenCode, Kimi CLI. Smart auto-approval via Haiku…
  • CLI Proxy APIrouter-for-me/CLIProxyAPI(51.2k ⭐) - API service that wraps Antigravity, Codex, Claude Code, and Grok Build behind OpenAI-, Gemini-, Claude-, and Codex-compatible endpoints
  • AgentWatchmishanefedov/agentwatchLocal-only TUI + web dashboard that tails Gemini CLI sessions alongside Claude Code, Codex, Cursor, Hermes, and OpenClaw on one unified timeline…
  • claude-replayes617/claude-replayby es617 - An outstanding, creative library that converts Claude Code session transcripts into self-contained, embeddable HTML replays - interactive…