LiteLLM

BerriAI/litellm

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider resilience (automatic failover on 429/500 errors), budget guardrails, or the ability to swap models wit

Python No licence declared

View on GitHub → Find it in the atlas

Install

uv tool install 'litellm[proxy]'

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for LiteLLM
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsLikelyInferred from the language or runtime. Nothing in the project says so.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSLikelyInferred from the language or runtime. Nothing in the project says so.
LinuxLikelyInferred from the language or runtime. Nothing in the project says so.
DockerYesStated in the project's own README, install route, CI config or release assets.

Where it came from

Named by 6 of the 39 lists the atlas merges, independently of each other.

  • AI Agent Security Tooling
  • AI Agents (Schwoebel)
  • AI Coding Tools (a4d)
  • Harness Engineering
  • LLMOps (InftyAI)
  • LLMOps (tensorchord)

How it is classified

One topic, 4 harnesses. Each link is a prerendered page of everything else in that slice.

Orchestrators & Multi-AgentClaude / AnthropicCodex / OpenAILangChain / LangGraphLocal / Ollama

Related in Orchestrators & Multi-Agent

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • bernsteinsipyourdrink-ltd/bernsteinDeterministic scheduler for 40+ CLI coding agents running in parallel git worktrees with an HMAC-signed audit chain, signed agent cards, and…
  • Autohand Code CLIautohandai/code-cliAutohand Code CLI is a self-evolving autonomous coding agent for the terminal, using the ReAct pattern to reason about and modify entire codebases…
  • PersonalJarvisDodaios/DodaiosDesktop voice and chat assistant for Windows, macOS, and Linux that runs CLI coding agents such as Claude Code, Codex, and Gemini CLI side by side…
  • swarm-orchestratormoonrunnerkc/swarm-orchestratorContract-first multi-agent orchestrator that races persona candidates per typed obligation, verifies before commit, and logs every action in an…
  • ALF OSalamparelli/alfSelf-hosted AI assistant daemon with encrypted credential vault, persistent memory, cron scheduler, multi-provider routing (Claude Code, Codex, GPT…
  • DecisionBoxdecisionbox-io/decisionbox-platformOpen-source AI data discovery platform that connects to warehouses (BigQuery, Redshift, Snowflake, etc.), runs autonomous agents that write and…
  • MLE-agentMLSysOps/MLE-agentYour intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research…
  • PickySteveKernelLord/pickysteveSkill router and context picker for coding agents: a local model (via Ollama, offline by default) routes each prompt to the right skill via hybrid…