KubeAI

kubeai-project/kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text

Go Apache-2.0

View on GitHub → Find it in the atlas

Install

helm install kubeai kubeai/kubeai --wait --timeout 10m

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for KubeAI
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsLikelyInferred from the language or runtime. Nothing in the project says so.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSLikelyInferred from the language or runtime. Nothing in the project says so.
LinuxLikelyInferred from the language or runtime. Nothing in the project says so.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 2 of the 39 lists the atlas merges, independently of each other.

  • LLMOps (InftyAI)
  • LLMOps (tensorchord)

How it is classified

One topic, 2 harnesses. Each link is a prerendered page of everything else in that slice.

Harnesses & Runtime InfraCodex / OpenAILocal / Ollama

Related in Harnesses & Runtime Infra

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • LobeChatlobehub/lobehubLobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen)…
  • Kaitokaito-project/kaitoA Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning…
  • Open WebUIopen-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  • codingmoh/open-codexcodingmoh/open-codexOpen-source Codex-inspired CLI running 100% locally with Ollama. No API key required, offline capable
  • feiskyer/codex-settingsfeiskyer/codex-settingsReady-to-use configs for LiteLLM, Ollama, LM Studio, OpenRouter, and Azure OpenAI
  • gemini-openai-proxyBrioch/gemini-openai-proxyUniversal compatibility layer serving Gemini 2.5 Pro/Flash through OpenAI protocol. Works instantly with existing tools like LangChain, llama.cpp…
  • llm-cache-routersvalench/llm-cache-routerA lightweight, async-first Python library combining semantic caching, multi-provider routing (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen) and…
  • Llm-Interfacesamestrin/llm-interfaceA simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemin…