Kaito

kaito-project/kaito

A Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning. Includes an OpenAI-compatible server for inference and preset configurations for popular runtimes such as vLLM and transformers

Go No licence declared

View on GitHub → Find it in the atlas

Install

git clone https://github.com/kaito-project/kaito.git

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for Kaito
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsNoNo evidence of support anywhere in the project.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSNoNo evidence of support anywhere in the project.
LinuxYesStated in the project's own README, install route, CI config or release assets.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 2 of the 39 lists the atlas merges, independently of each other.

  • LLMOps (InftyAI)
  • LLMOps (tensorchord)

How it is classified

One topic, 2 harnesses. Each link is a prerendered page of everything else in that slice.

Harnesses & Runtime InfraCodex / OpenAILocal / Ollama

Related in Harnesses & Runtime Infra

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • LobeChatlobehub/lobehubLobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen)…
  • KubeAIkubeai-project/kubeaiAI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text
  • Open WebUIopen-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  • codingmoh/open-codexcodingmoh/open-codexOpen-source Codex-inspired CLI running 100% locally with Ollama. No API key required, offline capable
  • feiskyer/codex-settingsfeiskyer/codex-settingsReady-to-use configs for LiteLLM, Ollama, LM Studio, OpenRouter, and Azure OpenAI
  • gemini-openai-proxyBrioch/gemini-openai-proxyUniversal compatibility layer serving Gemini 2.5 Pro/Flash through OpenAI protocol. Works instantly with existing tools like LangChain, llama.cpp…
  • llm-cache-routersvalench/llm-cache-routerA lightweight, async-first Python library combining semantic caching, multi-provider routing (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen) and…
  • Llm-Interfacesamestrin/llm-interfaceA simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemin…