Shimmy

Michael-A-Kuykendall/shimmy

Python-free Rust inference server with OpenAI API compatibility and hot model swapping

Rust Apache-2.0

View on GitHub → Find it in the atlas

Install

cargo install shimmy --locked

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for Shimmy
GitHub's social card — no screenshot was found for this project, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsYesStated in the project's own README, install route, CI config or release assets.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSYesStated in the project's own README, install route, CI config or release assets.
LinuxYesStated in the project's own README, install route, CI config or release assets.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 1 of the 39 lists the atlas merges.

  • LLMOps (tensorchord)

How it is classified

One topic, 2 harnesses. Each link is a prerendered page of everything else in that slice.

Harnesses & Runtime InfraCodex / OpenAILocal / Ollama

Related in Harnesses & Runtime Infra

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • LobeChatlobehub/lobehubLobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen)…
  • Kaitokaito-project/kaitoA Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning…
  • KubeAIkubeai-project/kubeaiAI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text
  • Open WebUIopen-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  • codingmoh/open-codexcodingmoh/open-codexOpen-source Codex-inspired CLI running 100% locally with Ollama. No API key required, offline capable
  • feiskyer/codex-settingsfeiskyer/codex-settingsReady-to-use configs for LiteLLM, Ollama, LM Studio, OpenRouter, and Azure OpenAI
  • gemini-openai-proxyBrioch/gemini-openai-proxyUniversal compatibility layer serving Gemini 2.5 Pro/Flash through OpenAI protocol. Works instantly with existing tools like LangChain, llama.cpp…
  • llm-cache-routersvalench/llm-cache-routerA lightweight, async-first Python library combining semantic caching, multi-provider routing (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen) and…