Frameworks & SDKs tools for Local / Ollama

15 projects · 15 with stars to rank by · 53,569 combined stars · snapshot 2026-11-01

Libraries you build an agent out of, and the tool-calling interfaces it reaches the world through.

Runs against a named local runtime: Ollama, llama.cpp, vLLM, LM Studio, llamafile or GPT4All.

Filter this live on the atlas →

Runs on: Windows WSL2 macOS Linux Docker

#ShotProject StarsPlugs into What it doesLang / licence / push
1OpenHumantinyhumansai/openhuman42,469
2 lists
MCPLocal / Ollama
Open-source personal agent harness: desktop app and Rust library with built-in memory, token compression, and instant tool search, efficient enough to run hundreds of agents on a $10 server.
irm https://raw.githubusercontent.com/tinyhumansai/openhuman/main/scripts/install.ps1 | iex
Rust
GPL-3.0
2026-10-31
2Strands Agents SDKstrands-agents/harness-sdk9,021
6 lists
Claude / AnthropicMCPCodex / OpenAIGemini / GoogleLocal / Ollama
AWS's open-source, model-driven agent SDK that treats the loop, tool binding, and guardrails as first-class primitives. Supports Bedrock, Anthropic, OpenAI, Gemini, and Ollama with native MCP, built-in observability, and multi-agent patterns — the missing AWS open-source harness framework alongside Bedrock AgentCore
pip install strands-harness
Python
Apache-2.0
2026-10-30
3Ollama-Mcp-Bridgepatruff/ollama-mcp-bridge984
1 list
MCPLocal / Ollama
Bridge between Ollama and MCP servers, enabling local LLMs to use Model Context Protocol tools
npm install -g @patruff/server-flux
TypeScript
MIT
2025-04-20
4Open-Webui-ToolsHaervwe/open-webui-tools831
1 list
Local / Ollama
a Repository of Open-WebUI tools to use with your favourite LLMs
git clone https://github.com/Haervwe/open-webui-tools.git
Python
MIT
2026-10-30
5escapeboy/agent-fleet-oescapeboy/agent-fleet-o77
1 list
Claude / AnthropicMCPCodex / OpenAIGemini / GoogleLangChain / LangGraphLocal / Ollama
Self-hosted mission control for AI agents: manage agents, experiments, workflows, crews, skills and more
git clone https://github.com/escapeboy/agent-fleet-o.git
PHP
AGPL-3.0
2026-10-31
6Widemem-Airemete618/widemem-ai49
1 list
Claude / AnthropicCodex / OpenAILocal / Ollama
Lightweight Python memory layer for LLM agents with importance scoring, temporal decay, 3-tier hierarchical memory, YMYL prioritization, and batch conflict resolution. Local-first with SQLite + FAISS. github | website | pypi
pip install "widemem-ai[local]" # FAISS, Ollama client, sentence-transformers
Python
Apache-2.0
2026-10-24
7Reactive Agentstylerjrbuell/reactive-agents-ts31
1 list
Claude / AnthropicMCPLocal / Ollama
Type-safe, observable TypeScript AI agent framework on Effect-TS; MCP-native, A2A multi-agent, 6 reasoning strategies, runs the same code on local Ollama 4B+ and frontier APIs
bunx create-reactive-agent my-app
TypeScript
MIT
2026-10-28
8Splaacp3249/splaa29
1 list
Local / Ollama
SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
pip install git+https://github.com/cp3249/splaa.git
Python
MIT
2025-05-06
9DuckyParthSareen/ducky27
1 list
Local / Ollama
Local AI pair programming tool
uv tool install rubber-ducky
Python
MIT
2026-02-04
10Nano-Bots-Apiicebaker/nano-bots-api19
1 list
Codex / OpenAIGemini / GoogleLocal / Ollama
HTTP API for Nano Bots - small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as…
git clone https://github.com/icebaker/nano-bots-api.git
Ruby
MIT
2024-06-23
11Kitebeevr-labs/Kite11
1 list
LangChain / LangGraphLocal / Ollama
Python framework for building AI agents with built-in safety guardrails, and a CLI that generates multi-agent scripts from natural language
pip install kite-agent
Python
MIT
2026-06-30
12selectoolsjohnnichev/selectools11
1 list
Claude / AnthropicCodex / OpenAIGemini / GoogleLocal / Ollama
Python agent framework for building composable AI applications with structured tool calling, HITL via generators, and 50+ built-in evaluators. Runs entirely in browser via visual builder at selectools.dev
pip install "selectools[rag]" # FAISS + Qdrant + beautifulsoup4 (HTML CSS selectors)
Python
Apache-2.0
2026-10-15
13Llm-Benchmarkswanzhenchn/llm-benchmarks5
1 list
Codex / OpenAILocal / Ollama
LLM benchmark tools for LMDeploy, vLLM, and TensorRT-LLM
git clone https://github.com/wanzhenchn/llm-benchmarks.git
Python
Apache-2.0
2026-04-13
14Modelreadysuparious/ModelReady4
1 list
Local / Ollama
Collection of tools for creating and running llama.cpp compatible LLMs
git clone https://github.com/suparious/ModelReady.git
Shell
GPL-3.0
2023-06-15
15Toolsbuildownai/tools1
1 list
Local / Ollama
Monorepository of LLM based t AI ools provided by BuildOwn.AI
git clone https://github.com/buildownai/tools.git
TypeScript
—
2024-10-29