Harnesses & Runtime Infra tools for LangChain / LangGraph

25 projects · 22 with stars to rank by · 82,329 combined stars · snapshot 2026-11-01

The scaffolding around the model rather than the model or the agent: runtimes, providers, gateways, fine-tuning, and what a harness runs on in production.

Built on LangChain, LangGraph or LangSmith.

Filter this live on the atlas →

Runs on: Windows WSL2 macOS Linux Docker

#ShotProject StarsPlugs into What it doesLang / licence / push
1LibreChatLibreChat-AI/LibreChat46,606
1 list
Claude / AnthropicMCPCodex / OpenAIGemini / GoogleLangChain / LangGraph
Self-hosted multi-model chat. All major providers
git clone https://github.com/danny-avila/LibreChat.git
TypeScript
MIT
2026-11-01
2AI GatewayPortkey-AI/gateway13,300
1 list
Codex / OpenAILangChain / LangGraph
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API
npx @portkey-ai/gateway
TypeScript
MIT
2026-05-25
3ipex-llmintel/ipex-llm8,845
1 list
LangChain / LangGraphLocal / Ollama
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc
git clone https://github.com/intel-analytics/ipex-llm.git
Python
Apache-2.0
2026-01-28
4ZenMLzenml-io/zenml5,633
2 lists
LangChain / LangGraph
Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations
pip install "zenml[server]" # pip install zenml will install a slimmer client
Python
Apache-2.0
2026-10-30
5Api-For-Open-Llmxusenlinzy/api-for-open-llm2,460
1 list
Codex / OpenAILangChain / LangGraph
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, X…
git clone https://github.com/xusenlinzy/api-for-open-llm.git
Python
Apache-2.0
2024-09-26
6langchain-servejina-ai/langchain-serve1,633
1 list
LangChain / LangGraph
Serverless LLM apps on Production with Jina AI Cloud *(Archived)
pip install langchain-serve
Python
Apache-2.0
2023-09-20
7Llm-Chainsobelio/llm-chain1,602
1 list
Codex / OpenAILangChain / LangGraph
llm-chain is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
git clone https://github.com/sobelio/llm-chain.git
Rust
MIT
2024-10-31
8Get-Things-Done-With-Prompt-Engineering-And-Langchaincuriousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain1,258
1 list
Codex / OpenAILangChain / LangGraph
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading a…
git clone https://github.com/curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain.git
Jupyter Notebook
Apache-2.0
2024-01-07
9Bentochainssheng/BentoChain194
1 list
LangChain / LangGraph
A voice-enabled chatbot application built using of 🦜️🔗 LangChain, text-to-speech, and speech-to-text models from 🤗 Hugging Face, and 🍱 Be…
git clone https://github.com/ssheng/BentoChain.git
Python
—
2023-11-13
10Llm-Api1b5d/llm-api169
1 list
Codex / OpenAILangChain / LangGraph
Run any Large Language Model behind a unified API
docker run -v $PWD/models/:/models:rw -v $PWD/config.yaml:/llm-api/config.yaml:ro -p 8000:8000 --ulimit memlock=16000000000 1b5d/llm-api
Python
MIT
2023-11-13
11Multi-Pdfs_Chatapp_Ai-AgentGURPREETKAURJETHRA/Multi-PDFs_ChatApp_AI-Agent138
1 list
Codex / OpenAIGemini / GoogleLangChain / LangGraph
Meet MultiPDF 📚 Chat AI App! 🚀 Chat seamlessly with Multiple PDFs using Langchain, Google Gemini Pro & FAISS Vector DB with Seamless Stre…
git clone https://github.com/GURPREETKAURJETHRA/Multi-PDFs_ChatApp_AI-Agent.git
Python
MIT
2024-04-23
12Langchain-Projects-Llmananthanarayanan431/Langchain-Projects-LLM120
1 list
Codex / OpenAILangChain / LangGraph
Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…
git clone https://github.com/ananthanarayanan431/Langchain-Projects-LLM.git
Jupyter Notebook
Unlicense
2026-10-25
13Langchain-Ollama-Chainlitsudarshan-koirala/langchain-ollama-chainlit84
1 list
LangChain / LangGraphLocal / Ollama
Simple Chat UI as well as chat with documents using LLMs with Ollama (mistral model) locally, LangChaiin and Chainlit
git clone https://github.com/sudarshan-koirala/langchain-ollama-chainlit.git
Python
MIT
2024-02-17
14Llm_Optimizesshh12/llm_optimize61
1 list
LangChain / LangGraph
LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization
pip install git+https://github.com/sshh12/llm_optimize
Python
MIT
2023-05-01
15gemini-openai-proxyBrioch/gemini-openai-proxy60
1 list
Codex / OpenAIGemini / GoogleLangChain / LangGraphLocal / Ollama
Universal compatibility layer serving Gemini 2.5 Pro/Flash through OpenAI protocol. Works instantly with existing tools like LangChain, llama.cpp, and VS Code extensions
docker run -p 11434:80 -e GEMINI_API_KEY gemini-openai-proxy
TypeScript
MIT
2025-08-07
16raphaelchristi/harness-evolverraphaelchristi/harness-evolver57
2 lists
Claude CodeClaude / AnthropicCodex / OpenAILangChain / LangGraph
March 2026 Claude Code plugin that autonomously evolves LLM agent harnesses using multi-agent proposers in isolated git worktrees, LangSmith-backed evaluation, and regression guards. Iterates on prompts, routing, retrieval, and orchestration code based on full-trace counterfactual diagnosis. The most practical published implementation of the Meta-Harness outer-loop optimization paradigm
npx harness-evolver@latest
Python
MIT
2026-04-18
17AinoteShengqinYang/AINote46
1 list
Codex / OpenAILangChain / LangGraph
I recently attended the Geekbang "Large Language Models Application Development Practice Camp", where I learned about the application dev…
git clone https://github.com/ShengqinYang/AINote.git
Jupyter Notebook
—
2024-08-23
18Superagent-Swift-Legacysimonweniger/superagent-swift-legacy30
1 list
Codex / OpenAILangChain / LangGraph
Build, deploy, and manage LLM-powered agents on  platforms
git clone https://github.com/simonweniger/superagent-swift-legacy.git
Swift
MIT
2023-09-22
19awaithumansawaithumans/awaithumans-human-in-the-loop-ai-agents27
1 list
LangChain / LangGraph
One-function HITL primitive for AI agents. await_human blocks like a Promise; a human reviews via Slack/email/dashboard; the agent resumes with the typed response. Durable across restarts via Stripe-style idempotency keys. Temporal + LangGraph adapters included
pip install "awaithumans[server]"
Python
Apache-2.0
2026-10-20
20Chamberlain_Multimodal_Multiagent_ChatbotnickShengY/chamberlain_multimodal_multiagent_chatbot3
1 list
Codex / OpenAILangChain / LangGraph
An AI-driven Multimodal multi-agent chatbot for home deployment to manage the user's daily chores and tasks. Used OpenAI and Langchain an…
git clone https://github.com/nickShengY/chamberlain_multimodal_multiagent_chatbot.git
Jupyter Notebook
CC0-1.0
2023-12-29
21Agentxsattyamjjain/AgentX2
1 list
Codex / OpenAILangChain / LangGraph
AgentX is a powerful AI-driven framework for building smart, context-aware assistants and automating workflows. With modular design, seam…
git clone https://github.com/sattyamjjain/AgentX.git
Python
—
2024-11-28
22Powerups.Aimuzetv/powerups.ai1
1 list
Codex / OpenAILangChain / LangGraph
Deploy AI Agent-Powered APIs in Minutes
git clone https://github.com/muzetv/powerups.ai.git
—
—
2023-09-12
23Ai-Agentkasragordini/AI-Agent—
1 list
LangChain / LangGraph
Designed and deployed a high-performance chatbot leveraging LangChain, Qdrant, LLM, and RAG to enhance data retrieval, AI knowledge base,…
git clone https://github.com/kasragordini/AI-Agent.git
Jupyter Notebook
—
2024-09-25
24Ai-AgentsBilalkhan4086/ai-agents—
1 list
LangChain / LangGraph
This repo is for learning how to deploy ai agent with langgraph on langgraph cloud
git clone https://github.com/Bilalkhan4086/ai-agents.git
Jupyter Notebook
—
2024-12-10
25Ghost-Agentqianyouliang/Ghost-Agent—
1 list
LangChain / LangGraph
The objective of this project is to develop an AI ghost deployed on the web, powered by LangChain technology. The AI ghost will continuou…
git clone https://github.com/qianyouliang/Ghost-Agent.git
—
MIT
2024-02-21