Observability & Evals tools for GitHub Copilot

11 projects · 11 with stars to rank by · 22,068 combined stars · snapshot 2026-11-01

Traces, benchmarks, graders, linting and CI feedback: how you find out whether the agent actually did the thing.

Targets Copilot: its coding agent, its CLI, or its extension surface.

Filter this live on the atlas →

Runs on: Windows WSL2 macOS Linux Docker

#ShotProject StarsPlugs into What it doesLang / licence / push
1Clawd on Deskrullerzhou-afk/clawd-on-desk6,610
2 lists
Claude CodeClaude / AnthropicCodex / OpenAIGemini / GoogleGitHub CopilotCursor
by Ruller_Lulu - A desktop pet that reacts to your Claude Code sessions in real-time — thinking, typing, juggling, sleeping, and more. Yep. It's undeniably endearing. And at the end of the day, isn't that what Claude Code is all about?
brew install --cask clawd-on-desk
JavaScript
AGPL-3.0
2026-11-01
2LangWatchlangwatch/langwatch5,003
1 list
Claude / AnthropicopencodeCodex / OpenAIGitHub Copilot
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy
npx langwatch claude # or codex, copilot, opencode, ...
TypeScript
Apache-2.0
2026-11-01
3openusagerobinebers/openusage4,503
1 list
Claude CodeClaude / AnthropicCodex / OpenAIGitHub CopilotCursor
(4.4k ⭐) - macOS menu bar app for tracking Claude, Codex, and other AI coding subscriptions, with usage limits, reset times, credits, and spend
brew install --cask openusage
Swift
MIT
2026-11-01
4Better HarnessQoderAI/better-harness2,427
2 lists
Claude CodeClaude / AnthropicCodex / OpenAIGitHub CopilotCursor
Evaluates coding-agent workflows across five dimensions and turns project and session evidence into prioritized, evidence-bounded findings with scoped repair actions. Runs inside Claude Code, Codex, Cursor, GitHub Copilot, and other hosts, making it a practical cross-tool diagnostic layer for improving the harness rather than just reviewing the final diff
git clone https://github.com/QoderAI/better-harness.git
JavaScript
MIT
2026-10-20
5ClaudeBartddworks/ClaudeBar1,565
1 list
Claude CodeClaude / AnthropicCodex / OpenAIGemini / GoogleGitHub Copilot
by tddworks - A macOS menu-bar app that surfaces remaining usage quota for Claude, Codex, Gemini, Copilot, and other AI coding providers at a glance, with burn-rate, dollar-balance, and reset-countdown indicators plus a lightweight live-session indicator. Swift 6 with a layered Domain/Infrastructure architecture
brew install --cask claudebar
Swift
Apache-2.0
2026-11-01
6onWatchonllm-dev/onWatch769
4 lists
Claude CodeClaude / AnthropicCodex / OpenAIGemini / GoogleGitHub CopilotCursorCline / Roo
Open-source Go CLI that tracks AI API quota usage across 7 providers (Anthropic, OpenAI, GitHub Copilot, MiniMax, and more). Works with Claude Code, Codex CLI, Cursor, Cline, and other vibe coding tools. Background daemon, <50MB RAM, zero telemetry
irm https://raw.githubusercontent.com/onllm-dev/onwatch/main/install.ps1 | iex
Go
GPL-3.0
2026-10-23
7agentlyticsf/agentlytics593
1 list
Claude CodeClaude / AnthropicopencodeGemini / GoogleGitHub CopilotCursor
(537 ⭐) - Analytics dashboard for AI coding agents including Claude Code, Cursor, Windsurf, VS Code Copilot, Zed, Antigravity, OpenCode, and Command Code
npx agentlytics
JavaScript
—
2026-08-03
8Kane CLILambdaTest/kane-cli259
1 list
Claude CodeClaude / AnthropicGitHub CopilotCursor
Open-source AI test agent CLI by TestMu AI that turns requirements into end-to-end tests and runs them on desktop web, Android and iOS, with every test linked to the acceptance criteria it covers
npm install -g @testmuai/kane-cli
JavaScript
Apache-2.0
2026-10-29
9BitRouterbitrouter/bitrouter236
1 list
Claude / AnthropicMCPCodex / OpenAIGitHub Copilot
Agent-native LLM router that optimizes your agent with every run — zero harness changes, with every model call reliable, traceable, secure, and cost-effective. Routes across OpenAI, Anthropic, Google, OpenRouter, Bedrock, GitHub Copilot, and more through one local endpoint, with cross-protocol translation, an MCP gateway, guardrails, observability, and multi-account failover. Written in Rust
npm install -g bitrouter
Rust
Apache-2.0
2026-11-01
10Code Insightsmelagiri/code-insights79
2 lists
Claude CodeClaude / AnthropicCodex / OpenAIGitHub CopilotCursor
Local-first CLI and dashboard for analyzing AI coding sessions from Claude Code, Cursor, Codex CLI, Copilot CLI, and VS Code Copilot Chat. SQLite-backed with terminal analytics, browser dashboard, and LLM-powered insights
npm install -g @code-insights/cli
TypeScript
MIT
2026-06-01
11agents-md-cookbookTaiizor/agents-md-cookbook24
2 lists
Claude CodeClaude / AnthropicGitHub CopilotCursorCline / RooAider
Tool-agnostic AGENTS.md authoring kit (MIT) with 15 stack-specific templates, a tool compatibility matrix, an npm CLI + GitHub Action linter (agents-md-lint), and a migrator (agents-md-migrate) that converts .cursorrules, CLAUDE.md, Copilot, Windsurf, Cline, and Aider configs to AGENTS.md. Works across Cursor, Claude Code, Copilot, and 30+ AI coding tools. Free and open source
bunx agents-md-migrate # or: npx agents-md-migrate
TypeScript
MIT
2026-08-08