Opik

comet-ml/opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and optimization in one self-hostable stack rather than stitching together separate tools

Python Apache-2.0

View on GitHub → Find it in the atlas

Install

npx add-mcp https://www.comet.com/opik/api/v1/mcp --name opik-mcp

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for Opik
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsLikelyInferred from the language or runtime. Nothing in the project says so.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSLikelyInferred from the language or runtime. Nothing in the project says so.
LinuxLikelyInferred from the language or runtime. Nothing in the project says so.
DockerYesStated in the project's own README, install route, CI config or release assets.

Where it came from

Named by 4 of the 39 lists the atlas merges, independently of each other.

How it is classified

One topic, 3 harnesses. Each link is a prerendered page of everything else in that slice.

Observability & EvalsMCPCodex / OpenAILangChain / LangGraph

Related in Observability & Evals

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • EvalViewhidai25/eval-viewRegression testing for AI agents. Snapshot behavior, detect tool-call and output regressions, with golden-baseline diffing and LLM-as-judge scoring…
  • runtapeRehanMohammed985/runtapeFinds which part of an agent's context caused a bad decision by rerunning it with pieces removed, checks candidate fixes the same way, and writes a…
  • Langfuselangfuse/langfuseThe most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool…
  • Codeburngetagentseal/codeburnFree, local tool that tracks AI coding token usage and cost across 31 tools and agents by model, project, and task. Worth including because…
  • AgentOpsAgentOps-AI/agentopsOpen-source agent engineering platform (YC W24) with session replay, cost tracking, and failure detection across 10+ frameworks including CrewAI…
  • BitRouterbitrouter/bitrouterAgent-native LLM router that optimizes your agent with every run — zero harness changes, with every model call reliable, traceable, secure, and…
  • budget-guardkimbeomgyu/budget-guardZero-infra hard spending caps for LLM APIs — blocks before overspending (atomic reservation), per-feature cost attribution, streaming usage…
  • Claude Code Agent Monitorhoangsonww/Claude-Code-Agent-Monitorby hoangsonww - A self-hosted real-time dashboard that monitors Claude Code agent activity via its native hooks — live sessions, subagent…