ai-evaluation (future-agi/agent-learning-kit) — Observability & Evals

Install

git clone https://github.com/future-agi/agent-learning-kit

Repository reader

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub

Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
Platform	Runs here	On what evidence
Windows	Likely	Inferred from the language or runtime. Nothing in the project says so.
WSL2	Likely	Inferred from the language or runtime. Nothing in the project says so.
macOS	Likely	Inferred from the language or runtime. Nothing in the project says so.
Linux	Likely	Inferred from the language or runtime. Nothing in the project says so.
Docker	No	No evidence of support anywhere in the project.

Named by 1 of the 39 lists the atlas merges.

One topic, no harnesses. Each link is a prerendered page of everything else in that slice.

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

Arize-PhoenixArize-ai/phoenixSelf-hostable trace UI and eval runtime for agent workflows. Lets harness engineers audit and replay every reasoning step and tool call offline…
AgentBenchTHUDM/AgentBenchMulti-environment agent benchmark (OS, DB, web, code) with a structured eval pipeline. Worth studying for its environment isolation design and task…
Langfuselangfuse/langfuseThe most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool…
ClawMetryvivekchand/clawmetrySelf-hosted, local-first observability and kill switch for coding agents, reading Gemini CLI sessions alongside Claude Code, Codex, Cursor…
Future AGIfuture-agi/future-agiOpen-source, self-hostable platform unifying tracing, evals, simulations, guardrails, and gateway into a single feedback loop. Worth including…
promptfoopromptfoo/promptfooYAML-driven LLM testing framework with LLM-as-judge, assertion DSL, and native CI integration. The most practical tool for adding agent output…
ccusageccusage/ccusageby ryoppippi - A zero-install CLI (npx ccusage) that analyzes Claude Code token usage and cost from local JSONL logs — daily, monthly, per-session…
Codeburngetagentseal/codeburnFree, local tool that tracks AI coding token usage and cost across 31 tools and agents by model, project, and task. Worth including because…