phoenix2pytest

golikovichev/phoenix2pytest

Reads Arize Phoenix traces flagged as failures and synthesises pytest regression tests, so production-discovered LLM failures feed back into the test suite without manual translation

Python MIT

View on GitHub → Find it in the atlas

Install

git clone https://github.com/golikovichev/phoenix2pytest

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for phoenix2pytest
The project's own screenshot, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsLikelyInferred from the language or runtime. Nothing in the project says so.
WSL2LikelyInferred from the language or runtime. Nothing in the project says so.
macOSLikelyInferred from the language or runtime. Nothing in the project says so.
LinuxLikelyInferred from the language or runtime. Nothing in the project says so.
DockerNoNo evidence of support anywhere in the project.

Where it came from

Named by 1 of the 39 lists the atlas merges.

  • LLMOps (tensorchord)

How it is classified

One topic, 1 harness. Each link is a prerendered page of everything else in that slice.

Observability & EvalsGemini / Google

Related in Observability & Evals

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • ClawMetryvivekchand/clawmetrySelf-hosted, local-first observability and kill switch for coding agents, reading Gemini CLI sessions alongside Claude Code, Codex, Cursor…
  • promptfoopromptfoo/promptfooYAML-driven LLM testing framework with LLM-as-judge, assertion DSL, and native CI integration. The most practical tool for adding agent output…
  • Codeburngetagentseal/codeburnFree, local tool that tracks AI coding token usage and cost across 31 tools and agents by model, project, and task. Worth including because…
  • onWatchonllm-dev/onWatchOpen-source Go CLI that tracks AI API quota usage across 7 providers (Anthropic, OpenAI, GitHub Copilot, MiniMax, and more). Works with Claude Code…
  • Tokscalejunhoyeo/tokscaleCLI tool for tracking token usage from AI coding agents (OpenCode, Claude Code, OpenClaw, Codex, Gemini CLI, Cursor IDE, AmpCode, Factory Droid)…
  • Clawd on Deskrullerzhou-afk/clawd-on-deskby Ruller_Lulu - A desktop pet that reacts to your Claude Code sessions in real-time — thinking, typing, juggling, sleeping, and more. Yep. It's…
  • CodexBarsteipete/CodexBarmacOS menu bar app showing usage stats for Codex, Claude, Cursor, Gemini without login. On-device parsing
  • agentlyticsf/agentlytics(537 ⭐) - Analytics dashboard for AI coding agents including Claude Code, Cursor, Windsurf, VS Code Copilot, Zed, Antigravity, OpenCode, and Command…