Llm-Benchmarks

wanzhenchn/llm-benchmarks

LLM benchmark tools for LMDeploy, vLLM, and TensorRT-LLM

Python Apache-2.0

View on GitHub → Find it in the atlas

Install

git clone https://github.com/wanzhenchn/llm-benchmarks.git

Repository reader

Explore before you clone

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub
Open on GitHub
Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Screenshot

Screenshot or social card for Llm-Benchmarks
GitHub's social card — no screenshot was found for this project, fetched from source rather than copied into this repository.

Platform support

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
PlatformRuns hereOn what evidence
WindowsNoNo evidence of support anywhere in the project.
WSL2YesStated in the project's own README, install route, CI config or release assets.
macOSNoNo evidence of support anywhere in the project.
LinuxYesStated in the project's own README, install route, CI config or release assets.
DockerYesStated in the project's own README, install route, CI config or release assets.

Where it came from

Named by 1 of the 39 lists the atlas merges.

  • AI Agents (Schwoebel)

How it is classified

One topic, 2 harnesses. Each link is a prerendered page of everything else in that slice.

Frameworks & SDKsCodex / OpenAILocal / Ollama

Related in Frameworks & SDKs

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

  • Strands Agents SDKstrands-agents/harness-sdkAWS's open-source, model-driven agent SDK that treats the loop, tool binding, and guardrails as first-class primitives. Supports Bedrock, Anthropic…
  • escapeboy/agent-fleet-oescapeboy/agent-fleet-oSelf-hosted mission control for AI agents: manage agents, experiments, workflows, crews, skills and more
  • Nano-Bots-Apiicebaker/nano-bots-apiHTTP API for Nano Bots - small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as…
  • selectoolsjohnnichev/selectoolsPython agent framework for building composable AI applications with structured tool calling, HITL via generators, and 50+ built-in evaluators. Runs…
  • Widemem-Airemete618/widemem-aiLightweight Python memory layer for LLM agents with importance scoring, temporal decay, 3-tier hierarchical memory, YMYL prioritization, and batch…
  • Autogenmicrosoft/autogenMicrosoft's multi-agent conversation framework with a complete AgentChat layer covering agent loop, tool integration, termination conditions, and…
  • mem0mem0ai/mem0Mem0 is an intelligent memory layer for Large Language Models that enhances personalized AI experiences by retaining and utilizing contextual…
  • LangChainlangchain-ai/langchainLangchain integrates various providers like Anthropic, AWS, and OpenAI, and offers tools for components such as LLMs, chat models, and data…