工具说明为英文。
LLM 可观测性
LLM 应用的监控、追踪、评估和质量管理。
用途
活跃度
排序方式
121
工具排名
按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。
- 13GitHub 星标稳定
- 2活跃
Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.
github实测增长打开来源 ↗
0GitHub 星标稳定 - 3活跃
AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.
github实测增长打开来源 ↗
68GitHub 星标稳定 - 4活跃
AI Guardian
MCPGoverned local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.
mcp实测增长打开来源 ↗
安装
claude mcp add ai-guardian -- uvx ai-guardian-aiops0GitHub 星标稳定 - 5休眠
A self-improving harness router for Claude Code.
github实测增长打开来源 ↗
安装
/plugin marketplace add SeongwoongCho/adaptive-harness8GitHub 星标稳定 - 6休眠
Multi-agent customer support system with Google ADK & Gemini 2.5 Flash Lite. Kaggle capstone demonstrating 11+ concepts. Automates 80%+ queries, <10s response time.
github实测增长打开来源 ↗
2GitHub 星标稳定 - 7活跃
memroos
智能体MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.
github实测增长打开来源 ↗
7GitHub 星标稳定 - 8活跃
a2a-otel-kit
MCPVendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.
github实测增长打开来源 ↗
1GitHub 星标稳定 - 9活跃
tulip-agents
智能体The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…
github实测增长打开来源 ↗
1GitHub 星标稳定 - 10休眠
agentanvil
智能体Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.
github实测增长打开来源 ↗
0GitHub 星标稳定 - 11活跃
The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
github实测增长打开来源 ↗
安装
git clone https://github.com/kubesphere/kubesphere ~/.claude/skills/kubesphere17 035GitHub 星标稳定 - 12活跃
Real-time execution trace and cost intelligence for Claude Code
github实测增长打开来源 ↗
安装
/plugin marketplace add DeibyGS/claudestat34GitHub 星标稳定 - 13活跃
pyxen
智能体A lightweight Python library that decouples agentic runtime from applications it builds
github实测增长打开来源 ↗
1GitHub 星标稳定 - 14活跃
green-agent
智能体A2A green-agent orchestrator for evaluating agents on the AppWorld benchmark, built on the AgentBeats SDK
github实测增长打开来源 ↗
0GitHub 星标稳定 - 15休眠
A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.
github实测增长打开来源 ↗
0GitHub 星标稳定 - 16休眠
🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.
github实测增长打开来源 ↗
安装
git clone https://github.com/OthmanAdi/langsmith-fetch-skill ~/.claude/skills/langsmith-fetch-skill27GitHub 星标稳定 - 17活跃
🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world
github实测增长打开来源 ↗
0GitHub 星标稳定 - 18休眠
astragraph
智能体Policy-enforced observability and fail-closed guardrails for MCP/A2A multi-agent systems.
github实测增长打开来源 ↗
26GitHub 星标稳定 - 19活跃
Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.
github实测增长打开来源 ↗
1GitHub 星标稳定 - 20休眠
kiboserve
MCPOpen-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability
github实测增长打开来源 ↗
5GitHub 星标稳定 - 21活跃
bakeoff
技能Turn one decision into a judged tournament of solutions, then pick the best — a Claude Code skill that generates candidates, auto-derives the rubric, judges independently, and returns a defensible winner.
github实测增长打开来源 ↗
安装
/plugin marketplace add CoriChui/bakeoff10GitHub 星标稳定 - 22活跃
Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.
github实测增长打开来源 ↗
1GitHub 星标稳定 - 23活跃
Sentry instrumentation skill for system-behavior tracking
github实测增长打开来源 ↗
安装
git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation24GitHub 星标稳定 - 24活跃
langfuse-mcp
MCPA Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability
github实测增长打开来源 ↗
105GitHub 星标稳定 - 25休眠
Agents-eval
智能体A Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.
github实测增长打开来源 ↗
2GitHub 星标稳定