工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

122

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Turn one decision into a judged tournament of solutions, then pick the best — a Claude Code skill that generates candidates, auto-derives the rubric, judges independently, and returns a defensible winner.

    JavaScript许可证: MIT
    • ai-agents
    • anthropic
    • claude-code
    • claude-code-plugin
    • claude-skill

    github实测增长打开来源 ↗

    安装 /plugin marketplace add CoriChui/bakeoff

    10GitHub 星标稳定
  2. 2

    MCP
    活跃

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    TypeScript许可证: Apache-2.0
    • agent-management
    • agent-ops
    • agent-orchestration
    • ai-agent-platform
    • ai-agents

    github实测增长打开来源 ↗

    50GitHub 星标+1 (+2.0 %)
  3. 3

    技能
    活跃

    Skill instalable para Claude Code que mide si tu agente cumple las reglas establecidas. Lee el historial de sesiones de tu disco y devuelve un porcentaje por regla de cumplimiento. Sin instalar nada, sin red, biblioteca estándar.

    Python许可证: MIT
    • ai-evaluation
    • claude
    • claude-code
    • claude-code-plugin
    • claude-code-skill

    github实测增长打开来源 ↗

    安装 /plugin marketplace add jleonceo/skill-adherencia-reglas

    1GitHub 星标稳定
  4. 4

    技能
    休眠

    An assembly line for AI software development. 35 skills, 11 agent personas, 29 commands. From raw idea to shipped code.

    Shell许可证: MIT
    • agentic-engineering
    • agents
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    github实测增长打开来源 ↗

    安装 /plugin marketplace add aneja5/forge-skills

    3GitHub 星标稳定
  5. 5

    技能
    活跃

    Audit which Claude Code skills you actually use — surface dead installs and hallucinated invocations from your session logs.

    TypeScript许可证: MIT
    • anthropic
    • audit
    • claude
    • claude-code
    • claude-code-plugin

    github实测增长打开来源 ↗

    安装 /plugin marketplace add sfrangulov/skill-graveyard

    10GitHub 星标稳定
  6. 6

    智能体
    休眠

    A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

    Python
    • a2a
    • agent-to-agent
    • ai-agents
    • conversational-ai
    • llm-evaluation

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  7. 7

    技能
    活跃

    Production-grade AI coding rules for Cursor and Claude Code. 15 rules + 9 doc templates + skills + agents + MCP setup. Drop into any project.

    Python许可证: MIT
    • ai-agents
    • ai-coding
    • ai-development
    • ai-engineer
    • automation

    github实测增长打开来源 ↗

    安装 git clone https://github.com/aiagentwithdhruv/ai-dev-stack ~/.claude/skills/ai-dev-stack

    10GitHub 星标稳定
  8. 8

    智能体
    活跃

    Agent 降智检测与自愈公评网络 — an immune system for the AI agent society

    TypeScript许可证: MIT
    • a2a
    • agent
    • agent-guard
    • ai-sre
    • drift-detection

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  9. 9

    其他
    活跃

    A Go-native framework for LLM agents, with OpenTelemetry observability built in.

    Go许可证: Apache-2.0
    • a2a
    • agents
    • ai
    • anthropic
    • bedrock

    github实测增长打开来源 ↗

    10GitHub 星标稳定
  10. 10

    MCP
    休眠

    Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability

    Python许可证: MIT
    • a2a
    • a2a-client
    • a2a-server
    • agent-evaluation
    • agentic-ai

    github实测增长打开来源 ↗

    5GitHub 星标稳定
  11. 11

    智能体
    活跃

    Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

    TypeScript许可证: Apache-2.0
    • a2a
    • agent-evaluation
    • ai-agents
    • benchmark
    • deterministic-replay

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  12. 12

    智能体
    活跃

    Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

    TypeScript许可证: MIT
    • agent2agent
    • ai-agents
    • cordis
    • deepseek-harness
    • dsh

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  13. 13

    技能
    活跃

    Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

    • agentic-coding
    • agentic-workflow
    • ai-agent-skills
    • ai-code-review
    • ai-workflows

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

    2GitHub 星标稳定
  14. 14

    智能体
    活跃

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    Python许可证: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  15. 15

    其他
    活跃

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    Python
    • a2a
    • agent-runtime
    • ai-infra
    • deepseek
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  16. 16

    智能体
    活跃

    Multi-agent SRE on-call investigator that auto-triages Slack/Discord infrastructure alerts via AWS Bedrock AgentCore, fanning out to specialized agents (CloudWatch, EKS, Slack/Discord scanners) for parallel investigation.

    Python
    • a2a-protocol
    • anthropic
    • aws-bedrock
    • aws-lambda
    • bedrock-agentcore

    github实测增长打开来源 ↗

    3GitHub 星标稳定
  17. 17

    MCP
    活跃

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    ↓ 32 下载/周TypeScript许可证: MIT

      mcp实测增长打开来源 ↗

      安装 claude mcp add mcp-server -- npx @spanlens/mcp-server

      12GitHub 星标稳定
    • 18

      MCP
      活跃

      Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

      Python许可证: MIT

        mcp实测增长打开来源 ↗

        安装 claude mcp add ai-guardian -- uvx ai-guardian-aiops

        0GitHub 星标稳定
      • 19

        智能体
        活跃

        A lightweight Python library that decouples agentic runtime from applications it builds

        Python许可证: MIT
        • a2a
        • agent-runtime
        • agents
        • observability
        • portability

        github实测增长打开来源 ↗

        1GitHub 星标稳定
      • 20

        智能体
        活跃

        Amazon Bedrock AgentCore enterprise platform accelerator with AWS CDK, Terraform organization guardrails, MCP/A2A agents, security, memory, and observability.

        Python许可证: Apache-2.0
        • a2a-protocol
        • agentcore
        • agentcore-agent
        • agentcore-gateway
        • agentcore-identity

        github实测增长打开来源 ↗

        6GitHub 星标+1 (+20.0 %)
      • 21

        技能
        活跃

        Claude Code plugin marketplace — agentic-engineering (spec-driven shape→decide→execute→measure→eval with adversarial review) + github-keeper (audit/elevate READMEs and make a repo open-source-ready).

        Python许可证: MIT
        • adr
        • agentic-engineering
        • ai-agents
        • anthropic
        • claude-code

        github实测增长打开来源 ↗

        安装 /plugin marketplace add GiustoPiedimonte/agentic-engineering-marketplace

        13GitHub 星标稳定
      • 22

        技能
        活跃

        Measure prompt and skill improvements with blind A/B comparison.

        Python许可证: MIT
        • agent-skills
        • ai-tools
        • claude-code
        • claude-code-plugin
        • claude-code-skill

        github实测增长打开来源 ↗

        安装 /plugin marketplace add shinpr/rashomon

        18GitHub 星标稳定
      • 23

        其他
        活跃

        Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

        TypeScript
        • ai-agents
        • claude-code
        • claude-code-skills
        • cli
        • evals

        github实测增长打开来源 ↗

        1GitHub 星标稳定
      • 24

        智能体
        休眠

        The reliability and interoperability layer for AI agents. A2A-native. MCP-bridged.

        Python许可证: Apache-2.0
        • a2a
        • agent-framework
        • agents
        • ai
        • ai-safety

        github实测增长打开来源 ↗

        1GitHub 星标稳定
      • 25

        MCP
        活跃

        A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

        Shell
        • a2a
        • agent-framework
        • agentic-ai
        • ai
        • ai-agents

        github实测增长打开来源 ↗

        2GitHub 星标稳定