工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

122

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Python许可证: Apache-2.0
    • agent-evaluation
    • agent-security
    • agent-skills
    • agentic-ai
    • benchmark

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    404GitHub 星标+53 (+15.1 %)
  2. 2

    技能
    活跃

    Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

    • agentic-coding
    • agentic-workflow
    • ai-agent-skills
    • ai-code-review
    • ai-workflows

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

    2GitHub 星标稳定
  3. 3

    智能体
    活跃

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    Python许可证: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  4. 4

    其他
    活跃

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    Python
    • a2a
    • agent-runtime
    • ai-infra
    • deepseek
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  5. 5

    智能体
    活跃

    Multi-agent SRE on-call investigator that auto-triages Slack/Discord infrastructure alerts via AWS Bedrock AgentCore, fanning out to specialized agents (CloudWatch, EKS, Slack/Discord scanners) for parallel investigation.

    Python
    • a2a-protocol
    • anthropic
    • aws-bedrock
    • aws-lambda
    • bedrock-agentcore

    github实测增长打开来源 ↗

    3GitHub 星标稳定
  6. 6

    MCP
    活跃

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    Python许可证: MIT

      mcp实测增长打开来源 ↗

      安装 claude mcp add ai-guardian -- uvx ai-guardian-aiops

      0GitHub 星标稳定
    • 7

      智能体
      活跃

      A lightweight Python library that decouples agentic runtime from applications it builds

      Python许可证: MIT
      • a2a
      • agent-runtime
      • agents
      • observability
      • portability

      github实测增长打开来源 ↗

      1GitHub 星标稳定
    • 8

      智能体
      活跃

      Amazon Bedrock AgentCore enterprise platform accelerator with AWS CDK, Terraform organization guardrails, MCP/A2A agents, security, memory, and observability.

      Python许可证: Apache-2.0
      • a2a-protocol
      • agentcore
      • agentcore-agent
      • agentcore-gateway
      • agentcore-identity

      github实测增长打开来源 ↗

      6GitHub 星标+1 (+20.0 %)
    • 9

      技能
      活跃

      Claude Code plugin marketplace — agentic-engineering (spec-driven shape→decide→execute→measure→eval with adversarial review) + github-keeper (audit/elevate READMEs and make a repo open-source-ready).

      Python许可证: MIT
      • adr
      • agentic-engineering
      • ai-agents
      • anthropic
      • claude-code

      github实测增长打开来源 ↗

      安装 /plugin marketplace add GiustoPiedimonte/agentic-engineering-marketplace

      13GitHub 星标稳定
    • 10

      MCP
      活跃

      Self improving agents through iterations

      Python许可证: Apache-2.0
      • agent-learning
      • agent-memory
      • agentic-workflows
      • ai-agents
      • claude-code

      github实测增长打开来源 ↗

      104GitHub 星标稳定
    • 11

      技能
      活跃

      Measure prompt and skill improvements with blind A/B comparison.

      Python许可证: MIT
      • agent-skills
      • ai-tools
      • claude-code
      • claude-code-plugin
      • claude-code-skill

      github实测增长打开来源 ↗

      安装 /plugin marketplace add shinpr/rashomon

      18GitHub 星标稳定
    • 12

      其他
      活跃

      Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

      TypeScript
      • ai-agents
      • claude-code
      • claude-code-skills
      • cli
      • evals

      github实测增长打开来源 ↗

      1GitHub 星标稳定
    • 13

      智能体
      休眠

      The reliability and interoperability layer for AI agents. A2A-native. MCP-bridged.

      Python许可证: Apache-2.0
      • a2a
      • agent-framework
      • agents
      • ai
      • ai-safety

      github实测增长打开来源 ↗

      1GitHub 星标稳定
    • 14

      MCP
      活跃

      A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

      Shell
      • a2a
      • agent-framework
      • agentic-ai
      • ai
      • ai-agents

      github实测增长打开来源 ↗

      2GitHub 星标稳定
    • 15

      技能
      活跃

      Research-backed, eval-driven skills for AI agents

      Python许可证: Apache-2.0
      • agent-skills
      • ai-agents
      • codex
      • design
      • evals

      github实测增长打开来源 ↗

      安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills

      145GitHub 星标+9 (+6.6 %)
    • 16

      技能
      活跃

      🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

      MDX许可证: MIT
      • agent-skills
      • agents
      • genai
      • hacktoberfest
      • langfuse

      github实测增长打开来源 ↗

      安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

      240GitHub 星标+4 (+1.7 %)
    • 17

      其他
      休眠

      A Claude Code skill that adds a rubric-based eval layer to any agent project. Framework-agnostic — generates rubric, test cases, judge prompt, and harness. Returns a weighted score plus a judge-leniency signal.

      HTML
      • agent-evaluation
      • anthropic
      • claude-code
      • claude-code-skill
      • evals

      github实测增长打开来源 ↗

      13GitHub 星标稳定
    • 18

      智能体
      活跃

      Local-first control plane for durable, governed agent teams: DAG orchestration, approvals, memory, signed skills, trace contracts, and realtime.

      Python许可证: Apache-2.0
      • a2a-protocol
      • agentic-ai
      • ai-agents
      • fastapi
      • llmops

      github实测增长打开来源 ↗

      0GitHub 星标稳定
    • 19

      技能
      活跃

      Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

      JavaScript许可证: Apache-2.0
      • agent-skills
      • ai-agents
      • claude-code
      • devops
      • dql

      github实测增长打开来源 ↗

      安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

      135GitHub 星标+4 (+3.1 %)
    • 20

      智能体
      活跃

      MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

      TypeScript
      • a2a
      • agent-governance
      • agent-memory
      • agent-orchestration
      • agent-workflows

      github实测增长打开来源 ↗

      7GitHub 星标稳定
    • 21

      其他
      活跃

      🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

      Python许可证: MIT
      • a2a-protocol
      • agent-framework
      • ai
      • causal-memory
      • event-stream

      github实测增长打开来源 ↗

      0GitHub 星标稳定
    • 22

      其他
      活跃

      A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

      Go许可证: Apache-2.0
      • a2a
      • agents
      • ai
      • containerized
      • docker

      github实测增长打开来源 ↗

      14GitHub 星标+1 (+7.7 %)
    • 23

      技能
      活跃

      Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

      Python许可证: Apache-2.0
      • agent-memory
      • agent-skills
      • ai-agents
      • benchmark
      • dataset

      github实测增长打开来源 ↗

      安装 git clone https://github.com/EverMind-AI/SkillCorpus ~/.claude/skills/SkillCorpus

      525GitHub 星标+199 (+61.0 %)
    • 24

      MCP
      活跃

      74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

      JavaScript许可证: MIT
      • agent-orchestration
      • agent-skill
      • agent-skills
      • ai-agents
      • ai-coding

      github实测增长打开来源 ↗

      129GitHub 星标-4 (-3.0 %)
    • 25

      技能
      活跃

      Make Claude write clearly, for everyone.

      Python许可证: 0BSD
      • claude-code
      • claude-code-plugin
      • controlled-language
      • llm-evaluation
      • output-style

      github实测增长打开来源 ↗

      安装 /plugin marketplace add stefanobaghino/simple-output-styles

      16GitHub 星标稳定