工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

123

工具排名

按实测增长排序,并在不同来源间归一化。 原始值保留各自的数据窗口;计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/EverMind-AI/SkillCorpus ~/.claude/skills/SkillCorpus

    360GitHub 星标+168 (+87.5 %)
  2. 2
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    363GitHub 星标+58 (+19.0 %)
  3. 3

    技能
    活跃

    Research-backed, eval-driven skills for AI agents

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills

    138GitHub 星标+21 (+17.9 %)
  4. 4

    智能体
    活跃

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    github实测增长打开来源 ↗

    146GitHub 星标+13 (+9.8 %)
  5. 5
    活跃

    Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

    github实测增长打开来源 ↗

    安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

    72GitHub 星标+4 (+5.9 %)
  6. 6
    活跃

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    131GitHub 星标+5 (+4.0 %)
  7. 7

    智能体
    活跃

    DataBuff is an AI-native APM built on Opentelemetry,with multi-agent troubleshooting out of the box.

    github实测增长打开来源 ↗

    627GitHub 星标+22 (+3.6 %)
  8. 8
    活跃

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    96GitHub 星标+3 (+3.2 %)
  9. 9
    活跃

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 565GitHub 星标+58 (+2.3 %)
  10. 10
    活跃

    A test runner for agentskills.io-style AI agent skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/darkrishabh/agent-skills-eval ~/.claude/skills/agent-skills-eval

    713GitHub 星标+12 (+1.7 %)
  11. 11

    技能
    活跃

    local-first analytics for AI agent skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub 星标+1 (+1.3 %)
  12. 12
    活跃

    MCP server for Langfuse LLM observability — trace and observation analysis.

    mcp实测增长打开来源 ↗

    安装 claude mcp add langfuse -- npx langfuse-observability-mcp-server

    78GitHub 星标+1 (+1.3 %)
  13. 13
    活跃

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    github实测增长打开来源 ↗

    1 752GitHub 星标+22 (+1.3 %)
  14. 14
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 358GitHub 星标+29 (+1.2 %)
  15. 15

    技能
    活跃

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Sahir619/fable-method ~/.claude/skills/fable-method

    2 269GitHub 星标+22 (+0.98 %)
  16. 16
    活跃

    Self improving agents through iterations

    github实测增长打开来源 ↗

    105GitHub 星标+1 (+0.96 %)
  17. 17

    技能
    活跃

    OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

    github实测增长打开来源 ↗

    安装 git clone https://github.com/agentscope-ai/OpenJudge ~/.claude/skills/OpenJudge

    807GitHub 星标+7 (+0.88 %)
  18. 18

    技能
    活跃

    🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

    github实测增长打开来源 ↗

    安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

    237GitHub 星标+2 (+0.85 %)
  19. 19

    MCP
    活跃

    AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure.

    github实测增长打开来源 ↗

    258GitHub 星标+2 (+0.78 %)
  20. 20
    活跃

    Dashboard for monitoring claude code sessions.

    github实测增长打开来源 ↗

    安装 /plugin marketplace add JayantDevkar/claude-code-karma

    321GitHub 星标+2 (+0.63 %)
  21. 21

    技能
    活跃

    A skill creator that proves its skills work. Evidence-driven skill creation for Claude Code and Codex: baseline-tested generation, per-skill regression evals, ecosystem doctor, cross-runtime compile, and an opt-in proactive advisor.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/tripleyak/SkillForge ~/.claude/skills/SkillForge

    884GitHub 星标+5 (+0.57 %)
  22. 22

    其他
    活跃

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

    github实测增长打开来源 ↗

    24 710GitHub 星标+137 (+0.56 %)
  23. 23

    其他
    活跃

    Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

    github实测增长打开来源 ↗

    21 594GitHub 星标+119 (+0.55 %)
  24. 24

    其他
    活跃

    the LLM vulnerability scanner

    github实测增长打开来源 ↗

    9 079GitHub 星标+46 (+0.51 %)

学习与参考资源

按实测增长排序,并在不同来源间归一化。 这些资源可单独访问,不参与主要排名。

  1. 1
    活跃打开来源 ↗

    Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.

    github资源实测增长
    77GitHub 星标+1 (+1.3 %)