工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

75

工具排名

按实测增长排序,并在不同来源间归一化。 原始值保留各自的数据窗口;计算变化需要 7 天内至少两次测量。

  1. 1
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 367GitHub 星标+15 (+0.64 %)
  2. 2
    活跃

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    135GitHub 星标+4 (+3.1 %)
  3. 3

    其他
    活跃

    A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

    github实测增长打开来源 ↗

    14GitHub 星标+1 (+7.7 %)
  4. 4

    技能
    活跃

    🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

    github实测增长打开来源 ↗

    安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

    240GitHub 星标+4 (+1.7 %)
  5. 5
    活跃

    Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

    github实测增长打开来源 ↗

    安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

    73GitHub 星标+2 (+2.8 %)
  6. 6
    活跃

    MCP server for Langfuse LLM observability — trace and observation analysis.

    mcp实测增长打开来源 ↗

    安装 claude mcp add langfuse -- npx langfuse-observability-mcp-server

    80GitHub 星标+2 (+2.6 %)
  7. 7

    智能体
    活跃

    eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

    github实测增长打开来源 ↗

    12 068GitHub 星标+7 (+0.06 %)
  8. 8
    活跃

    Dashboard for monitoring claude code sessions.

    github实测增长打开来源 ↗

    安装 /plugin marketplace add JayantDevkar/claude-code-karma

    324GitHub 星标+3 (+0.93 %)
  9. 9

    MCP
    活跃

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    github实测增长打开来源 ↗

    50GitHub 星标+1 (+2.0 %)
  10. 10

    技能
    活跃

    local-first analytics for AI agent skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub 星标+1 (+1.3 %)
  11. 11
    活跃

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub 星标+1 (+1.0 %)
  12. 12

    其他
    活跃

    AI SRE AgenticOps for Kubernetes and cloud infrastructure.

    github实测增长打开来源 ↗

    783GitHub 星标+2 (+0.26 %)
  13. 13
    活跃

    🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams

    github实测增长打开来源 ↗

    安装 git clone https://github.com/tikalk/adlc-team-skills ~/.claude/skills/adlc-team-skills

    132GitHub 星标+1 (+0.76 %)
  14. 14
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skills-platform ~/.claude/skills/agent-skills-platform

    2 376GitHub 星标稳定
  15. 15
    活跃

    🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform

    199GitHub 星标稳定
  16. 16
    活跃

    74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

    github实测增长打开来源 ↗

    129GitHub 星标-4 (-3.0 %)
  17. 17
    活跃

    A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

    github实测增长打开来源 ↗

    105GitHub 星标稳定
  18. 18
    活跃

    Self improving agents through iterations

    github实测增长打开来源 ↗

    104GitHub 星标稳定
  19. 19

    其他
    活跃

    AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.

    github实测增长打开来源 ↗

    68GitHub 星标稳定
  20. 20
    活跃

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/aleclindz/seo-skill-bench ~/.claude/skills/seo-skill-bench

    51GitHub 星标-5 (-8.9 %)
  21. 21

    技能
    活跃

    Real-time execution trace and cost intelligence for Claude Code

    github实测增长打开来源 ↗

    安装 /plugin marketplace add DeibyGS/claudestat

    34GitHub 星标稳定
  22. 22

    其他
    活跃

    AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

    github实测增长打开来源 ↗

    18GitHub 星标稳定
  23. 23

    技能
    活跃

    Measure prompt and skill improvements with blind A/B comparison.

    github实测增长打开来源 ↗

    安装 /plugin marketplace add shinpr/rashomon

    18GitHub 星标稳定

学习与参考资源

按实测增长排序,并在不同来源间归一化。 这些资源可单独访问,不参与主要排名。

  1. 1
    活跃打开来源 ↗

    50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    github

    安装 git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability

    资源实测增长
    33GitHub 星标+2 (+6.5 %)
  2. 2
    活跃打开来源 ↗

    Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.

    github资源实测增长
    77GitHub 星标稳定