工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

77

工具排名

Ranked by creation date, newest first; undated entries come last. 原始值保留各自的数据窗口;计算变化需要 7 天内至少两次测量。

  1. 1

    其他
    活跃

    AI SRE AgenticOps for Kubernetes and cloud infrastructure.

    github实测增长打开来源 ↗

    783GitHub 星标+2 (+0.26 %)
  2. 2
    活跃

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/aleclindz/seo-skill-bench ~/.claude/skills/seo-skill-bench

    51GitHub 星标-5 (-8.9 %)
  3. 3

    其他
    活跃

    AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

    github实测增长打开来源 ↗

    18GitHub 星标稳定
  4. 4
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    404GitHub 星标+53 (+15.1 %)
  5. 5

    智能体
    活跃

    DataBuff is an AI-native APM built on Opentelemetry,with multi-agent troubleshooting out of the box.

    github实测增长打开来源 ↗

    655GitHub 星标+45 (+7.4 %)
  6. 6
    活跃

    Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

    github实测增长打开来源 ↗

    安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

    73GitHub 星标+2 (+2.8 %)
  7. 7

    智能体
    活跃

    The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  8. 8

    技能
    活跃

    Axiom is a curated marketplace of shared plugins for Claude Code and Codex.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/netopsengineer/axiom ~/.claude/skills/axiom

    5GitHub 星标稳定
  9. 9
    活跃

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  10. 10

    技能
    活跃

    Anchor — the production-grade AGENTS.md template for AI coding agents. 51 sections of battle-tested rules. Keep your agents grounded.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/peva3/anchor ~/.claude/skills/anchor

    8GitHub 星标稳定
  11. 11

    其他
    活跃

    Open-source observability tool that uses AI agents to self-heal your software

    github估算动量打开来源 ↗

    1 404GitHub 星标
  12. 12

    技能
    活跃

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    github实测增长打开来源 ↗

    安装 git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub 星标稳定
  13. 13
    活跃

    74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

    github实测增长打开来源 ↗

    129GitHub 星标-4 (-3.0 %)
  14. 14

    其他
    活跃

    A Go-native framework for LLM agents, with OpenTelemetry observability built in.

    github实测增长打开来源 ↗

    10GitHub 星标稳定
  15. 15

    技能
    活跃

    Real-time execution trace and cost intelligence for Claude Code

    github实测增长打开来源 ↗

    安装 /plugin marketplace add DeibyGS/claudestat

    34GitHub 星标稳定
  16. 16
    活跃

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    mcp实测增长打开来源 ↗

    安装 claude mcp add mcp-server -- npx @spanlens/mcp-server

    12GitHub 星标稳定
  17. 17

    智能体
    活跃

    MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

    github实测增长打开来源 ↗

    7GitHub 星标稳定
  18. 18
    活跃

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    github实测增长打开来源 ↗

    安装 git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 596GitHub 星标+37 (+1.4 %)
  19. 19
    活跃

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    135GitHub 星标+4 (+3.1 %)
  20. 20
    活跃

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  21. 21

    技能
    活跃

    Marketing Mix Model expert agent plugin for Claude Code - pymc-marketing v0.18.2+

    github实测增长打开来源 ↗

    安装 /plugin marketplace add Yakoub-ai/agent-mmm

    4GitHub 星标稳定
  22. 22

    智能体
    活跃

    Provide clear documentation for AgentStack’s MCP protocol, plugins, and ecosystem API with usage examples and tool references.

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  23. 23

    MCP
    活跃

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    github实测增长打开来源 ↗

    50GitHub 星标+1 (+2.0 %)

学习与参考资源

Ranked by creation date, newest first; undated entries come last. 这些资源可单独访问,不参与主要排名。

  1. 1
    活跃打开来源 ↗

    50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    github

    安装 git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability

    资源实测增长
    33GitHub 星标+2 (+6.5 %)
  2. 2
    活跃打开来源 ↗

    Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.

    github资源实测增长
    77GitHub 星标稳定