工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

116

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Python许可证: Apache-2.0
    • agent-memory
    • agent-skills
    • ai-agents
    • benchmark
    • dataset

    github实测增长打开来源 ↗

    安装 git clone https://github.com/EverMind-AI/SkillCorpus ~/.claude/skills/SkillCorpus

    424GitHub 星标+170 (+66.9 %)
  2. 2

    其他
    活跃

    Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.

    Python许可证: Apache-2.0
    • benchmark
    • kubernetes
    • llm-evaluation
    • llm-infrastructure
    • ray

    github实测增长打开来源 ↗

    140GitHub 星标+24 (+20.7 %)
  3. 3

    技能
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Python许可证: Apache-2.0
    • agent-evaluation
    • agent-security
    • agent-skills
    • agentic-ai
    • benchmark

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    389GitHub 星标+57 (+17.2 %)
  4. 4

    技能
    活跃

    Research-backed, eval-driven skills for AI agents

    Python许可证: Apache-2.0
    • agent-skills
    • ai-agents
    • codex
    • design
    • evals

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills

    142GitHub 星标+18 (+14.5 %)
  5. 5

    智能体
    活跃

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    Python许可证: Apache-2.0
    • a2a
    • adk
    • ai-agents
    • aws
    • azure

    github实测增长打开来源 ↗

    156GitHub 星标+19 (+13.9 %)
  6. 6

    技能
    活跃

    Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

    Python许可证: MIT
    • agent-skills
    • evals
    • python
    • skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

    73GitHub 星标+4 (+5.8 %)
  7. 7

    智能体
    活跃

    DataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box.

    Java许可证: AGPL-3.0
    • aiops
    • apm
    • application-monitoring
    • devops
    • distributed-tracing

    github实测增长打开来源 ↗

    642GitHub 星标+32 (+5.2 %)
  8. 8

    技能
    活跃

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    Shell许可证: Apache-2.0
    • agent-skills
    • ai
    • observability
    • opentelemetry

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub 星标+4 (+4.3 %)
  9. 9

    技能
    活跃

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    JavaScript许可证: Apache-2.0
    • agent-skills
    • ai-agents
    • claude-code
    • devops
    • dql

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    132GitHub 星标+4 (+3.1 %)
  10. 10

    技能
    活跃

    A test runner for agentskills.io-style AI agent skills

    TypeScript许可证: MIT
    • agent-evals
    • agent-skills
    • agentskills
    • ai-agents
    • cli

    github实测增长打开来源 ↗

    安装 git clone https://github.com/darkrishabh/agent-skills-eval ~/.claude/skills/agent-skills-eval

    719GitHub 星标+13 (+1.8 %)
  11. 11

    技能
    活跃

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • evaluation
    • governance
    • meta-skill

    github实测增长打开来源 ↗

    安装 git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 577GitHub 星标+35 (+1.4 %)
  12. 12

    技能
    活跃

    local-first analytics for AI agent skills

    TypeScript
    • agent-skills
    • analytics
    • bun
    • claude-code
    • cli

    github实测增长打开来源 ↗

    安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub 星标+1 (+1.3 %)
  13. 13

    技能
    活跃

    🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

    MDX许可证: MIT
    • agent-skills
    • agents
    • genai
    • hacktoberfest
    • langfuse

    github实测增长打开来源 ↗

    安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

    239GitHub 星标+3 (+1.3 %)
  14. 14

    技能
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 367GitHub 星标+28 (+1.2 %)
  15. 15

    MCP
    活跃

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Go许可证: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    github实测增长打开来源 ↗

    1 759GitHub 星标+18 (+1.0 %)
  16. 16

    MCP
    活跃

    Self improving agents through iterations

    Python许可证: Apache-2.0
    • agent-learning
    • agent-memory
    • agentic-workflows
    • ai-agents
    • claude-code

    github实测增长打开来源 ↗

    105GitHub 星标+1 (+0.96 %)
  17. 17

    技能
    活跃

    🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams

    Shell许可证: MIT
    • adr
    • agent-skills
    • agentic-sdlc
    • ai-coding
    • developer-tools

    github实测增长打开来源 ↗

    安装 git clone https://github.com/tikalk/adlc-team-skills ~/.claude/skills/adlc-team-skills

    132GitHub 星标+1 (+0.76 %)
  18. 18

    技能
    活跃

    OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

    Python许可证: Apache-2.0
    • agent
    • agent-skills
    • ai-agent
    • alignment
    • evaluation

    github实测增长打开来源 ↗

    安装 git clone https://github.com/agentscope-ai/OpenJudge ~/.claude/skills/OpenJudge

    809GitHub 星标+6 (+0.75 %)
  19. 19

    技能
    活跃

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude
    • claude-code
    • claude-md

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Sahir619/fable-method ~/.claude/skills/fable-method

    2 272GitHub 星标+16 (+0.71 %)
  20. 20

    技能
    活跃

    Dashboard for monitoring claude code sessions.

    Python许可证: Apache-2.0
    • agents
    • agentskills
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    github实测增长打开来源 ↗

    安装 /plugin marketplace add JayantDevkar/claude-code-karma

    323GitHub 星标+2 (+0.62 %)
  21. 21

    其他
    活跃

    Mastra is the modern TypeScript framework for AI-powered applications and agents.

    TypeScript
    • agents
    • ai
    • chatbots
    • evals
    • javascript

    github实测增长打开来源 ↗

    27 658GitHub 星标+128 (+0.46 %)
  22. 22

    MCP
    活跃

    🫖 Status page with uptime monitoring & API monitoring as code 🫖

    TypeScript许可证: AGPL-3.0
    • alerting
    • incident-management
    • mcp
    • mcp-server
    • monitoring

    github实测增长打开来源 ↗

    9 056GitHub 星标+31 (+0.34 %)
  23. 23

    其他
    活跃

    SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

    TypeScript
    • apm
    • application-monitoring
    • distributed-tracing
    • go
    • good-first-issue

    github实测增长打开来源 ↗

    32 003GitHub 星标+50 (+0.16 %)
  24. 24

    其他
    活跃

    Open-source observability tool that uses AI agents to self-heal your software

    TypeScript许可证: Apache-2.0
    • ai
    • llm
    • memory
    • observability
    • opentelemetry

    github实测增长打开来源 ↗

    1 404GitHub 星标+2 (+0.14 %)
  25. 25

    其他
    活跃

    AI SRE AgenticOps for Kubernetes and cloud infrastructure.

    Python
    • agenticops
    • ai
    • aiops
    • aisre
    • cloud

    github实测增长打开来源 ↗

    782GitHub 星标+1 (+0.13 %)