工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

75

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Python许可证: Apache-2.0
    • agent-memory
    • agent-skills
    • ai-agents
    • benchmark
    • dataset

    github实测增长打开来源 ↗

    安装 git clone https://github.com/EverMind-AI/SkillCorpus ~/.claude/skills/SkillCorpus

    424GitHub 星标+170 (+66.9 %)
  2. 2

    其他
    活跃

    Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.

    Python许可证: Apache-2.0
    • benchmark
    • kubernetes
    • llm-evaluation
    • llm-infrastructure
    • ray

    github实测增长打开来源 ↗

    140GitHub 星标+24 (+20.7 %)
  3. 3

    技能
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Python许可证: Apache-2.0
    • agent-evaluation
    • agent-security
    • agent-skills
    • agentic-ai
    • benchmark

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    389GitHub 星标+57 (+17.2 %)
  4. 4

    技能
    活跃

    Research-backed, eval-driven skills for AI agents

    Python许可证: Apache-2.0
    • agent-skills
    • ai-agents
    • codex
    • design
    • evals

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills

    142GitHub 星标+18 (+14.5 %)
  5. 5

    智能体
    活跃

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    Python许可证: Apache-2.0
    • a2a
    • adk
    • ai-agents
    • aws
    • azure

    github实测增长打开来源 ↗

    156GitHub 星标+19 (+13.9 %)
  6. 6

    技能
    活跃

    Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

    Python许可证: MIT
    • agent-skills
    • evals
    • python
    • skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

    73GitHub 星标+4 (+5.8 %)
  7. 7

    智能体
    活跃

    DataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box.

    Java许可证: AGPL-3.0
    • aiops
    • apm
    • application-monitoring
    • devops
    • distributed-tracing

    github实测增长打开来源 ↗

    642GitHub 星标+32 (+5.2 %)
  8. 8

    技能
    活跃

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    Shell许可证: Apache-2.0
    • agent-skills
    • ai
    • observability
    • opentelemetry

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub 星标+4 (+4.3 %)
  9. 9

    技能
    活跃

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    JavaScript许可证: Apache-2.0
    • agent-skills
    • ai-agents
    • claude-code
    • devops
    • dql

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    132GitHub 星标+4 (+3.1 %)
  10. 10

    技能
    活跃

    A test runner for agentskills.io-style AI agent skills

    TypeScript许可证: MIT
    • agent-evals
    • agent-skills
    • agentskills
    • ai-agents
    • cli

    github实测增长打开来源 ↗

    安装 git clone https://github.com/darkrishabh/agent-skills-eval ~/.claude/skills/agent-skills-eval

    719GitHub 星标+13 (+1.8 %)
  11. 11

    技能
    活跃

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • evaluation
    • governance
    • meta-skill

    github实测增长打开来源 ↗

    安装 git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 577GitHub 星标+35 (+1.4 %)
  12. 12

    技能
    活跃

    local-first analytics for AI agent skills

    TypeScript
    • agent-skills
    • analytics
    • bun
    • claude-code
    • cli

    github实测增长打开来源 ↗

    安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub 星标+1 (+1.3 %)
  13. 13

    技能
    活跃

    🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

    MDX许可证: MIT
    • agent-skills
    • agents
    • genai
    • hacktoberfest
    • langfuse

    github实测增长打开来源 ↗

    安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

    239GitHub 星标+3 (+1.3 %)
  14. 14

    技能
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 367GitHub 星标+28 (+1.2 %)
  15. 15

    MCP
    活跃

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Go许可证: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    github实测增长打开来源 ↗

    1 759GitHub 星标+18 (+1.0 %)
  16. 16

    MCP
    活跃

    Self improving agents through iterations

    Python许可证: Apache-2.0
    • agent-learning
    • agent-memory
    • agentic-workflows
    • ai-agents
    • claude-code

    github实测增长打开来源 ↗

    105GitHub 星标+1 (+0.96 %)
  17. 17

    技能
    活跃

    🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams

    Shell许可证: MIT
    • adr
    • agent-skills
    • agentic-sdlc
    • ai-coding
    • developer-tools

    github实测增长打开来源 ↗

    安装 git clone https://github.com/tikalk/adlc-team-skills ~/.claude/skills/adlc-team-skills

    132GitHub 星标+1 (+0.76 %)
  18. 18

    技能
    活跃

    Dashboard for monitoring claude code sessions.

    Python许可证: Apache-2.0
    • agents
    • agentskills
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    github实测增长打开来源 ↗

    安装 /plugin marketplace add JayantDevkar/claude-code-karma

    323GitHub 星标+2 (+0.62 %)
  19. 19

    其他
    活跃

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

    TypeScript许可证: MIT
    • ci
    • ci-cd
    • cicd
    • evaluation
    • evaluation-framework

    github实测增长打开来源 ↗

    24 768GitHub 星标+142 (+0.58 %)
  20. 20

    其他
    活跃

    Mastra is the modern TypeScript framework for AI-powered applications and agents.

    TypeScript
    • agents
    • ai
    • chatbots
    • evals
    • javascript

    github实测增长打开来源 ↗

    27 658GitHub 星标+128 (+0.46 %)
  21. 21

    其他
    活跃

    Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

    TypeScript许可证: AGPL-3.0
    • analytics
    • apm
    • datadog
    • elasticsearch
    • grafana

    github实测增长打开来源 ↗

    21 615GitHub 星标+96 (+0.45 %)
  22. 22

    MCP
    活跃

    🫖 Status page with uptime monitoring & API monitoring as code 🫖

    TypeScript许可证: AGPL-3.0
    • alerting
    • incident-management
    • mcp
    • mcp-server
    • monitoring

    github实测增长打开来源 ↗

    9 056GitHub 星标+31 (+0.34 %)
  23. 23

    其他
    活跃

    the LLM vulnerability scanner

    Python许可证: Apache-2.0
    • ai
    • llm-evaluation
    • llm-security
    • security-scanners
    • vulnerability-assessment

    github实测增长打开来源 ↗

    9 079GitHub 星标+31 (+0.34 %)
  24. 24

    智能体
    活跃

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

    Python许可证: Apache-2.0
    • agentops
    • agents
    • ai
    • ai-governance
    • apache-spark

    github实测增长打开来源 ↗

    27 783GitHub 星标+82 (+0.30 %)
  25. 25

    库
    活跃

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    Python许可证: Apache-2.0
    • automation
    • data
    • data-engineering
    • data-ops
    • data-science

    github实测增长打开来源 ↗

    23 766GitHub 星标+66 (+0.28 %)