工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

123

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Python许可证: Apache-2.0
    • agent-memory
    • agent-skills
    • ai-agents
    • benchmark
    • dataset

    github实测增长打开来源 ↗

    安装 git clone https://github.com/EverMind-AI/SkillCorpus ~/.claude/skills/SkillCorpus

    360GitHub 星标+168 (+87.5 %)
  2. 2

    技能
    活跃

    Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Python许可证: Apache-2.0
    • agent-evaluation
    • agent-security
    • agent-skills
    • agentic-ai
    • benchmark

    github实测增长打开来源 ↗

    安装 git clone https://github.com/NVIDIA/SkillEvaluator ~/.claude/skills/SkillEvaluator

    363GitHub 星标+58 (+19.0 %)
  3. 3

    技能
    活跃

    Research-backed, eval-driven skills for AI agents

    Python许可证: Apache-2.0
    • agent-skills
    • ai-agents
    • codex
    • design
    • evals

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills

    138GitHub 星标+21 (+17.9 %)
  4. 4

    技能
    活跃

    Deletion-first Agent Skill for removing test bloat, verification theater, and speculative fallbacks while preserving behavior.

    Python许可证: MIT
    • agent-skills
    • claude
    • claude-ai
    • claude-code
    • claude-skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/MrZoyo/deslop-GPT ~/.claude/skills/deslop-GPT

    38GitHub 星标+10 (+35.7 %)
  5. 5

    其他
    活跃

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

    TypeScript许可证: MIT
    • ci
    • ci-cd
    • cicd
    • evaluation
    • evaluation-framework

    github实测增长打开来源 ↗

    24 710GitHub 星标+137 (+0.56 %)
  6. 6

    其他
    活跃

    Mastra is the modern TypeScript framework for AI-powered applications and agents.

    TypeScript
    • agents
    • ai
    • chatbots
    • evals
    • javascript

    github实测增长打开来源 ↗

    27 601GitHub 星标+128 (+0.47 %)
  7. 7

    其他
    活跃

    Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

    TypeScript许可证: AGPL-3.0
    • analytics
    • apm
    • datadog
    • elasticsearch
    • grafana

    github实测增长打开来源 ↗

    21 594GitHub 星标+119 (+0.55 %)
  8. 8

    技能
    活跃

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • evaluation
    • governance
    • meta-skill

    github实测增长打开来源 ↗

    安装 git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 565GitHub 星标+58 (+2.3 %)
  9. 9

    MCP
    活跃

    A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

    Shell
    • a2a
    • agent-framework
    • agentic-ai
    • ai
    • ai-agents

    github实测增长打开来源 ↗

    2GitHub 星标+1 (+100.0 %)
  10. 10

    技能
    活跃

    Production patterns for agent orchestrators, harnesses, evals, MCP/A2A interoperability, memory, provider routing, and LLM usage metering.

    Python许可证: MIT
    • a2a
    • agent-orchestration
    • agent-skills
    • ai-agents
    • developer-tools

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ssheleg/agent-stack ~/.claude/skills/agent-stack

    2GitHub 星标+1 (+100.0 %)
  11. 11

    智能体
    活跃

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    Python许可证: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标+1
  12. 12

    智能体
    活跃

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    Python许可证: Apache-2.0
    • a2a
    • adk
    • ai-agents
    • aws
    • azure

    github实测增长打开来源 ↗

    146GitHub 星标+13 (+9.8 %)
  13. 13

    智能体
    活跃

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

    Python许可证: Apache-2.0
    • agentops
    • agents
    • ai
    • ai-governance
    • apache-spark

    github实测增长打开来源 ↗

    27 759GitHub 星标+78 (+0.28 %)
  14. 14

    智能体
    活跃

    DataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box.

    Java许可证: AGPL-3.0
    • aiops
    • apm
    • application-monitoring
    • devops
    • distributed-tracing

    github实测增长打开来源 ↗

    627GitHub 星标+22 (+3.6 %)
  15. 15

    其他
    活跃

    The fastest path to AI-powered full stack observability, even for lean teams.

    Go许可证: GPL-3.0
    • ai
    • alerting
    • cncf
    • data-visualization
    • database

    github实测增长打开来源 ↗

    80 382GitHub 星标+80 (+0.10 %)
  16. 16

    库
    活跃

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    Python许可证: Apache-2.0
    • automation
    • data
    • data-engineering
    • data-ops
    • data-science

    github实测增长打开来源 ↗

    23 741GitHub 星标+55 (+0.23 %)
  17. 17

    其他
    活跃

    the LLM vulnerability scanner

    Python许可证: Apache-2.0
    • ai
    • llm-evaluation
    • llm-security
    • security-scanners
    • vulnerability-assessment

    github实测增长打开来源 ↗

    9 079GitHub 星标+46 (+0.51 %)
  18. 18

    技能
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 358GitHub 星标+29 (+1.2 %)
  19. 19

    其他
    活跃

    SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

    TypeScript
    • apm
    • application-monitoring
    • distributed-tracing
    • go
    • good-first-issue

    github实测增长打开来源 ↗

    31 983GitHub 星标+48 (+0.15 %)
  20. 20

    其他
    活跃

    A high-performance observability data pipeline.

    Rust许可证: MPL-2.0
    • agent
    • cloud-native
    • data-transformation
    • datadog
    • etl

    github实测增长打开来源 ↗

    22 497GitHub 星标+41 (+0.18 %)
  21. 21

    MCP
    活跃

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Go许可证: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    github实测增长打开来源 ↗

    1 752GitHub 星标+22 (+1.3 %)
  22. 22

    技能
    活跃

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude
    • claude-code
    • claude-md

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Sahir619/fable-method ~/.claude/skills/fable-method

    2 269GitHub 星标+22 (+0.98 %)
  23. 23

    智能体
    活跃

    Amazon Bedrock AgentCore enterprise platform accelerator with AWS CDK, Terraform organization guardrails, MCP/A2A agents, security, memory, and observability.

    Python许可证: Apache-2.0
    • a2a-protocol
    • agentcore
    • agentcore-agent
    • agentcore-gateway
    • agentcore-identity

    github实测增长打开来源 ↗

    5GitHub 星标+1 (+25.0 %)
  24. 24

    MCP
    休眠

    Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability

    Python许可证: MIT
    • a2a
    • a2a-client
    • a2a-server
    • agent-evaluation
    • agentic-ai

    github实测增长打开来源 ↗

    5GitHub 星标+1 (+25.0 %)
  25. 25

    MCP
    活跃

    🫖 Status page with uptime monitoring & API monitoring as code 🫖

    TypeScript许可证: AGPL-3.0
    • alerting
    • incident-management
    • mcp
    • mcp-server
    • monitoring

    github实测增长打开来源 ↗

    9 045GitHub 星标+28 (+0.31 %)