工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

77

工具排名

Ranked by creation date, newest first; undated entries come last. 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    技能
    活跃

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    Shell许可证: Apache-2.0
    • agent-skills
    • ai
    • observability
    • opentelemetry

    github实测增长打开来源 ↗

    安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub 星标+1 (+1.0 %)
  2. 2

    技能
    活跃

    Agent skills for Arize — datasets, experiments, and traces via the ax CLI

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • ai-observability
    • arize
    • claude-code

    github估算动量打开来源 ↗

    安装 git clone https://github.com/Arize-ai/arize-skills ~/.claude/skills/arize-skills

    47GitHub 星标—
  3. 3

    MCP
    活跃

    AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure.

    Rust许可证: Apache-2.0
    • a2a
    • ai-agent-framework
    • ai-agents
    • ai-sre
    • aiops

    github实测增长打开来源 ↗

    339GitHub 星标+81 (+31.4 %)
  4. 4

    技能
    活跃

    local-first analytics for AI agent skills

    TypeScript
    • agent-skills
    • analytics
    • bun
    • claude-code
    • cli

    github实测增长打开来源 ↗

    安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub 星标+1 (+1.3 %)
  5. 5

    技能
    活跃

    Measure prompt and skill improvements with blind A/B comparison.

    Python许可证: MIT
    • agent-skills
    • ai-tools
    • claude-code
    • claude-code-plugin
    • claude-code-skill

    github实测增长打开来源 ↗

    安装 /plugin marketplace add shinpr/rashomon

    18GitHub 星标稳定
  6. 6

    技能
    活跃

    Dashboard for monitoring claude code sessions.

    Python许可证: Apache-2.0
    • agents
    • agentskills
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    github实测增长打开来源 ↗

    安装 /plugin marketplace add JayantDevkar/claude-code-karma

    324GitHub 星标+3 (+0.93 %)
  7. 7

    MCP
    活跃

    Self improving agents through iterations

    Python许可证: Apache-2.0
    • agent-learning
    • agent-memory
    • agentic-workflows
    • ai-agents
    • claude-code

    github实测增长打开来源 ↗

    104GitHub 星标稳定
  8. 8

    技能
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skills-platform ~/.claude/skills/agent-skills-platform

    2 376GitHub 星标稳定
  9. 9

    技能
    活跃

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Python许可证: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    github实测增长打开来源 ↗

    安装 git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 367GitHub 星标+15 (+0.64 %)
  10. 10

    其他
    活跃

    A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

    Go许可证: Apache-2.0
    • a2a
    • agents
    • ai
    • containerized
    • docker

    github实测增长打开来源 ↗

    14GitHub 星标+1 (+7.7 %)
  11. 11

    智能体
    活跃

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    Python许可证: Apache-2.0
    • a2a
    • adk
    • ai-agents
    • aws
    • azure

    github实测增长打开来源 ↗

    166GitHub 星标+25 (+17.7 %)
  12. 12

    技能
    活跃

    🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.

    Python许可证: GPL-3.0
    • a2a-protocol
    • ag-ui-protocol
    • agent-platform
    • agentic-ai
    • agents

    github实测增长打开来源 ↗

    安装 git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform

    199GitHub 星标稳定
  13. 13

    MCP
    活跃

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Go许可证: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    github实测增长打开来源 ↗

    1 763GitHub 星标+15 (+0.86 %)
  14. 14

    MCP
    活跃

    MCP server for Langfuse LLM observability — trace and observation analysis.

    TypeScript许可证: MIT

      mcp实测增长打开来源 ↗

      安装 claude mcp add langfuse -- npx langfuse-observability-mcp-server

      80GitHub 星标+2 (+2.6 %)
    • 15

      MCP
      活跃

      A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

      Python许可证: MIT
      • agent-skills
      • ai-agents
      • claude-code
      • codex
      • developer-tools

      github实测增长打开来源 ↗

      105GitHub 星标稳定
    • 16

      其他
      活跃

      Mastra is the modern TypeScript framework for AI-powered applications and agents.

      TypeScript
      • agents
      • ai
      • chatbots
      • evals
      • javascript

      github实测增长打开来源 ↗

      27 712GitHub 星标+149 (+0.54 %)
    • 17

      MCP
      活跃

      🫖 Status page with uptime monitoring & API monitoring as code 🫖

      TypeScript许可证: AGPL-3.0
      • alerting
      • incident-management
      • mcp
      • mcp-server
      • monitoring

      github实测增长打开来源 ↗

      9 060GitHub 星标+31 (+0.34 %)
    • 18

      其他
      活跃

      the LLM vulnerability scanner

      Python许可证: Apache-2.0
      • ai
      • llm-evaluation
      • llm-security
      • security-scanners
      • vulnerability-assessment

      github实测增长打开来源 ↗

      9 110GitHub 星标+37 (+0.41 %)
    • 19

      其他
      活跃

      Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

      TypeScript许可证: MIT
      • ci
      • ci-cd
      • cicd
      • evaluation
      • evaluation-framework

      github实测增长打开来源 ↗

      24 825GitHub 星标+159 (+0.64 %)
    • 20

      其他
      活跃

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScript许可证: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      github实测增长打开来源 ↗

      21 643GitHub 星标+87 (+0.40 %)
    • 21

      智能体
      活跃

      eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

      Go许可证: Apache-2.0
      • cloud-native
      • devops
      • docker
      • ebpf
      • golang

      github实测增长打开来源 ↗

      12 068GitHub 星标+7 (+0.06 %)
    • 22

      其他
      活跃

      SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

      TypeScript
      • apm
      • application-monitoring
      • distributed-tracing
      • go
      • good-first-issue

      github实测增长打开来源 ↗

      32 012GitHub 星标+42 (+0.13 %)
    • 23

      其他
      活跃

      A high-performance observability data pipeline.

      Rust许可证: MPL-2.0
      • agent
      • cloud-native
      • data-transformation
      • datadog
      • etl

      github实测增长打开来源 ↗

      22 511GitHub 星标+24 (+0.11 %)
    • 24

      库
      活跃

      Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

      Python许可证: Apache-2.0
      • automation
      • data
      • data-engineering
      • data-ops
      • data-science

      github实测增长打开来源 ↗

      23 783GitHub 星标+67 (+0.28 %)
    • 25

      智能体
      活跃

      The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

      Python许可证: Apache-2.0
      • agentops
      • agents
      • ai
      • ai-governance
      • apache-spark

      github实测增长打开来源 ↗

      27 817GitHub 星标+86 (+0.31 %)