工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

75

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    MCP
    活跃

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    ↓ 32 下载/周TypeScript许可证: MIT

      mcp实测增长打开来源 ↗

      安装 claude mcp add mcp-server -- npx @spanlens/mcp-server

      12GitHub 星标稳定
    • 2

      其他
      活跃

      Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

      TypeScript许可证: MIT
      • ci
      • ci-cd
      • cicd
      • evaluation
      • evaluation-framework

      github实测增长打开来源 ↗

      24 768GitHub 星标+142 (+0.58 %)
    • 3

      其他
      活跃

      AI SRE AgenticOps for Kubernetes and cloud infrastructure.

      Python
      • agenticops
      • ai
      • aiops
      • aisre
      • cloud

      github实测增长打开来源 ↗

      782GitHub 星标+1 (+0.13 %)
    • 4

      智能体
      活跃

      The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

      Python许可证: Apache-2.0
      • agentops
      • agents
      • ai
      • ai-governance
      • apache-spark

      github实测增长打开来源 ↗

      27 783GitHub 星标+82 (+0.30 %)
    • 5

      库
      活跃

      Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

      Python许可证: Apache-2.0
      • automation
      • data
      • data-engineering
      • data-ops
      • data-science

      github实测增长打开来源 ↗

      23 766GitHub 星标+66 (+0.28 %)
    • 6

      其他
      活跃

      A high-performance observability data pipeline.

      Rust许可证: MPL-2.0
      • agent
      • cloud-native
      • data-transformation
      • datadog
      • etl

      github实测增长打开来源 ↗

      22 509GitHub 星标+40 (+0.18 %)
    • 7

      其他
      活跃

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScript许可证: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      github实测增长打开来源 ↗

      21 615GitHub 星标+96 (+0.45 %)
    • 8

      其他
      活跃

      SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

      TypeScript
      • apm
      • application-monitoring
      • distributed-tracing
      • go
      • good-first-issue

      github实测增长打开来源 ↗

      32 003GitHub 星标+50 (+0.16 %)
    • 9

      其他
      活跃

      Mastra is the modern TypeScript framework for AI-powered applications and agents.

      TypeScript
      • agents
      • ai
      • chatbots
      • evals
      • javascript

      github实测增长打开来源 ↗

      27 658GitHub 星标+128 (+0.46 %)
    • 10

      其他
      活跃

      The fastest path to AI-powered full stack observability, even for lean teams.

      Go许可证: GPL-3.0
      • ai
      • alerting
      • cncf
      • data-visualization
      • database

      github实测增长打开来源 ↗

      80 412GitHub 星标+85 (+0.11 %)
    • 11

      MCP
      活跃

      🫖 Status page with uptime monitoring & API monitoring as code 🫖

      TypeScript许可证: AGPL-3.0
      • alerting
      • incident-management
      • mcp
      • mcp-server
      • monitoring

      github实测增长打开来源 ↗

      9 056GitHub 星标+31 (+0.34 %)
    • 12

      其他
      活跃

      eBPF-based Networking, Security, and Observability

      Go许可证: Apache-2.0
      • bpf
      • cncf
      • cni
      • containers
      • ebpf

      github实测增长打开来源 ↗

      25 047GitHub 星标+29 (+0.12 %)
    • 13

      智能体
      活跃

      eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

      Go许可证: Apache-2.0
      • cloud-native
      • devops
      • docker
      • ebpf
      • golang

      github实测增长打开来源 ↗

      12 068GitHub 星标+8 (+0.07 %)
    • 14

      智能体
      活跃

      DataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box.

      Java许可证: AGPL-3.0
      • aiops
      • apm
      • application-monitoring
      • devops
      • distributed-tracing

      github实测增长打开来源 ↗

      642GitHub 星标+32 (+5.2 %)
    • 15

      其他
      活跃

      Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.

      Python许可证: Apache-2.0
      • benchmark
      • kubernetes
      • llm-evaluation
      • llm-infrastructure
      • ray

      github实测增长打开来源 ↗

      140GitHub 星标+24 (+20.7 %)
    • 16

      智能体
      活跃

      The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

      Python许可证: Apache-2.0
      • a2a
      • adk
      • ai-agents
      • aws
      • azure

      github实测增长打开来源 ↗

      156GitHub 星标+19 (+13.9 %)
    • 17

      MCP
      活跃

      Production reliability, benchmarking, and evaluation layer for MCP agent runtimes — protocol negotiation, A2A interop, circuit breakers, connection pooling, adaptive streaming, and autoscaling, with measured throughput/latency and a…

      Python许可证: Apache-2.0
      • a2a-protocol
      • agent-to-agent
      • ai-agents
      • async-python
      • autoscaling

      github实测增长打开来源 ↗

      3GitHub 星标稳定
    • 18

      MCP
      活跃

      Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

      Python
      • a2a-protocol
      • agentic-ai
      • auditability
      • clean-architecture
      • credit-risk

      github实测增长打开来源 ↗

      0GitHub 星标稳定
    • 19

      MCP
      活跃

      AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure.

      Rust许可证: Apache-2.0
      • a2a
      • ai-agent-framework
      • ai-agents
      • ai-sre
      • aiops

      github实测增长打开来源 ↗

      254GitHub 星标-3 (-1.2 %)
    • 20

      智能体
      活跃

      Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

      TypeScript许可证: MIT
      • agent2agent
      • ai-agents
      • cordis
      • deepseek-harness
      • dsh

      github实测增长打开来源 ↗

      1GitHub 星标稳定
    • 21

      MCP
      活跃

      A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

      Shell
      • a2a
      • agent-framework
      • agentic-ai
      • ai
      • ai-agents

      github实测增长打开来源 ↗

      2GitHub 星标稳定
    • 22

      技能
      活跃

      Production patterns for agent orchestrators, harnesses, evals, MCP/A2A interoperability, memory, provider routing, and LLM usage metering.

      Python许可证: MIT
      • a2a
      • agent-orchestration
      • agent-skills
      • ai-agents
      • developer-tools

      github实测增长打开来源 ↗

      安装 git clone https://github.com/ssheleg/agent-stack ~/.claude/skills/agent-stack

      2GitHub 星标+1 (+100.0 %)
    • 23

      技能
      活跃

      Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

      • agentic-coding
      • agentic-workflow
      • ai-agent-skills
      • ai-code-review
      • ai-workflows

      github实测增长打开来源 ↗

      安装 git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

      2GitHub 星标稳定
    • 24

      技能
      活跃

      🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

      MDX许可证: MIT
      • agent-skills
      • agents
      • genai
      • hacktoberfest
      • langfuse

      github实测增长打开来源 ↗

      安装 git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

      239GitHub 星标+3 (+1.3 %)
    • 25

      智能体
      活跃

      Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

      TypeScript许可证: Apache-2.0
      • a2a
      • agent-evaluation
      • ai-agents
      • benchmark
      • deterministic-replay

      github实测增长打开来源 ↗

      1GitHub 星标稳定