工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

用途

活跃度

排序方式

122

工具排名

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    智能体
    活跃

    Agent 降智检测与自愈公评网络 — an immune system for the AI agent society

    TypeScript许可证: MIT
    • a2a
    • agent
    • agent-guard
    • ai-sre
    • drift-detection

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  2. 2

    其他
    活跃

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    Python
    • a2a
    • agent-runtime
    • ai-infra
    • deepseek
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  3. 3

    智能体
    休眠

    The reliability and interoperability layer for AI agents. A2A-native. MCP-bridged.

    Python许可证: Apache-2.0
    • a2a
    • agent-framework
    • agents
    • ai
    • ai-safety

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  4. 4

    智能体
    活跃

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    Python许可证: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  5. 5

    智能体
    活跃

    Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

    TypeScript许可证: MIT
    • agent2agent
    • ai-agents
    • cordis
    • deepseek-harness
    • dsh

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  6. 6

    MCP
    活跃

    8 MCP SMB products — standalone AI servers for SMBs: Guardrails, FinOps, Observability, Router, Trust Score, Memory, ThinkSecure, A2A Lite. 37 tools, TNC credits billing.

    Python许可证: MIT
    • a2a-protocol
    • ai-governance
    • finops
    • guardrails
    • mcp

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  7. 7

    智能体
    活跃

    The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

    Python许可证: Apache-2.0
    • a2a
    • agent-framework
    • ai-agents
    • ai-governance
    • ai-safety

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  8. 8

    其他
    休眠

    Official Python SDK for GT8004 — AI agent observability with MCP, A2A, x402 payment tracking. FastAPI, Flask, FastMCP middleware included.

    Python许可证: MIT
    • a2a
    • ai-agent
    • analytics
    • fastapi
    • flask

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  9. 9

    其他
    活跃

    Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

    TypeScript
    • ai-agents
    • claude-code
    • claude-code-skills
    • cli
    • evals

    github实测增长打开来源 ↗

    1GitHub 星标稳定
  10. 10

    技能
    活跃

    Run many AIs on one board and keep control of all of it. Deterministic code decides who acts — never a model. A privacy floor keeps sensitive work on your machine, your own tests decide what counts as done, and every action lands on a…

    • a2a
    • agent-orchestration
    • agent-skills
    • ai-agents
    • ai-governance

    github实测增长打开来源 ↗

    安装 git clone https://github.com/sandhusukhdeep2/sc-prism-releases ~/.claude/skills/sc-prism-releases

    1GitHub 星标稳定
  11. 11

    技能
    活跃

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    Shell许可证: MIT
    • ai-workflow-observability
    • claude-code
    • claude-code-hooks
    • claude-code-skill
    • claude-code-skills

    github实测增长打开来源 ↗

    安装 git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub 星标稳定
  12. 12

    智能体
    活跃

    Local-first control plane for durable, governed agent teams: DAG orchestration, approvals, memory, signed skills, trace contracts, and realtime.

    Python许可证: Apache-2.0
    • a2a-protocol
    • agentic-ai
    • ai-agents
    • fastapi
    • llmops

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  13. 13

    智能体
    活跃

    A2A green-agent orchestrator for evaluating agents on the AppWorld benchmark, built on the AgentBeats SDK

    Python
    • a2a-protocol
    • agentbeats
    • appworld
    • evaluation
    • llm-agents

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  14. 14

    智能体
    活跃

    Provide clear documentation for AgentStack’s MCP protocol, plugins, and ecosystem API with usage examples and tool references.

    • a2a
    • anthropic
    • claude-code
    • crewai
    • deep-learning

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  15. 15

    智能体
    休眠

    Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

    Python许可证: MIT
    • a2a
    • agents
    • contracts
    • evaluation
    • llm

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  16. 16

    MCP
    活跃

    Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

    Python
    • a2a-protocol
    • agentic-ai
    • auditability
    • clean-architecture
    • credit-risk

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  17. 17

    智能体
    休眠

    An AI-powered multi-agent system that demonstrates clinical triage, OTC medication recommendations, and e-pharmacy integration for respiratory conditions. Built with modular agents that collaborate to provide safe, intelligent healthcare…

    Python
    • agent-to-agent
    • agentic-ai
    • aiagent
    • antigravity-ide
    • cursor-ai

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  18. 18

    MCP
    活跃

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    • agent-to-agent
    • ai-gateway
    • api-gateway
    • apis-json
    • cncf

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  19. 19

    智能体
    休眠

    A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

    Python
    • a2a
    • agent-to-agent
    • ai-agents
    • conversational-ai
    • llm-evaluation

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  20. 20

    智能体
    活跃

    面向长程研发任务的 Java Agent Harness，支持 A2A 跨语言协作、可恢复执行、上下文工程与 Eval 驱动开发。

    Java许可证: Apache-2.0
    • a2a
    • agentic-ai
    • ai-agents
    • developer-tools
    • evals

    github实测增长打开来源 ↗

    0GitHub 星标稳定
  21. 21

    其他
    活跃

    🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

    Python许可证: MIT
    • a2a-protocol
    • agent-framework
    • ai
    • causal-memory
    • event-stream

    github实测增长打开来源 ↗

    0GitHub 星标稳定

学习与参考资源

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. 这些资源可单独访问，不参与主要排名。

  1. 1

    production-ai-engineering

    智能体
    活跃打开来源 ↗

    Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

    Markdown
    • a2a-protocol
    • agentic-ai
    • ai
    • ai-agents
    • ai-engineering
    github资源实测增长
    1GitHub 星标稳定