工具说明为英文。

LLM 可观测性

LLM 应用的监控、追踪、评估和质量管理。

工具排名

Ranked by normalized popularity across sources. 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

1
agent-kernel
智能体
活跃最近提交：1 天前 · 2026-09-03
The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…
Python许可证: Apache-2.0
- a2a
- adk
- ai-agents
- aws
- azure
github13 个月前创建实测增长打开来源 ↗
166GitHub 星标+29 (+21.2 %)
2
VeriRun
其他
活跃最近提交：2 天前 · 2026-09-02
Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.
Python许可证: Apache-2.0
- benchmark
- kubernetes
- llm-evaluation
- llm-infrastructure
- ray
github44 天前创建实测增长打开来源 ↗
163GitHub 星标+47 (+40.5 %)
3
craft-skills
技能
活跃最近提交：13 天前 · 2026-08-22
Research-backed, eval-driven skills for AI agents
Python许可证: Apache-2.0
- agent-skills
- ai-agents
- codex
- design
- evals
github32 天前创建实测增长打开来源 ↗
安装 git clone https://github.com/ZSeven-W/craft-skills ~/.claude/skills/craft-skills
145GitHub 星标+14 (+10.7 %)
4
dynatrace-for-ai
技能
活跃最近提交：4 天前 · 2026-08-31
Skills, prompts, and instructions for building AI agents on top of Dynatrace production context
JavaScript许可证: Apache-2.0
- agent-skills
- ai-agents
- claude-code
- devops
- dql
github5 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai
135GitHub 星标+4 (+3.1 %)
5
adlc-team-skills
技能
活跃最近提交：1 天前 · 2026-09-03
🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams
Shell许可证: MIT
- adr
- agent-skills
- agentic-sdlc
- ai-coding
- developer-tools
github46 天前创建实测增长打开来源 ↗
安装 git clone https://github.com/tikalk/adlc-team-skills ~/.claude/skills/adlc-team-skills
132GitHub 星标+1 (+0.76 %)
6
suede-creator-skills
MCP
活跃最近提交：今天 · 2026-09-03
74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…
JavaScript许可证: MIT
- agent-orchestration
- agent-skill
- agent-skills
- ai-agents
- ai-coding
github3 个月前创建实测增长打开来源 ↗
129GitHub 星标-4 (-3.0 %)
7
langfuse-mcp
MCP
活跃最近提交：9 天前 · 2026-08-26
A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability
Python许可证: MIT
- agent-skills
- ai-agents
- claude-code
- codex
- developer-tools
github17 个月前创建实测增长打开来源 ↗
105GitHub 星标稳定
8
altk-evolve
MCP
活跃最近提交：2 天前 · 2026-09-02
Self improving agents through iterations
Python许可证: Apache-2.0
- agent-learning
- agent-memory
- agentic-workflows
- ai-agents
- claude-code
github8 个月前创建实测增长打开来源 ↗
105GitHub 星标+1 (+0.96 %)
9
opentelemetry-agent-skills
技能
活跃最近提交：1 天前 · 2026-09-03
Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources
Shell许可证: Apache-2.0
- agent-skills
- ai
- observability
- opentelemetry
github6 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills
97GitHub 星标+1 (+1.0 %)
10
com.pulsemcp/langfuse
MCP
活跃最近提交：5 天前 · 2026-08-30
MCP server for Langfuse LLM observability — trace and observation analysis.
TypeScript许可证: MIT
mcp16 个月前创建实测增长打开来源 ↗
安装 claude mcp add langfuse -- npx langfuse-observability-mcp-server
80GitHub 星标+2 (+2.6 %)
11
skill-kit
技能
活跃最近提交：4 天前 · 2026-08-31
local-first analytics for AI agent skills
TypeScript
- agent-skills
- analytics
- bun
- claude-code
- cli
github6 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit
77GitHub 星标+1 (+1.3 %)
12
deslop-GPT
技能
活跃最近提交：1 天前 · 2026-09-03
Deletion-first Agent Skill for removing test bloat, verification theater, and speculative fallbacks while preserving behavior.
Python许可证: MIT
- agent-skills
- claude
- claude-ai
- claude-code
- claude-skills
github11 天前创建最新实测增长打开来源 ↗
安装 git clone https://github.com/MrZoyo/deslop-GPT ~/.claude/skills/deslop-GPT
76GitHub 星标+48 (+171.4 %)
13
skill-eval-harness
技能
活跃最近提交：4 天前 · 2026-08-31
Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters
Python许可证: MIT
- agent-skills
- evals
- python
- skills
github2 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness
73GitHub 星标+4 (+5.8 %)
14
AgentX-Python
其他
活跃最近提交：2 天前 · 2026-09-02
AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.
Python许可证: Apache-2.0
- a2a
- agent
- agent-monitoring
- evaluation
- mcp
github2 年前创建实测增长打开来源 ↗
68GitHub 星标稳定
15
seo-skill-bench
技能
活跃最近提交：13 天前 · 2026-08-21
Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
JavaScript许可证: MIT
- aeo
- agent-skills
- ai
- ai-seo
- benchmark
github2 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/aleclindz/seo-skill-bench ~/.claude/skills/seo-skill-bench
51GitHub 星标-5 (-8.9 %)
16
nora
MCP
活跃最近提交：1 天前 · 2026-09-03
Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.
TypeScript许可证: Apache-2.0
- agent-management
- agent-ops
- agent-orchestration
- ai-agent-platform
- ai-agents
github5 个月前创建实测增长打开来源 ↗
50GitHub 星标+2 (+4.2 %)
17
arize-skills
技能
活跃最近提交：7 天前 · 2026-08-28
Agent skills for Arize — datasets, experiments, and traces via the ax CLI
Python许可证: MIT
- agent-skills
- ai-agents
- ai-observability
- arize
- claude-code
github6 个月前创建实测增长打开来源 ↗
安装 git clone https://github.com/Arize-ai/arize-skills ~/.claude/skills/arize-skills
47GitHub 星标稳定
18
cap-evolve
MCP
活跃最近提交：8 天前 · 2026-08-27
Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
Python许可证: Apache-2.0
- agent-optimization
- agent-skills
- agentic-ai
- ai-agents
- claude
github2 个月前创建估算动量打开来源 ↗
47GitHub 星标—
19
mini-program-engineering-skill-suite
技能
活跃最近提交：3 天前 · 2026-09-01
Mini Program Engineering Skill Suite is an Agent Skill suite for evidence‑first mini‑program development. It helps agents bring WeChat or other mini‑program projects from vague intent to reliable engineering work: project intake, product…
Python许可证: MIT
- agent-skills
- ai-agents
- alipay
- ci-cd
- claude-code
github22 天前创建最新实测增长打开来源 ↗
安装 git clone https://github.com/NocodeMrLi/mini-program-engineering-skill-suite ~/.claude/skills/mini-program-engineering-skill-suite
43GitHub 星标+4 (+10.3 %)
20
claudestat
技能
活跃最近提交：2 天前 · 2026-09-02
Real-time execution trace and cost intelligence for Claude Code
TypeScript许可证: MIT
- agentic-workflow
- ai-productivity
- anthropic
- anthropic-claude
- claude
github4 个月前创建实测增长打开来源 ↗
安装 /plugin marketplace add DeibyGS/claudestat
34GitHub 星标稳定
21
bar-observatory
MCP
活跃最近提交：7 天前 · 2026-08-27
Deterministic, local-only audit reports for Claude Code AI agent sessions. Rust + SQLite. Zero network calls. MCP server for agents.
HTML许可证: MIT
- agent-monitoring
- agentic-ai
- ai-agents
- ai-engineering
- audit
github22 天前创建最新实测增长打开来源 ↗
22GitHub 星标+2 (+10.0 %)
22
untell
其他
活跃最近提交：1 天前 · 2026-09-03
AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…
Python许可证: MIT
- ai-detection
- ai-detector
- benchmark
- claude-code
- claude-code-skill
github2 个月前创建实测增长打开来源 ↗
18GitHub 星标稳定
23
rashomon
技能
活跃最近提交：4 天前 · 2026-08-30
Measure prompt and skill improvements with blind A/B comparison.
Python许可证: MIT
- agent-skills
- ai-tools
- claude-code
- claude-code-plugin
- claude-code-skill
github7 个月前创建实测增长打开来源 ↗
安装 /plugin marketplace add shinpr/rashomon
18GitHub 星标稳定

学习与参考资源

Ranked by normalized popularity across sources. 这些资源可单独访问，不参与主要排名。

1
awesome-agentic-devops
MCP
活跃最近提交：1 天前 · 2026-09-03打开来源 ↗
Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.
Python许可证: MIT
- agent-skills
- agentic-ai
- agentic-devops
- ai-agents
- awesome
github1 天前活跃2 个月前创建资源实测增长
77GitHub 星标稳定
2
awesome-llm-observability
技能
活跃最近提交：4 天前 · 2026-08-31打开来源 ↗
50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.
Python
- ai-agents
- ai-engineering
- ai-observability
- awesome
- awesome-list
github
安装 git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability
4 天前活跃2 个月前创建资源实测增长
33GitHub 星标+3 (+10.0 %)

LLM 可观测性

用途

活跃度

排序方式

工具排名

agent-kernel

VeriRun

craft-skills

dynatrace-for-ai

adlc-team-skills

suede-creator-skills

langfuse-mcp

altk-evolve

opentelemetry-agent-skills

com.pulsemcp/langfuse

skill-kit

deslop-GPT

skill-eval-harness

AgentX-Python

seo-skill-bench

nora

arize-skills

cap-evolve

mini-program-engineering-skill-suite

claudestat

bar-observatory

untell

rashomon

学习与参考资源

awesome-agentic-devops

awesome-llm-observability