LLM observability: tools for developers

Monitoring, traces, evaluation and quality tracking for LLM applications. An entry can appear under several use cases when its topics or description provide several explicit signals.

Use case

Activity

Sort by

74 entries in this view.

Tool ranking

Ranked by measured growth, normalized across sources. Raw values keep their source-specific window, shown under each tool; a change requires at least two snapshots from the last 7 days.

  1. 1

    MCP
    Active

    Deterministic, local-only audit reports for Claude Code AI agent sessions. Rust + SQLite. Zero network calls. MCP server for agents.

    HTMLLicense: MIT
    • agent-monitoring
    • agentic-ai
    • ai-agents
    • ai-engineering
    • audit

    githubmeasured growthOpen source ↗

    22GitHub stars+2 (+10.0 %)
  2. 2

    Skill
    Active

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    ShellLicense: Apache-2.0
    • agent-skills
    • ai
    • observability
    • opentelemetry

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub stars+4 (+4.3 %)
  3. 3

    Skill
    Active

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    JavaScriptLicense: Apache-2.0
    • agent-skills
    • ai-agents
    • claude-code
    • devops
    • dql

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    132GitHub stars+4 (+3.1 %)
  4. 4

    Other
    Active

    A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

    GoLicense: Apache-2.0
    • a2a
    • agents
    • ai
    • containerized
    • docker

    githubmeasured growthOpen source ↗

    14GitHub stars+1 (+7.7 %)
  5. 5

    MCP
    Active

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    TypeScriptLicense: Apache-2.0
    • agent-management
    • agent-ops
    • agent-orchestration
    • ai-agent-platform
    • ai-agents

    githubmeasured growthOpen source ↗

    50GitHub stars+2 (+4.2 %)
  6. 6

    Agent
    Active

    eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

    GoLicense: Apache-2.0
    • cloud-native
    • devops
    • docker
    • ebpf
    • golang

    githubmeasured growthOpen source ↗

    12 068GitHub stars+8 (+0.07 %)
  7. 7

    Skill
    Active

    🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

    MDXLicense: MIT
    • agent-skills
    • agents
    • genai
    • hacktoberfest
    • langfuse

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/langfuse/langfuse-docs ~/.claude/skills/langfuse-docs

    239GitHub stars+3 (+1.3 %)
  8. 8

    Skill
    Active

    Real-time execution trace and cost intelligence for Claude Code

    TypeScriptLicense: MIT
    • agentic-workflow
    • ai-productivity
    • anthropic
    • anthropic-claude
    • claude

    githubmeasured growthOpen source ↗

    Install /plugin marketplace add DeibyGS/claudestat

    34GitHub stars+1 (+3.0 %)
  9. 9

    MCP
    Active

    Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.

    PythonLicense: Apache-2.0
    • agent-optimization
    • agent-skills
    • agentic-ai
    • ai-agents
    • claude

    githubmeasured growthOpen source ↗

    47GitHub stars+1 (+2.2 %)
  10. 10

    Skill
    Active

    Dashboard for monitoring claude code sessions.

    PythonLicense: Apache-2.0
    • agents
    • agentskills
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    githubmeasured growthOpen source ↗

    Install /plugin marketplace add JayantDevkar/claude-code-karma

    323GitHub stars+2 (+0.62 %)
  11. 11

    Skill
    Active

    local-first analytics for AI agent skills

    TypeScript
    • agent-skills
    • analytics
    • bun
    • claude-code
    • cli

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub stars+1 (+1.3 %)
  12. 12

    MCP
    Active

    Self improving agents through iterations

    PythonLicense: Apache-2.0
    • agent-learning
    • agent-memory
    • agentic-workflows
    • ai-agents
    • claude-code

    githubmeasured growthOpen source ↗

    105GitHub stars+1 (+0.96 %)
  13. 13

    Other
    Active

    Open-source observability tool that uses AI agents to self-heal your software

    TypeScriptLicense: Apache-2.0
    • ai
    • llm
    • memory
    • observability
    • opentelemetry

    githubmeasured growthOpen source ↗

    1 404GitHub stars+2 (+0.14 %)
  14. 14

    Skill
    Active

    🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams

    ShellLicense: MIT
    • adr
    • agent-skills
    • agentic-sdlc
    • ai-coding
    • developer-tools

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/tikalk/adlc-team-skills ~/.claude/skills/adlc-team-skills

    132GitHub stars+1 (+0.76 %)
  15. 15

    Other
    Active

    AI SRE AgenticOps for Kubernetes and cloud infrastructure.

    Python
    • agenticops
    • ai
    • aiops
    • aisre
    • cloud

    githubmeasured growthOpen source ↗

    782GitHub stars+1 (+0.13 %)
  16. 16

    MCP
    Active

    AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure.

    RustLicense: Apache-2.0
    • a2a
    • ai-agent-framework
    • ai-agents
    • ai-sre
    • aiops

    githubmeasured growthOpen source ↗

    254GitHub stars-3 (-1.2 %)
  17. 17

    Skill
    Active

    🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.

    PythonLicense: GPL-3.0
    • a2a-protocol
    • ag-ui-protocol
    • agent-platform
    • agentic-ai
    • agents

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform

    198GitHub stars-1 (-0.50 %)
  18. 18

    MCP
    Active

    74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

    JavaScriptLicense: MIT
    • agent-orchestration
    • agent-skill
    • agent-skills
    • ai-agents
    • ai-coding

    githubmeasured growthOpen source ↗

    129GitHub stars-4 (-3.0 %)
  19. 19

    MCP
    Active

    A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

    PythonLicense: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • developer-tools

    githubmeasured growthOpen source ↗

    105GitHub starsstable
  20. 20

    Other
    Active

    AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.

    PythonLicense: Apache-2.0
    • a2a
    • agent
    • agent-monitoring
    • evaluation
    • mcp

    githubmeasured growthOpen source ↗

    68GitHub starsstable
  21. 21

    Skill
    Active

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    JavaScriptLicense: MIT
    • aeo
    • agent-skills
    • ai
    • ai-seo
    • benchmark

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/aleclindz/seo-skill-bench ~/.claude/skills/seo-skill-bench

    51GitHub stars-5 (-8.9 %)
  22. 22

    Skill
    Active

    Agent skills for Arize — datasets, experiments, and traces via the ax CLI

    PythonLicense: MIT
    • agent-skills
    • ai-agents
    • ai-observability
    • arize
    • claude-code

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/Arize-ai/arize-skills ~/.claude/skills/arize-skills

    47GitHub starsstable

Learning resources

Ranked by measured growth, normalized across sources. These resources remain available separately and do not take part in the main tool ranking.

  1. 1

    awesome-llm-observability

    Skill
    ActiveOpen source ↗

    50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    Python
    • ai-agents
    • ai-engineering
    • ai-observability
    • awesome
    • awesome-list
    github

    Install git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability

    Resourcemeasured growth
    32GitHub stars+2 (+6.7 %)
  2. 2

    trigger_tree

    Skill
    ActiveOpen source ↗

    Documentation-discovery telemetry for Claude Code — heat/cold maps, health grade, evidence-backed router fixes. 100% local, zero tokens. /tt

    PythonLicense: MIT
    • ai-agents
    • claude-code
    • claude-code-plugin
    • docs-as-code
    • documentation
    github

    Install /plugin marketplace add Hedde/trigger_tree

    Resourcemeasured growth
    14GitHub stars+1 (+7.7 %)
  3. 3

    awesome-agentic-devops

    MCP
    ActiveOpen source ↗

    Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.

    PythonLicense: MIT
    • agent-skills
    • agentic-ai
    • agentic-devops
    • ai-agents
    • awesome
    githubResourcemeasured growth
    77GitHub starsstable