Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

117

Werkzeug-Rangliste

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    MCP
    Aktiv

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    • agent-to-agent
    • ai-gateway
    • api-gateway
    • apis-json
    • cncf

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  2. 2

    Skill
    Ruhend

    🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

    Lizenz: MIT
    • agent-debugging
    • ai-agents
    • claude-skills
    • claude-skills-creator
    • claude-skills-hub

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/OthmanAdi/langsmith-fetch-skill ~/.claude/skills/langsmith-fetch-skill

    27GitHub-Sternestabil
  3. 3

    Agent
    Ruhend

    Policy-enforced observability and fail-closed guardrails for MCP/A2A multi-agent systems.

    Rust
    • a2a
    • ai-agents
    • llm-security
    • mcp
    • multi-agent

    githubgemessenes WachstumQuelle öffnen ↗

    26GitHub-Sternestabil
  4. 4

    Agent
    Ruhend

    OpenTelemetry semantic conventions and instrumentation for agent provenance, derivation lineage, and acceptance criteria evaluation. Fills the Microsoft AI stack observability gap.

    Python
    • a2a-protocol
    • agentic-ai
    • ai-agents
    • observability
    • opentelemetry

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  5. 5

    Skill
    Aktiv

    Sentry instrumentation skill for system-behavior tracking

    ShellLizenz: MIT
    • agent-skills
    • claude-skills
    • codex-skill
    • instrumentation
    • monitoring

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation

    24GitHub-Sternestabil
  6. 6

    MCP
    Aktiv

    Deterministic, local-only audit reports for Claude Code AI agent sessions. Rust + SQLite. Zero network calls. MCP server for agents.

    HTMLLizenz: MIT
    • agent-monitoring
    • agentic-ai
    • ai-agents
    • ai-engineering
    • audit

    githubgemessenes WachstumQuelle öffnen ↗

    22GitHub-Sterne+2 (+10.0 %)
  7. 7

    MCP
    Aktiv

    Log Claude Code sessions to Opik, the open-source LLM observability and evaluation platform, built by Comet. Tracing, evaluation, and skills for observable AI applications.

    GoLizenz: Apache-2.0
    • ai-agent
    • claude-ai
    • claude-code-plugin
    • llm-observation
    • mcp-server

    githubgemessenes WachstumQuelle öffnen ↗

    22GitHub-Sterne+1 (+4.8 %)
  8. 8

    MCP
    Aktiv

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    PythonLizenz: MIT

      mcpgemessenes WachstumQuelle öffnen ↗

      Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

      0GitHub-Sternestabil
    • 9

      Sonstige
      Aktiv

      AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

      PythonLizenz: MIT
      • ai-detection
      • ai-detector
      • benchmark
      • claude-code
      • claude-code-skill

      githubgemessenes WachstumQuelle öffnen ↗

      18GitHub-Sternestabil
    • 10

      Skill
      Aktiv

      Measure prompt and skill improvements with blind A/B comparison.

      PythonLizenz: MIT
      • agent-skills
      • ai-tools
      • claude-code
      • claude-code-plugin
      • claude-code-skill

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add shinpr/rashomon

      18GitHub-Sternestabil
    • 11

      Skill
      Aktiv

      Two Claude Code skills for adversarial code review (single-model PAR and multi-model MMAR with cross-critique to catch hallucinations), plus a fixture-based eval suite.

      Python
      • ai-agents
      • claude-code-plugin
      • code-review
      • evals
      • python

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add prime-radiant-inc/parallel-adversarial-review

      17GitHub-Sternestabil
    • 12

      Skill
      Aktiv

      Make Claude write clearly, for everyone.

      PythonLizenz: 0BSD
      • claude-code
      • claude-code-plugin
      • controlled-language
      • llm-evaluation
      • output-style

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add stefanobaghino/simple-output-styles

      16GitHub-Sternestabil
    • 13

      Agent
      Ruhend

      AgentOps: Multi-agent infrastructure remediation platform. A2A protocol, agent coordination, HITL approval, auto-rollback.

      PythonLizenz: MIT
      • a2a-protocol
      • ai
      • automation
      • infrastructure
      • llm

      githubgemessenes WachstumQuelle öffnen ↗

      0GitHub-Sternestabil
    • 14

      Sonstige
      Aktiv

      A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

      GoLizenz: Apache-2.0
      • a2a
      • agents
      • ai
      • containerized
      • docker

      githubgemessenes WachstumQuelle öffnen ↗

      14GitHub-Sterne+1 (+7.7 %)
    • 15

      Skill
      Aktiv

      Claude Code plugin marketplace — agentic-engineering (spec-driven shape→decide→execute→measure→eval with adversarial review) + github-keeper (audit/elevate READMEs and make a repo open-source-ready).

      PythonLizenz: MIT
      • adr
      • agentic-engineering
      • ai-agents
      • anthropic
      • claude-code

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add GiustoPiedimonte/agentic-engineering-marketplace

      13GitHub-Sternestabil
    • 16

      Skill
      Aktiv

      Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

      ShellLizenz: MIT
      • ai-workflow-observability
      • claude-code
      • claude-code-hooks
      • claude-code-skill
      • claude-code-skills

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

      1GitHub-Sternestabil
    • 17

      Sonstige
      Ruhend

      A Claude Code skill that adds a rubric-based eval layer to any agent project. Framework-agnostic — generates rubric, test cases, judge prompt, and harness. Returns a weighted score plus a judge-leniency signal.

      HTML
      • agent-evaluation
      • anthropic
      • claude-code
      • claude-code-skill
      • evals

      githubgemessenes WachstumQuelle öffnen ↗

      13GitHub-Sternestabil
    • 18

      MCP
      Aktiv

      Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

      ↓ 32 Downloads/WocheTypeScriptLizenz: MIT

        mcpgemessenes WachstumQuelle öffnen ↗

        Installieren claude mcp add mcp-server -- npx @spanlens/mcp-server

        12GitHub-Sternestabil
      • 19

        Agent
        Aktiv

        Provide clear documentation for AgentStack’s MCP protocol, plugins, and ecosystem API with usage examples and tool references.

        • a2a
        • anthropic
        • claude-code
        • crewai
        • deep-learning

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil
      • 20

        Skill
        Aktiv

        Production-grade AI coding rules for Cursor and Claude Code. 15 rules + 9 doc templates + skills + agents + MCP setup. Drop into any project.

        PythonLizenz: MIT
        • ai-agents
        • ai-coding
        • ai-development
        • ai-engineer
        • automation

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren git clone https://github.com/aiagentwithdhruv/ai-dev-stack ~/.claude/skills/ai-dev-stack

        10GitHub-Sterne+1 (+11.1 %)
      • 21

        Sonstige
        Aktiv

        Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

        TypeScript
        • ai-agents
        • claude-code
        • claude-code-skills
        • cli
        • evals

        githubgemessenes WachstumQuelle öffnen ↗

        1GitHub-Sternestabil
      • 22

        Skill
        Aktiv

        Audit which Claude Code skills you actually use — surface dead installs and hallucinated invocations from your session logs.

        TypeScriptLizenz: MIT
        • anthropic
        • audit
        • claude
        • claude-code
        • claude-code-plugin

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add sfrangulov/skill-graveyard

        10GitHub-Sterne+1 (+11.1 %)
      • 23

        Skill
        Aktiv

        Turn one decision into a judged tournament of solutions, then pick the best — a Claude Code skill that generates candidates, auto-derives the rubric, judges independently, and returns a defensible winner.

        JavaScriptLizenz: MIT
        • ai-agents
        • anthropic
        • claude-code
        • claude-code-plugin
        • claude-skill

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add CoriChui/bakeoff

        10GitHub-Sternestabil
      • 24

        Sonstige
        Aktiv

        A Go-native framework for LLM agents, with OpenTelemetry observability built in.

        GoLizenz: Apache-2.0
        • a2a
        • agents
        • ai
        • anthropic
        • bedrock

        githubgemessenes WachstumQuelle öffnen ↗

        10GitHub-Sternestabil
      • 25

        Skill
        Aktiv

        Anchor — the production-grade AGENTS.md template for AI coding agents. 51 sections of battle-tested rules. Keep your agents grounded.

        Lizenz: MIT
        • agent-instructions
        • agents-md
        • ai-agent-instructions
        • ai-coding
        • ai-coding-agent

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren git clone https://github.com/peva3/anchor ~/.claude/skills/anchor

        8GitHub-Sternestabil