Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

76

Werkzeug-Rangliste

Gemischte Rangfolge: Gemessenes Wachstum hat Vorrang. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Sonstige
    Aktiv

    A Go-native framework for LLM agents, with OpenTelemetry observability built in.

    githubgemessenes WachstumQuelle öffnen ↗

    10GitHub-Sternestabil
  2. 2
    Aktiv

    Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  3. 3

    Skill
    Aktiv

    Marketing Mix Model expert agent plugin for Claude Code - pymc-marketing v0.18.2+

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add Yakoub-ai/agent-mmm

    4GitHub-Sternestabil
  4. 4
    Aktiv

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    mcpgemessenes WachstumQuelle öffnen ↗

    Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

    0GitHub-Sternestabil
  5. 5

    Agent
    Aktiv

    Local-first control plane for durable, governed agent teams: DAG orchestration, approvals, memory, signed skills, trace contracts, and realtime.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  6. 6
    Aktiv

    Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  7. 7

    Skill
    Aktiv

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub-Sternestabil
  8. 8

    Agent
    Aktiv

    Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  9. 9
    Aktiv

    Vendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  10. 10

    MCP
    Aktiv

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    githubgemessenes WachstumQuelle öffnen ↗

    50GitHub-Sterne+2 (+4.2 %)
  11. 11

    Skill
    Aktiv

    Real-time execution trace and cost intelligence for Claude Code

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add DeibyGS/claudestat

    34GitHub-Sternestabil
  12. 12

    Agent
    Aktiv

    The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  13. 13

    Sonstige
    Aktiv

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  14. 14
    Aktiv

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  15. 15
    Aktiv

    Deterministic, local-only audit reports for Claude Code AI agent sessions. Rust + SQLite. Zero network calls. MCP server for agents.

    githubgemessenes WachstumQuelle öffnen ↗

    22GitHub-Sterne+2 (+10.0 %)
  16. 16

    MCP
    Aktiv

    A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

    githubgemessenes WachstumQuelle öffnen ↗

    2GitHub-Sternestabil
  17. 17

    Sonstige
    Aktiv

    AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

    githubgemessenes WachstumQuelle öffnen ↗

    18GitHub-Sternestabil
  18. 18
    Aktiv

    Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

    2GitHub-Sternestabil
  19. 19

    Skill
    Aktiv

    Measure prompt and skill improvements with blind A/B comparison.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add shinpr/rashomon

    18GitHub-Sternestabil
  20. 20

    Skill
    Aktiv

    Production patterns for agent orchestrators, harnesses, evals, MCP/A2A interoperability, memory, provider routing, and LLM usage metering.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/ssheleg/agent-stack ~/.claude/skills/agent-stack

    2GitHub-Sterne+1 (+100.0 %)
  21. 21

    Skill
    Aktiv

    Deletion-first Agent Skill for removing test bloat, verification theater, and speculative fallbacks while preserving behavior.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/MrZoyo/deslop-GPT ~/.claude/skills/deslop-GPT

    76GitHub-Sterne+48 (+171.4 %)
  22. 22
    Aktiv

    Mini Program Engineering Skill Suite is an Agent Skill suite for evidence‑first mini‑program development. It helps agents bring WeChat or other mini‑program projects from vague intent to reliable engineering work: project intake, product…

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/NocodeMrLi/mini-program-engineering-skill-suite ~/.claude/skills/mini-program-engineering-skill-suite

    43GitHub-Sterne+4 (+10.3 %)
  23. 23
    Aktiv

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    githubgeschätztes MomentumQuelle öffnen ↗

    Installieren git clone https://github.com/FrancyJGLisboa/agent-skills-platform ~/.claude/skills/agent-skills-platform

    2 376GitHub-Sterne

Lern- und Referenzressourcen

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

  1. 1
    AktivQuelle öffnen ↗

    Documentation-discovery telemetry for Claude Code — heat/cold maps, health grade, evidence-backed router fixes. 100% local, zero tokens. /tt

    github

    Installieren /plugin marketplace add Hedde/trigger_tree

    Ressourcegemessenes Wachstum
    14GitHub-Sterne+1 (+7.7 %)
  2. 2
    AktivQuelle öffnen ↗

    50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    github

    Installieren git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability

    Ressourcegemessenes Wachstum
    33GitHub-Sterne+3 (+10.0 %)