Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

117

Werkzeug-Rangliste

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Sonstige
    Aktiv

    AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

    githubgemessenes WachstumQuelle öffnen ↗

    18GitHub-Sternestabil
  2. 2

    Agent
    Ruhend

    Real-time debugging proxy for Agent2Agent (A2A) multi-agent systems

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  3. 3

    Agent
    Ruhend

    Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  4. 4
    Aktiv

    Sentry instrumentation skill for system-behavior tracking

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation

    24GitHub-Sternestabil
  5. 5
    Ruhend

    A self-improving harness router for Claude Code.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add SeongwoongCho/adaptive-harness

    8GitHub-Sternestabil
  6. 6

    Skill
    Aktiv

    Axiom is a curated marketplace of shared plugins for Claude Code and Codex.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/netopsengineer/axiom ~/.claude/skills/axiom

    5GitHub-Sternestabil
  7. 7

    Agent
    Ruhend

    Policy-enforced observability and fail-closed guardrails for MCP/A2A multi-agent systems.

    githubgemessenes WachstumQuelle öffnen ↗

    26GitHub-Sternestabil
  8. 8

    Agent
    Aktiv

    面向长程研发任务的 Java Agent Harness,支持 A2A 跨语言协作、可恢复执行、上下文工程与 Eval 驱动开发。

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  9. 9
    Ruhend

    🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/OthmanAdi/langsmith-fetch-skill ~/.claude/skills/langsmith-fetch-skill

    27GitHub-Sternestabil
  10. 10
    Aktiv

    8 MCP SMB products — standalone AI servers for SMBs: Guardrails, FinOps, Observability, Router, Trust Score, Memory, ThinkSecure, A2A Lite. 37 tools, TNC credits billing.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  11. 11

    Agent
    Ruhend

    AgentOps: Multi-agent infrastructure remediation platform. A2A protocol, agent coordination, HITL approval, auto-rollback.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  12. 12

    Agent
    Aktiv

    Provide clear documentation for AgentStack’s MCP protocol, plugins, and ecosystem API with usage examples and tool references.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  13. 13

    Sonstige
    Aktiv

    AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.

    githubgemessenes WachstumQuelle öffnen ↗

    68GitHub-Sternestabil
  14. 14
    Aktiv

    Production reliability, benchmarking, and evaluation layer for MCP agent runtimes — protocol negotiation, A2A interop, circuit breakers, connection pooling, adaptive streaming, and autoscaling, with measured throughput/latency and a…

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  15. 15
    Aktiv

    Mide si tu agente de IA cumple las reglas que le escribiste. Lee el historial local de Claude Code y devuelve un porcentaje por regla. Sin instalar nada, sin red, biblioteca estándar.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/jleonceo/adherencia-reglas ~/.claude/skills/adherencia-reglas

    1GitHub-Sternestabil
  16. 16

    Skill
    Aktiv

    Real-time execution trace and cost intelligence for Claude Code

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add DeibyGS/claudestat

    34GitHub-Sternestabil
  17. 17
    Aktiv

    Claude Code skills where every entry ships receipts — accuracy-gated benchmarks against baseline and placebo, rejects published

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/sjh9714/skill-receipts ~/.claude/skills/skill-receipts

    2GitHub-Sternestabil
  18. 18

    Agent
    Aktiv

    A2A green-agent orchestrator for evaluating agents on the AppWorld benchmark, built on the AgentBeats SDK

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  19. 19

    Skill
    Aktiv

    A skill creator that proves its skills work. Evidence-driven skill creation for Claude Code and Codex: baseline-tested generation, per-skill regression evals, ecosystem doctor, cross-runtime compile, and an opt-in proactive advisor.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/tripleyak/SkillForge ~/.claude/skills/SkillForge

    885GitHub-Sternestabil
  20. 20

    Skill
    Aktiv

    Turn one decision into a judged tournament of solutions, then pick the best — a Claude Code skill that generates candidates, auto-derives the rubric, judges independently, and returns a defensible winner.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add CoriChui/bakeoff

    10GitHub-Sternestabil
  21. 21
    Aktiv

    Skill instalable para Claude Code que mide si tu agente cumple las reglas establecidas. Lee el historial de sesiones de tu disco y devuelve un porcentaje por regla de cumplimiento. Sin instalar nada, sin red, biblioteca estándar.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add jleonceo/skill-adherencia-reglas

    1GitHub-Sternestabil
  22. 22

    Skill
    Ruhend

    An assembly line for AI software development. 35 skills, 11 agent personas, 29 commands. From raw idea to shipped code.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add aneja5/forge-skills

    3GitHub-Sternestabil
  23. 23
    Aktiv

    Audit which Claude Code skills you actually use — surface dead installs and hallucinated invocations from your session logs.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add sfrangulov/skill-graveyard

    10GitHub-Sternestabil
  24. 24
    Ruhend

    A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  25. 25

    Skill
    Aktiv

    Production-grade AI coding rules for Cursor and Claude Code. 15 rules + 9 doc templates + skills + agents + MCP setup. Drop into any project.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/aiagentwithdhruv/ai-dev-stack ~/.claude/skills/ai-dev-stack

    10GitHub-Sternestabil