Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

117

Werkzeug-Rangliste

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Agent
    Aktiv

    Agent 降智检测与自愈公评网络 — an immune system for the AI agent society

    TypeScriptLizenz: MIT
    • a2a
    • agent
    • agent-guard
    • ai-sre
    • drift-detection

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  2. 2

    Sonstige
    Aktiv

    A Go-native framework for LLM agents, with OpenTelemetry observability built in.

    GoLizenz: Apache-2.0
    • a2a
    • agents
    • ai
    • anthropic
    • bedrock

    githubgemessenes WachstumQuelle öffnen ↗

    10GitHub-Sternestabil
  3. 3

    MCP
    Ruhend

    Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability

    PythonLizenz: MIT
    • a2a
    • a2a-client
    • a2a-server
    • agent-evaluation
    • agentic-ai

    githubgemessenes WachstumQuelle öffnen ↗

    5GitHub-Sternestabil
  4. 4

    Agent
    Aktiv

    Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

    TypeScriptLizenz: Apache-2.0
    • a2a
    • agent-evaluation
    • ai-agents
    • benchmark
    • deterministic-replay

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  5. 5

    Agent
    Aktiv

    Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

    TypeScriptLizenz: MIT
    • agent2agent
    • ai-agents
    • cordis
    • deepseek-harness
    • dsh

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  6. 6

    Skill
    Aktiv

    Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

    • agentic-coding
    • agentic-workflow
    • ai-agent-skills
    • ai-code-review
    • ai-workflows

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

    2GitHub-Sternestabil
  7. 7

    Agent
    Aktiv

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    PythonLizenz: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  8. 8

    Sonstige
    Aktiv

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    Python
    • a2a
    • agent-runtime
    • ai-infra
    • deepseek
    • fastapi

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  9. 9

    Agent
    Aktiv

    Multi-agent SRE on-call investigator that auto-triages Slack/Discord infrastructure alerts via AWS Bedrock AgentCore, fanning out to specialized agents (CloudWatch, EKS, Slack/Discord scanners) for parallel investigation.

    Python
    • a2a-protocol
    • anthropic
    • aws-bedrock
    • aws-lambda
    • bedrock-agentcore

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  10. 10

    MCP
    Aktiv

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    ↓ 32 Downloads/WocheTypeScriptLizenz: MIT

      mcpgemessenes WachstumQuelle öffnen ↗

      Installieren claude mcp add mcp-server -- npx @spanlens/mcp-server

      12GitHub-Sternestabil
    • 11

      MCP
      Aktiv

      Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

      PythonLizenz: MIT

        mcpgemessenes WachstumQuelle öffnen ↗

        Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

        0GitHub-Sternestabil
      • 12

        Agent
        Aktiv

        A lightweight Python library that decouples agentic runtime from applications it builds

        PythonLizenz: MIT
        • a2a
        • agent-runtime
        • agents
        • observability
        • portability

        githubgemessenes WachstumQuelle öffnen ↗

        1GitHub-Sternestabil
      • 13

        Skill
        Aktiv

        Claude Code plugin marketplace — agentic-engineering (spec-driven shape→decide→execute→measure→eval with adversarial review) + github-keeper (audit/elevate READMEs and make a repo open-source-ready).

        PythonLizenz: MIT
        • adr
        • agentic-engineering
        • ai-agents
        • anthropic
        • claude-code

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add GiustoPiedimonte/agentic-engineering-marketplace

        13GitHub-Sternestabil
      • 14

        MCP
        Aktiv

        Self improving agents through iterations

        PythonLizenz: Apache-2.0
        • agent-learning
        • agent-memory
        • agentic-workflows
        • ai-agents
        • claude-code

        githubgemessenes WachstumQuelle öffnen ↗

        104GitHub-Sternestabil
      • 15

        Skill
        Aktiv

        Measure prompt and skill improvements with blind A/B comparison.

        PythonLizenz: MIT
        • agent-skills
        • ai-tools
        • claude-code
        • claude-code-plugin
        • claude-code-skill

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add shinpr/rashomon

        18GitHub-Sternestabil
      • 16

        Sonstige
        Aktiv

        Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

        TypeScript
        • ai-agents
        • claude-code
        • claude-code-skills
        • cli
        • evals

        githubgemessenes WachstumQuelle öffnen ↗

        1GitHub-Sternestabil
      • 17

        Agent
        Ruhend

        The reliability and interoperability layer for AI agents. A2A-native. MCP-bridged.

        PythonLizenz: Apache-2.0
        • a2a
        • agent-framework
        • agents
        • ai
        • ai-safety

        githubgemessenes WachstumQuelle öffnen ↗

        1GitHub-Sternestabil
      • 18

        MCP
        Aktiv

        A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

        Shell
        • a2a
        • agent-framework
        • agentic-ai
        • ai
        • ai-agents

        githubgemessenes WachstumQuelle öffnen ↗

        2GitHub-Sternestabil
      • 19

        Sonstige
        Ruhend

        A Claude Code skill that adds a rubric-based eval layer to any agent project. Framework-agnostic — generates rubric, test cases, judge prompt, and harness. Returns a weighted score plus a judge-leniency signal.

        HTML
        • agent-evaluation
        • anthropic
        • claude-code
        • claude-code-skill
        • evals

        githubgemessenes WachstumQuelle öffnen ↗

        13GitHub-Sternestabil
      • 20

        Agent
        Aktiv

        Local-first control plane for durable, governed agent teams: DAG orchestration, approvals, memory, signed skills, trace contracts, and realtime.

        PythonLizenz: Apache-2.0
        • a2a-protocol
        • agentic-ai
        • ai-agents
        • fastapi
        • llmops

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil
      • 21

        Agent
        Aktiv

        MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

        TypeScript
        • a2a
        • agent-governance
        • agent-memory
        • agent-orchestration
        • agent-workflows

        githubgemessenes WachstumQuelle öffnen ↗

        7GitHub-Sternestabil
      • 22

        Sonstige
        Aktiv

        🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

        PythonLizenz: MIT
        • a2a-protocol
        • agent-framework
        • ai
        • causal-memory
        • event-stream

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil
      • 23

        Skill
        Aktiv

        Make Claude write clearly, for everyone.

        PythonLizenz: 0BSD
        • claude-code
        • claude-code-plugin
        • controlled-language
        • llm-evaluation
        • output-style

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add stefanobaghino/simple-output-styles

        16GitHub-Sternestabil
      • 24

        Skill
        Aktiv

        Marketing Mix Model expert agent plugin for Claude Code - pymc-marketing v0.18.2+

        Python
        • claude-code-agent
        • claude-code-plugin
        • claude-code-skill
        • data-analysis
        • data-analytics

        githubgemessenes WachstumQuelle öffnen ↗

        Installieren /plugin marketplace add Yakoub-ai/agent-mmm

        4GitHub-Sternestabil
      • 25

        Agent
        Aktiv

        The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

        PythonLizenz: Apache-2.0
        • a2a
        • agent-framework
        • ai-agents
        • ai-governance
        • ai-safety

        githubgemessenes WachstumQuelle öffnen ↗

        1GitHub-Sternestabil