Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

121

Werkzeug-Rangliste

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Agent
    Ruhend

    Real-time debugging proxy for Agent2Agent (A2A) multi-agent systems

    Lizenz: MIT
    • a2a
    • agent2agent
    • debugging
    • debugging-tool
    • developer-tools

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  2. 2

    MCP
    Aktiv

    Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

    Python
    • a2a-protocol
    • agentic-ai
    • auditability
    • clean-architecture
    • credit-risk

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  3. 3

    Sonstige
    Aktiv

    AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.

    PythonLizenz: Apache-2.0
    • a2a
    • agent
    • agent-monitoring
    • evaluation
    • mcp

    githubgemessenes WachstumQuelle öffnen ↗

    68GitHub-Sternestabil
  4. 4

    MCP
    Aktiv

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    PythonLizenz: MIT

      mcpgemessenes WachstumQuelle öffnen ↗

      Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

      0GitHub-Sternestabil
    • 5

      Skill
      Ruhend

      A self-improving harness router for Claude Code.

      PythonLizenz: MIT
      • a-b-testing
      • ai-agent
      • ai-orchestration
      • ai-routing
      • ai-workflow

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add SeongwoongCho/adaptive-harness

      8GitHub-Sternestabil
    • 6

      Sonstige
      Ruhend

      Multi-agent customer support system with Google ADK & Gemini 2.5 Flash Lite. Kaggle capstone demonstrating 11+ concepts. Automates 80%+ queries, <10s response time.

      PythonLizenz: MIT
      • a2a-protocol
      • agent-evaluation
      • google-adk
      • multi-agent-system
      • observability

      githubgemessenes WachstumQuelle öffnen ↗

      2GitHub-Sternestabil
    • 7

      Agent
      Aktiv

      MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

      TypeScript
      • a2a
      • agent-governance
      • agent-memory
      • agent-orchestration
      • agent-workflows

      githubgemessenes WachstumQuelle öffnen ↗

      7GitHub-Sternestabil
    • 8

      MCP
      Aktiv

      Vendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.

      PythonLizenz: MIT
      • a2a
      • agent2agent
      • agentic-ai
      • ai-agents
      • clean-architecture

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 9

      Agent
      Aktiv

      The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

      PythonLizenz: Apache-2.0
      • a2a
      • agent-framework
      • ai-agents
      • ai-governance
      • ai-safety

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 10

      Agent
      Ruhend

      Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

      PythonLizenz: MIT
      • a2a
      • agents
      • contracts
      • evaluation
      • llm

      githubgemessenes WachstumQuelle öffnen ↗

      0GitHub-Sternestabil
    • 11

      Skill
      Aktiv

      The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

      Go
      • agent-skills
      • ai
      • cloud-native
      • cncf
      • devops

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/kubesphere/kubesphere ~/.claude/skills/kubesphere

      17 035GitHub-Sternestabil
    • 12

      Skill
      Aktiv

      Real-time execution trace and cost intelligence for Claude Code

      TypeScriptLizenz: MIT
      • agentic-workflow
      • ai-productivity
      • anthropic
      • anthropic-claude
      • claude

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add DeibyGS/claudestat

      34GitHub-Sternestabil
    • 13

      Agent
      Aktiv

      A lightweight Python library that decouples agentic runtime from applications it builds

      PythonLizenz: MIT
      • a2a
      • agent-runtime
      • agents
      • observability
      • portability

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 14

      Agent
      Aktiv

      A2A green-agent orchestrator for evaluating agents on the AppWorld benchmark, built on the AgentBeats SDK

      Python
      • a2a-protocol
      • agentbeats
      • appworld
      • evaluation
      • llm-agents

      githubgemessenes WachstumQuelle öffnen ↗

      0GitHub-Sternestabil
    • 15

      Agent
      Ruhend

      A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

      Python
      • a2a
      • agent-to-agent
      • ai-agents
      • conversational-ai
      • llm-evaluation

      githubgemessenes WachstumQuelle öffnen ↗

      0GitHub-Sternestabil
    • 16

      Skill
      Ruhend

      🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

      Lizenz: MIT
      • agent-debugging
      • ai-agents
      • claude-skills
      • claude-skills-creator
      • claude-skills-hub

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/OthmanAdi/langsmith-fetch-skill ~/.claude/skills/langsmith-fetch-skill

      27GitHub-Sternestabil
    • 17

      Sonstige
      Aktiv

      🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

      PythonLizenz: MIT
      • a2a-protocol
      • agent-framework
      • ai
      • causal-memory
      • event-stream

      githubgemessenes WachstumQuelle öffnen ↗

      0GitHub-Sternestabil
    • 18

      Agent
      Ruhend

      Policy-enforced observability and fail-closed guardrails for MCP/A2A multi-agent systems.

      Rust
      • a2a
      • ai-agents
      • llm-security
      • mcp
      • multi-agent

      githubgemessenes WachstumQuelle öffnen ↗

      26GitHub-Sternestabil
    • 19

      Sonstige
      Aktiv

      Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

      TypeScript
      • ai-agents
      • claude-code
      • claude-code-skills
      • cli
      • evals

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 20

      MCP
      Ruhend

      Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability

      PythonLizenz: MIT
      • a2a
      • a2a-client
      • a2a-server
      • agent-evaluation
      • agentic-ai

      githubgemessenes WachstumQuelle öffnen ↗

      5GitHub-Sternestabil
    • 21

      Skill
      Aktiv

      Turn one decision into a judged tournament of solutions, then pick the best — a Claude Code skill that generates candidates, auto-derives the rubric, judges independently, and returns a defensible winner.

      JavaScriptLizenz: MIT
      • ai-agents
      • anthropic
      • claude-code
      • claude-code-plugin
      • claude-skill

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add CoriChui/bakeoff

      10GitHub-Sternestabil
    • 22

      Agent
      Aktiv

      Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

      TypeScriptLizenz: Apache-2.0
      • a2a
      • agent-evaluation
      • ai-agents
      • benchmark
      • deterministic-replay

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 23

      Skill
      Aktiv

      Sentry instrumentation skill for system-behavior tracking

      ShellLizenz: MIT
      • agent-skills
      • claude-skills
      • codex-skill
      • instrumentation
      • monitoring

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation

      24GitHub-Sternestabil
    • 24

      MCP
      Aktiv

      A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

      PythonLizenz: MIT
      • agent-skills
      • ai-agents
      • claude-code
      • codex
      • developer-tools

      githubgemessenes WachstumQuelle öffnen ↗

      105GitHub-Sternestabil
    • 25

      Agent
      Ruhend

      A Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.

      PythonLizenz: Apache-2.0
      • a2a-protocol
      • agent-evaluation
      • agentbeats
      • ai-agents
      • benchmarks

      githubgemessenes WachstumQuelle öffnen ↗

      2GitHub-Sternestabil