Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

74

Werkzeug-Rangliste

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    MCP
    Aktiv

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    ↓ 32 Downloads/WocheTypeScriptLizenz: MIT

      mcpgemessenes WachstumQuelle öffnen ↗

      Installieren claude mcp add mcp-server -- npx @spanlens/mcp-server

      13GitHub-Sterne+1 (+8.3 %)
    • 2

      Sonstige
      Aktiv

      A Go-native framework for LLM agents, with OpenTelemetry observability built in.

      GoLizenz: Apache-2.0
      • a2a
      • agents
      • ai
      • anthropic
      • bedrock

      githubgemessenes WachstumQuelle öffnen ↗

      10GitHub-Sternestabil
    • 3

      Skill
      Aktiv

      Anchor — the production-grade AGENTS.md template for AI coding agents. 51 sections of battle-tested rules. Keep your agents grounded.

      Lizenz: MIT
      • agent-instructions
      • agents-md
      • ai-agent-instructions
      • ai-coding
      • ai-coding-agent

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/peva3/anchor ~/.claude/skills/anchor

      8GitHub-Sternestabil
    • 4

      Agent
      Aktiv

      MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

      TypeScript
      • a2a
      • agent-governance
      • agent-memory
      • agent-orchestration
      • agent-workflows

      githubgemessenes WachstumQuelle öffnen ↗

      7GitHub-Sternestabil
    • 5

      Agent
      Aktiv

      Amazon Bedrock AgentCore enterprise platform accelerator with AWS CDK, Terraform organization guardrails, MCP/A2A agents, security, memory, and observability.

      PythonLizenz: Apache-2.0
      • a2a-protocol
      • agentcore
      • agentcore-agent
      • agentcore-gateway
      • agentcore-identity

      githubgemessenes WachstumQuelle öffnen ↗

      6GitHub-Sterne+1 (+20.0 %)
    • 6

      Skill
      Aktiv

      Axiom is a curated marketplace of shared plugins for Claude Code and Codex.

      PythonLizenz: MIT
      • agent-skills
      • anthropic
      • claude
      • claude-code
      • claude-code-marketplace

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/netopsengineer/axiom ~/.claude/skills/axiom

      5GitHub-Sternestabil
    • 7

      Skill
      Aktiv

      Marketing Mix Model expert agent plugin for Claude Code - pymc-marketing v0.18.2+

      Python
      • claude-code-agent
      • claude-code-plugin
      • claude-code-skill
      • data-analysis
      • data-analytics

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren /plugin marketplace add Yakoub-ai/agent-mmm

      4GitHub-Sternestabil
    • 8

      MCP
      Aktiv

      Production reliability, benchmarking, and evaluation layer for MCP agent runtimes — protocol negotiation, A2A interop, circuit breakers, connection pooling, adaptive streaming, and autoscaling, with measured throughput/latency and a…

      PythonLizenz: Apache-2.0
      • a2a-protocol
      • agent-to-agent
      • ai-agents
      • async-python
      • autoscaling

      githubgemessenes WachstumQuelle öffnen ↗

      3GitHub-Sternestabil
    • 9

      MCP
      Aktiv

      A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

      Shell
      • a2a
      • agent-framework
      • agentic-ai
      • ai
      • ai-agents

      githubgemessenes WachstumQuelle öffnen ↗

      2GitHub-Sternestabil
    • 10

      Skill
      Aktiv

      Multi-agent quality gate skill for Claude Code that researches, reviews, tests and challenges AI-generated work before the final answer.

      • agentic-coding
      • agentic-workflow
      • ai-agent-skills
      • ai-code-review
      • ai-workflows

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/ma-nucho-pro/supervisor-skill-claude ~/.claude/skills/supervisor-skill-claude

      2GitHub-Sternestabil
    • 11

      Skill
      Aktiv

      Production patterns for agent orchestrators, harnesses, evals, MCP/A2A interoperability, memory, provider routing, and LLM usage metering.

      PythonLizenz: MIT
      • a2a
      • agent-orchestration
      • agent-skills
      • ai-agents
      • developer-tools

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/ssheleg/agent-stack ~/.claude/skills/agent-stack

      2GitHub-Sternestabil
    • 12

      Skill
      Aktiv

      Your LLM reviewer said APPROVE. Did it? A structured verdict contract: prompt rule + parser + exit-code gate in one stdlib file, with the 42 counterexamples that forced every line. Free, MIT.

      PythonLizenz: MIT
      • agent-skills
      • ai-agents
      • ci
      • claude-code
      • claude-code-skills

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/tonydzi/verdict-contract ~/.claude/skills/verdict-contract

      2GitHub-Sternestabil
    • 13

      Skill
      Aktiv

      Description Evidence-driven evaluation, benchmarking, and verified repair for Agent Skills across Codex, Claude Code, Gemini CLI, and Antigravity.

      PythonLizenz: MIT
      • agent-skills
      • agentic-ai
      • ai-agents
      • ai-evaluation
      • ai-safety

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/MaxLaurieHutchinson/skill-evaluation-graph ~/.claude/skills/skill-evaluation-graph

      2GitHub-Sternestabil
    • 14

      Agent
      Aktiv

      The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

      PythonLizenz: Apache-2.0
      • a2a
      • agent-framework
      • ai-agents
      • ai-governance
      • ai-safety

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 15

      Agent
      Aktiv

      Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

      TypeScriptLizenz: MIT
      • agent2agent
      • ai-agents
      • cordis
      • deepseek-harness
      • dsh

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 16

      Sonstige
      Aktiv

      Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

      Python
      • a2a
      • agent-runtime
      • ai-infra
      • deepseek
      • fastapi

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 17

      Agent
      Aktiv

      Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

      TypeScriptLizenz: Apache-2.0
      • a2a
      • agent-evaluation
      • ai-agents
      • benchmark
      • deterministic-replay

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 18

      MCP
      Aktiv

      Vendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.

      PythonLizenz: MIT
      • a2a
      • agent2agent
      • agentic-ai
      • ai-agents
      • clean-architecture

      githubgemessenes WachstumQuelle öffnen ↗

      1GitHub-Sternestabil
    • 19

      Skill
      Aktiv

      Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

      ShellLizenz: MIT
      • ai-workflow-observability
      • claude-code
      • claude-code-hooks
      • claude-code-skill
      • claude-code-skills

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

      1GitHub-Sternestabil
    • 20

      Skill
      Aktiv

      Run many AIs on one board and keep control of all of it. Deterministic code decides who acts — never a model. A privacy floor keeps sensitive work on your machine, your own tests decide what counts as done, and every action lands on a…

      • a2a
      • agent-orchestration
      • agent-skills
      • ai-agents
      • ai-governance

      githubgemessenes WachstumQuelle öffnen ↗

      Installieren git clone https://github.com/sandhusukhdeep2/sc-prism-releases ~/.claude/skills/sc-prism-releases

      1GitHub-Sternestabil
    • 21

      MCP
      Aktiv

      Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

      PythonLizenz: MIT

        mcpgemessenes WachstumQuelle öffnen ↗

        Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

        0GitHub-Sternestabil
      • 22

        Agent
        Aktiv

        面向长程研发任务的 Java Agent Harness，支持 A2A 跨语言协作、可恢复执行、上下文工程与 Eval 驱动开发。

        JavaLizenz: Apache-2.0
        • a2a
        • agentic-ai
        • ai-agents
        • developer-tools
        • evals

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil
      • 23

        MCP
        Aktiv

        AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

        • agent-to-agent
        • ai-gateway
        • api-gateway
        • apis-json
        • cncf

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil
      • 24

        MCP
        Aktiv

        Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

        Python
        • a2a-protocol
        • agentic-ai
        • auditability
        • clean-architecture
        • credit-risk

        githubgemessenes WachstumQuelle öffnen ↗

        0GitHub-Sternestabil