Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

118

Werkzeug-Rangliste

Ranked by creation date, newest first; undated entries come last. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Sonstige
    Aktiv

    Open-source observability tool that uses AI agents to self-heal your software

    githubgemessenes WachstumQuelle öffnen ↗

    1 404GitHub-Sterne+2 (+0.14 %)
  2. 2

    Skill
    Aktiv

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub-Sternestabil
  3. 3
    Aktiv

    74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

    githubgemessenes WachstumQuelle öffnen ↗

    129GitHub-Sterne-4 (-3.0 %)
  4. 4

    Sonstige
    Aktiv

    A Go-native framework for LLM agents, with OpenTelemetry observability built in.

    githubgemessenes WachstumQuelle öffnen ↗

    10GitHub-Sternestabil
  5. 5

    Agent
    Ruhend

    The reliability and interoperability layer for AI agents. A2A-native. MCP-bridged.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  6. 6

    Agent
    Aktiv

    Multi-agent SRE on-call investigator that auto-triages Slack/Discord infrastructure alerts via AWS Bedrock AgentCore, fanning out to specialized agents (CloudWatch, EKS, Slack/Discord scanners) for parallel investigation.

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  7. 7

    Skill
    Ruhend

    Don't make LLMs honest. Make every factual claim auditable. — An LLM Claim Auditing Layer with T1-T7 truth gradients. 98.1% business effectiveness on LiarBench v0.2.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/lc198707/anti-lie ~/.claude/skills/anti-lie

    89GitHub-Sternestabil
  8. 8
    Aktiv

    Two Claude Code skills for adversarial code review (single-model PAR and multi-model MMAR with cross-critique to catch hallucinations), plus a fixture-based eval suite.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add prime-radiant-inc/parallel-adversarial-review

    17GitHub-Sternestabil
  9. 9
    Aktiv

    A test runner for agentskills.io-style AI agent skills

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/darkrishabh/agent-skills-eval ~/.claude/skills/agent-skills-eval

    719GitHub-Sterne+13 (+1.8 %)
  10. 10
    Aktiv

    8 MCP SMB products — standalone AI servers for SMBs: Guardrails, FinOps, Observability, Router, Trust Score, Memory, ThinkSecure, A2A Lite. 37 tools, TNC credits billing.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  11. 11
    Aktiv

    Audit which Claude Code skills you actually use — surface dead installs and hallucinated invocations from your session logs.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add sfrangulov/skill-graveyard

    10GitHub-Sterne+1 (+11.1 %)
  12. 12

    Skill
    Aktiv

    Real-time execution trace and cost intelligence for Claude Code

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add DeibyGS/claudestat

    34GitHub-Sterne+1 (+3.0 %)
  13. 13

    Sonstige
    Ruhend

    A Claude Code skill that adds a rubric-based eval layer to any agent project. Framework-agnostic — generates rubric, test cases, judge prompt, and harness. Returns a weighted score plus a judge-leniency signal.

    githubgemessenes WachstumQuelle öffnen ↗

    13GitHub-Sternestabil
  14. 14
    Aktiv

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    mcpgemessenes WachstumQuelle öffnen ↗

    Installieren claude mcp add mcp-server -- npx @spanlens/mcp-server

    12GitHub-Sternestabil
  15. 15

    Agent
    Ruhend

    Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  16. 16
    Aktiv

    Sentry instrumentation skill for system-behavior tracking

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation

    24GitHub-Sternestabil
  17. 17

    Agent
    Aktiv

    MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

    githubgemessenes WachstumQuelle öffnen ↗

    7GitHub-Sternestabil
  18. 18

    Agent
    Ruhend

    Real-time debugging proxy for Agent2Agent (A2A) multi-agent systems

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  19. 19
    Aktiv

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/yaojingang/yao-meta-skill ~/.claude/skills/yao-meta-skill

    2 577GitHub-Sterne+35 (+1.4 %)
  20. 20
    Aktiv

    Skills, prompts, and instructions for building AI agents on top of Dynatrace production context

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/Dynatrace/dynatrace-for-ai ~/.claude/skills/dynatrace-for-ai

    132GitHub-Sterne+4 (+3.1 %)
  21. 21
    Aktiv

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  22. 22

    Agent
    Aktiv

    Provide clear documentation for AgentStack’s MCP protocol, plugins, and ecosystem API with usage examples and tool references.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  23. 23

    Skill
    Ruhend

    An assembly line for AI software development. 35 skills, 11 agent personas, 29 commands. From raw idea to shipped code.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add aneja5/forge-skills

    3GitHub-Sternestabil
  24. 24

    MCP
    Aktiv

    Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

    githubgemessenes WachstumQuelle öffnen ↗

    50GitHub-Sterne+2 (+4.2 %)

Lern- und Referenzressourcen

Ranked by creation date, newest first; undated entries come last. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

  1. 1
    AktivQuelle öffnen ↗

    Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

    githubRessourcegemessenes Wachstum
    1GitHub-Sternestabil