Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

121

Werkzeug-Rangliste

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Sonstige
    Aktiv

    Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  2. 2
    Aktiv

    Agent 降智检测与自愈公评网络 — an immune system for the AI agent society

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  3. 3
    Aktiv

    Skill instalable para Claude Code que mide si tu agente cumple las reglas establecidas. Lee el historial de sesiones de tu disco y devuelve un porcentaje por regla de cumplimiento. Sin instalar nada, sin red, biblioteca estándar.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add jleonceo/skill-adherencia-reglas

    1GitHub-Sternestabil
  4. 4
    Aktiv

    Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  5. 5

    Agent
    Aktiv

    A lightweight Python library that decouples agentic runtime from applications it builds

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  6. 6
    Aktiv

    Vendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  7. 7
    Ruhend

    A safety-first multi-agent mental health companion with real-time distress tracking, triple-layer guardrails, and evidence-based grounding techniques. Built for Kaggle × Google Agents Intensive 2025 Capstone (Agents for Good Track)

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  8. 8
    Aktiv

    Mide si tu agente de IA cumple las reglas que le escribiste. Lee el historial local de Claude Code y devuelve un porcentaje por regla. Sin instalar nada, sin red, biblioteca estándar.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/jleonceo/adherencia-reglas ~/.claude/skills/adherencia-reglas

    1GitHub-Sternestabil
  9. 9

    Skill
    Aktiv

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub-Sternestabil
  10. 10
    Aktiv

    Run many AIs on one board and keep control of all of it. Deterministic code decides who acts — never a model. A privacy floor keeps sensitive work on your machine, your own tests decide what counts as done, and every action lands on a…

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/sandhusukhdeep2/sc-prism-releases ~/.claude/skills/sc-prism-releases

    1GitHub-Sternestabil
  11. 11

    Agent
    Ruhend

    AgentOps: Multi-agent infrastructure remediation platform. A2A protocol, agent coordination, HITL approval, auto-rollback.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  12. 12
    Aktiv

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    mcpgemessenes WachstumQuelle öffnen ↗

    Installieren claude mcp add ai-guardian -- uvx ai-guardian-aiops

    0GitHub-Sternestabil
  13. 13

    Sonstige
    Aktiv

    🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架,通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  14. 14

    Agent
    Aktiv

    面向长程研发任务的 Java Agent Harness,支持 A2A 跨语言协作、可恢复执行、上下文工程与 Eval 驱动开发。

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  15. 15
    Ruhend

    A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  16. 16
    Aktiv

    AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  17. 17
    Ruhend

    An AI-powered multi-agent system that demonstrates clinical triage, OTC medication recommendations, and e-pharmacy integration for respiratory conditions. Built with modular agents that collaborate to provide safe, intelligent healthcare…

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  18. 18
    Ruhend

    OpenTelemetry semantic conventions and instrumentation for agent provenance, derivation lineage, and acceptance criteria evaluation. Fills the Microsoft AI stack observability gap.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  19. 19
    Aktiv

    Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  20. 20

    Agent
    Ruhend

    Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil

Lern- und Referenzressourcen

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

  1. 1
    AktivQuelle öffnen ↗

    Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

    githubRessourcegemessenes Wachstum
    1GitHub-Sternestabil