Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

117

Werkzeug-Rangliste

Gemischte Rangfolge: Gemessenes Wachstum hat Vorrang. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1
    Ruhend

    A self-improving harness router for Claude Code.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add SeongwoongCho/adaptive-harness

    8GitHub-Sternestabil
  2. 2

    Agent
    Aktiv

    The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already…

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  3. 3

    Agent
    Aktiv

    MemroOS / memroos: memory OS and governance layer for AI agents, agent workflows, dispatch, proof, and context continuity.

    githubgemessenes WachstumQuelle öffnen ↗

    7GitHub-Sternestabil
  4. 4
    Aktiv

    Amazon Bedrock AgentCore enterprise platform accelerator with AWS CDK, Terraform organization guardrails, MCP/A2A agents, security, memory, and observability.

    githubgemessenes WachstumQuelle öffnen ↗

    5GitHub-Sterne+1 (+25.0 %)
  5. 5
    Aktiv

    Vendor-neutral OpenTelemetry tracing for A2A agents and MCP services, with W3C context propagation and privacy-safe telemetry.

    githubgemessenes WachstumQuelle öffnen ↗

    1GitHub-Sternestabil
  6. 6

    MCP
    Ruhend

    Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability

    githubgemessenes WachstumQuelle öffnen ↗

    5GitHub-Sternestabil
  7. 7

    Skill
    Aktiv

    Axiom is a curated marketplace of shared plugins for Claude Code and Codex.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/netopsengineer/axiom ~/.claude/skills/axiom

    5GitHub-Sternestabil
  8. 8

    Agent
    Ruhend

    Real-time debugging proxy for Agent2Agent (A2A) multi-agent systems

    githubgemessenes WachstumQuelle öffnen ↗

    3GitHub-Sternestabil
  9. 9

    Skill
    Aktiv

    Deletion-first Agent Skill for removing test bloat, verification theater, and speculative fallbacks while preserving behavior.

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/MrZoyo/deslop-GPT ~/.claude/skills/deslop-GPT

    55GitHub-Sterne+27 (+96.4 %)
  10. 10
    Aktiv

    Mini Program Engineering Skill Suite is an Agent Skill suite for evidence‑first mini‑program development. It helps agents bring WeChat or other mini‑program projects from vague intent to reliable engineering work: project intake, product…

    githubgeschätztes MomentumQuelle öffnen ↗

    Installieren git clone https://github.com/NocodeMrLi/mini-program-engineering-skill-suite ~/.claude/skills/mini-program-engineering-skill-suite

    39GitHub-Sterne
  11. 11

    Skill
    Aktiv

    Agent skills for Arize — datasets, experiments, and traces via the ax CLI

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/Arize-ai/arize-skills ~/.claude/skills/arize-skills

    47GitHub-Sternestabil
  12. 12
    Aktiv

    Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.

    githubgemessenes WachstumQuelle öffnen ↗

    47GitHub-Sterne+1 (+2.2 %)

Lern- und Referenzressourcen

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

  1. 1
    AktivQuelle öffnen ↗

    Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

    githubRessourcegemessenes Wachstum
    1GitHub-Sternestabil
  2. 2
    AktivQuelle öffnen ↗

    50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    github

    Installieren git clone https://github.com/ContextJet-ai/awesome-llm-observability ~/.claude/skills/awesome-llm-observability

    Ressourcegemessenes Wachstum
    32GitHub-Sterne+2 (+6.7 %)
  3. 3
    AktivQuelle öffnen ↗

    My complete journey to becoming an Agentic AI Engineer through structured learning, projects, experiments, and production-ready implementations of modern AI systems.

    githubRessourcegemessenes Wachstum
    18GitHub-Sternestabil
  4. 4
    AktivQuelle öffnen ↗

    Documentation-discovery telemetry for Claude Code — heat/cold maps, health grade, evidence-backed router fixes. 100% local, zero tokens. /tt

    github

    Installieren /plugin marketplace add Hedde/trigger_tree

    Ressourcegemessenes Wachstum
    14GitHub-Sterne+1 (+7.7 %)
  5. 5

    tunelab

    Skill
    AktivQuelle öffnen ↗

    Claude Code plugin for LLM fine-tuning, distillation, and evaluation — decide whether you need fine-tuning at all, distill your LLM logs into small local models (MLX/LoRA), evaluate with held-out discipline, and learn the why at every step.

    github

    Installieren /plugin marketplace add rchaz/tunelab

    Ressourcegemessenes Wachstum
    6GitHub-Sternestabil