Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

117

Werkzeug-Rangliste

Gemischte Rangfolge: Gemessenes Wachstum hat Vorrang. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Agent
    Ruhend

    A Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.

    PythonLizenz: Apache-2.0
    • a2a-protocol
    • agent-evaluation
    • agentbeats
    • ai-agents
    • benchmarks

    githubgemessenes WachstumQuelle öffnen ↗

    2GitHub-Sternestabil
  2. 2

    MCP
    Aktiv

    A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

    PythonLizenz: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • developer-tools

    githubgemessenes WachstumQuelle öffnen ↗

    105GitHub-Sternestabil
  3. 3

    Sonstige
    Ruhend

    Multi-agent customer support system with Google ADK & Gemini 2.5 Flash Lite. Kaggle capstone demonstrating 11+ concepts. Automates 80%+ queries, <10s response time.

    PythonLizenz: MIT
    • a2a-protocol
    • agent-evaluation
    • google-adk
    • multi-agent-system
    • observability

    githubgemessenes WachstumQuelle öffnen ↗

    2GitHub-Sternestabil
  4. 4

    MCP
    Aktiv

    Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

    Python
    • a2a-protocol
    • agentic-ai
    • auditability
    • clean-architecture
    • credit-risk

    githubgemessenes WachstumQuelle öffnen ↗

    0GitHub-Sternestabil
  5. 5

    Skill
    Aktiv

    The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

    Go
    • agent-skills
    • ai
    • cloud-native
    • cncf
    • devops

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/kubesphere/kubesphere ~/.claude/skills/kubesphere

    17 035GitHub-Sternestabil
  6. 6

    Skill
    Ruhend

    Two Claude Code skills for adversarial code review (single-model PAR and multi-model MMAR with cross-critique to catch hallucinations), plus a fixture-based eval suite.

    Python
    • ai-agents
    • claude-code-plugin
    • code-review
    • evals
    • python

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add prime-radiant-inc/parallel-adversarial-review

    17GitHub-Sternestabil
  7. 7

    Skill
    Aktiv

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    PythonLizenz: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/FrancyJGLisboa/agent-skills-platform ~/.claude/skills/agent-skills-platform

    2 376GitHub-Sternestabil
  8. 8

    Skill
    Aktiv

    Run many AIs on one board and keep control of all of it. Deterministic code decides who acts — never a model. A privacy floor keeps sensitive work on your machine, your own tests decide what counts as done, and every action lands on a…

    • a2a
    • agent-orchestration
    • agent-skills
    • ai-agents
    • ai-governance

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/sandhusukhdeep2/sc-prism-releases ~/.claude/skills/sc-prism-releases

    1GitHub-Sternestabil
  9. 9

    Skill
    Aktiv

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    ShellLizenz: MIT
    • ai-workflow-observability
    • claude-code
    • claude-code-hooks
    • claude-code-skill
    • claude-code-skills

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1GitHub-Sternestabil
  10. 10

    Sonstige
    Aktiv

    Self-hosted AI SRE for Kubernetes — zero-instrumentation eBPF observability plus a copilot that fixes issues through guardrailed, self-verifying actions. BYO-LLM, air-gapped capable.

    GoLizenz: Apache-2.0
    • ai-agent
    • aiops
    • clickhouse
    • devops
    • ebpf

    githubgemessenes WachstumQuelle öffnen ↗

    131GitHub-Sterne-4 (-3.0 %)
  11. 11

    MCP
    Aktiv

    74 open-source Agent Skills for Claude Code and Codex: AI SEO, AEO and GEO, code review with an A-F ship grade, CI gates, AI evals, design systems, conversion copy, Instagram growth, iOS and Android app shipping, creator rights, and…

    JavaScriptLizenz: MIT
    • agent-orchestration
    • agent-skill
    • agent-skills
    • ai-agents
    • ai-coding

    githubgemessenes WachstumQuelle öffnen ↗

    129GitHub-Sterne-4 (-3.0 %)
  12. 12

    Sonstige
    Aktiv

    Open-source observability tool that uses AI agents to self-heal your software

    TypeScriptLizenz: Apache-2.0
    • ai
    • llm
    • memory
    • observability
    • opentelemetry

    githubgeschätztes MomentumQuelle öffnen ↗

    1 404GitHub-Sterne—

Lern- und Referenzressourcen

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

  1. 1

    Agentic_AI_Engineer

    Agent
    AktivQuelle öffnen ↗

    My complete journey to becoming an Agentic AI Engineer through structured learning, projects, experiments, and production-ready implementations of modern AI systems.

    Jupyter NotebookLizenz: MIT
    • a2a-protocol
    • agent-orchestration
    • ai-guardrails
    • fastapi
    • kubernetes
    githubRessourcegemessenes Wachstum
    18GitHub-Sternestabil
  2. 2

    awesome-agentic-devops

    MCP
    AktivQuelle öffnen ↗

    Curated + scored map of official MCP servers and agents for DevOps, Cloud, SRE, and Platform Engineering — every entry rated on production access, approval gates, and audit evidence.

    PythonLizenz: MIT
    • agent-skills
    • agentic-ai
    • agentic-devops
    • ai-agents
    • awesome
    githubRessourcegemessenes Wachstum
    77GitHub-Sternestabil
  3. 3

    production-ai-engineering

    Agent
    AktivQuelle öffnen ↗

    Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

    Markdown
    • a2a-protocol
    • agentic-ai
    • ai
    • ai-agents
    • ai-engineering
    githubRessourcegemessenes Wachstum
    1GitHub-Sternestabil
  4. 4

    trigger_tree

    Skill
    AktivQuelle öffnen ↗

    Documentation-discovery telemetry for Claude Code — heat/cold maps, health grade, evidence-backed router fixes. 100% local, zero tokens. /tt

    PythonLizenz: MIT
    • ai-agents
    • claude-code
    • claude-code-plugin
    • docs-as-code
    • documentation
    github

    Installieren /plugin marketplace add Hedde/trigger_tree

    Ressourcegemessenes Wachstum
    14GitHub-Sternestabil
  5. 5

    tunelab

    Skill
    AktivQuelle öffnen ↗

    Claude Code plugin for LLM fine-tuning, distillation, and evaluation — decide whether you need fine-tuning at all, distill your LLM logs into small local models (MLX/LoRA), evaluate with held-out discipline, and learn the why at every step.

    PythonLizenz: MIT
    • claude-code
    • claude-code-plugin
    • distillation
    • fine-tuning
    • llm-evaluation
    github

    Installieren /plugin marketplace add rchaz/tunelab

    Ressourcegemessenes Wachstum
    6GitHub-Sternestabil