Die Werkzeugbeschreibungen sind auf Englisch.

LLM-Beobachtbarkeit

Monitoring, Traces, Bewertung und Qualität von LLM-Anwendungen.

Anwendungsfall

Aktivität

Sortieren nach

77

Werkzeug-Rangliste

Ranked by creation date, newest first; undated entries come last. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Skill
    Aktiv

    Vendor-neutral OpenTelemetry skills for AI coding agents, grounded in upstream sources

    ShellLizenz: Apache-2.0
    • agent-skills
    • ai
    • observability
    • opentelemetry

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/ollygarden/opentelemetry-agent-skills ~/.claude/skills/opentelemetry-agent-skills

    97GitHub-Sterne+1 (+1.0 %)
  2. 2

    Skill
    Aktiv

    Agent skills for Arize — datasets, experiments, and traces via the ax CLI

    PythonLizenz: MIT
    • agent-skills
    • ai-agents
    • ai-observability
    • arize
    • claude-code

    githubgeschätztes MomentumQuelle öffnen ↗

    Installieren git clone https://github.com/Arize-ai/arize-skills ~/.claude/skills/arize-skills

    47GitHub-Sterne—
  3. 3

    MCP
    Aktiv

    AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure.

    RustLizenz: Apache-2.0
    • a2a
    • ai-agent-framework
    • ai-agents
    • ai-sre
    • aiops

    githubgemessenes WachstumQuelle öffnen ↗

    339GitHub-Sterne+81 (+31.4 %)
  4. 4

    Skill
    Aktiv

    local-first analytics for AI agent skills

    TypeScript
    • agent-skills
    • analytics
    • bun
    • claude-code
    • cli

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

    77GitHub-Sterne+1 (+1.3 %)
  5. 5

    Skill
    Aktiv

    Measure prompt and skill improvements with blind A/B comparison.

    PythonLizenz: MIT
    • agent-skills
    • ai-tools
    • claude-code
    • claude-code-plugin
    • claude-code-skill

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add shinpr/rashomon

    18GitHub-Sternestabil
  6. 6

    Skill
    Aktiv

    Dashboard for monitoring claude code sessions.

    PythonLizenz: Apache-2.0
    • agents
    • agentskills
    • claude-code
    • claude-code-plugin
    • claude-code-skills

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren /plugin marketplace add JayantDevkar/claude-code-karma

    324GitHub-Sterne+3 (+0.93 %)
  7. 7

    MCP
    Aktiv

    Self improving agents through iterations

    PythonLizenz: Apache-2.0
    • agent-learning
    • agent-memory
    • agentic-workflows
    • ai-agents
    • claude-code

    githubgemessenes WachstumQuelle öffnen ↗

    104GitHub-Sternestabil
  8. 8

    Skill
    Aktiv

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    PythonLizenz: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/FrancyJGLisboa/agent-skills-platform ~/.claude/skills/agent-skills-platform

    2 376GitHub-Sternestabil
  9. 9

    Skill
    Aktiv

    Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    PythonLizenz: MIT
    • agent-skills
    • ai-agents
    • claude-code
    • codex
    • cursor

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

    2 367GitHub-Sterne+15 (+0.64 %)
  10. 10

    Sonstige
    Aktiv

    A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol

    GoLizenz: Apache-2.0
    • a2a
    • agents
    • ai
    • containerized
    • docker

    githubgemessenes WachstumQuelle öffnen ↗

    14GitHub-Sterne+1 (+7.7 %)
  11. 11

    Agent
    Aktiv

    The Operating System for Scalable Enterprise AI Agents - Run, orchestrate, and deploy Compliant Enterprise AI Agents at scale across frameworks, without lock-in, rewrites or fragile glue code. Native support for MCP, A2A. Interface with all…

    PythonLizenz: Apache-2.0
    • a2a
    • adk
    • ai-agents
    • aws
    • azure

    githubgemessenes WachstumQuelle öffnen ↗

    166GitHub-Sterne+25 (+17.7 %)
  12. 12

    Skill
    Aktiv

    🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.

    PythonLizenz: GPL-3.0
    • a2a-protocol
    • ag-ui-protocol
    • agent-platform
    • agentic-ai
    • agents

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform

    199GitHub-Sternestabil
  13. 13

    MCP
    Aktiv

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    GoLizenz: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    githubgemessenes WachstumQuelle öffnen ↗

    1 763GitHub-Sterne+15 (+0.86 %)
  14. 14

    MCP
    Aktiv

    MCP server for Langfuse LLM observability — trace and observation analysis.

    TypeScriptLizenz: MIT

      mcpgemessenes WachstumQuelle öffnen ↗

      Installieren claude mcp add langfuse -- npx langfuse-observability-mcp-server

      80GitHub-Sterne+2 (+2.6 %)
    • 15

      MCP
      Aktiv

      A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

      PythonLizenz: MIT
      • agent-skills
      • ai-agents
      • claude-code
      • codex
      • developer-tools

      githubgemessenes WachstumQuelle öffnen ↗

      105GitHub-Sternestabil
    • 16

      Sonstige
      Aktiv

      Mastra is the modern TypeScript framework for AI-powered applications and agents.

      TypeScript
      • agents
      • ai
      • chatbots
      • evals
      • javascript

      githubgemessenes WachstumQuelle öffnen ↗

      27 712GitHub-Sterne+149 (+0.54 %)
    • 17

      MCP
      Aktiv

      🫖 Status page with uptime monitoring & API monitoring as code 🫖

      TypeScriptLizenz: AGPL-3.0
      • alerting
      • incident-management
      • mcp
      • mcp-server
      • monitoring

      githubgemessenes WachstumQuelle öffnen ↗

      9 060GitHub-Sterne+31 (+0.34 %)
    • 18

      Sonstige
      Aktiv

      the LLM vulnerability scanner

      PythonLizenz: Apache-2.0
      • ai
      • llm-evaluation
      • llm-security
      • security-scanners
      • vulnerability-assessment

      githubgemessenes WachstumQuelle öffnen ↗

      9 110GitHub-Sterne+37 (+0.41 %)
    • 19

      Sonstige
      Aktiv

      Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

      TypeScriptLizenz: MIT
      • ci
      • ci-cd
      • cicd
      • evaluation
      • evaluation-framework

      githubgemessenes WachstumQuelle öffnen ↗

      24 825GitHub-Sterne+159 (+0.64 %)
    • 20

      Sonstige
      Aktiv

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScriptLizenz: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      githubgemessenes WachstumQuelle öffnen ↗

      21 643GitHub-Sterne+87 (+0.40 %)
    • 21

      Agent
      Aktiv

      eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

      GoLizenz: Apache-2.0
      • cloud-native
      • devops
      • docker
      • ebpf
      • golang

      githubgemessenes WachstumQuelle öffnen ↗

      12 068GitHub-Sterne+7 (+0.06 %)
    • 22

      Sonstige
      Aktiv

      SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

      TypeScript
      • apm
      • application-monitoring
      • distributed-tracing
      • go
      • good-first-issue

      githubgemessenes WachstumQuelle öffnen ↗

      32 012GitHub-Sterne+42 (+0.13 %)
    • 23

      Sonstige
      Aktiv

      A high-performance observability data pipeline.

      RustLizenz: MPL-2.0
      • agent
      • cloud-native
      • data-transformation
      • datadog
      • etl

      githubgemessenes WachstumQuelle öffnen ↗

      22 511GitHub-Sterne+24 (+0.11 %)
    • 24

      Bibliothek
      Aktiv

      Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

      PythonLizenz: Apache-2.0
      • automation
      • data
      • data-engineering
      • data-ops
      • data-science

      githubgemessenes WachstumQuelle öffnen ↗

      23 783GitHub-Sterne+67 (+0.28 %)
    • 25

      Agent
      Aktiv

      The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

      PythonLizenz: Apache-2.0
      • agentops
      • agents
      • ai
      • ai-governance
      • apache-spark

      githubgemessenes WachstumQuelle öffnen ↗

      27 817GitHub-Sterne+86 (+0.31 %)