Le descrizioni degli strumenti sono in inglese.

Osservabilità LLM

Monitoraggio, tracce, valutazione e qualità delle applicazioni LLM.

Utilizzo

Attività

Ordina per

114

Classifica degli strumenti

Classifica per crescita misurata e normalizzata tra le fonti. I valori grezzi mantengono la propria finestra; una variazione richiede almeno due rilevazioni in 7 giorni.

  1. 1

    MCP
    Attivo

    MCP server for Langfuse LLM observability — trace and observation analysis.

    TypeScriptLicenza: MIT

      mcpcrescita misurataApri fonte ↗

      Installa claude mcp add langfuse -- npx langfuse-observability-mcp-server

      78stelle GitHubstabile
    • 2

      Skill
      Attivo

      Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

      PythonLicenza: MIT
      • agent-skills
      • ai-agents
      • claude-code
      • codex
      • cursor

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/FrancyJGLisboa/agent-skill-creator ~/.claude/skills/agent-skill-creator

      2 367stelle GitHub+28 (+1.2 %)
    • 3

      Skill
      Attivo

      local-first analytics for AI agent skills

      TypeScript
      • agent-skills
      • analytics
      • bun
      • claude-code
      • cli

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/crafter-station/skill-kit ~/.claude/skills/skill-kit

      77stelle GitHub+1 (+1.3 %)
    • 4

      Altro
      Attivo

      🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

      PythonLicenza: MIT
      • a2a-protocol
      • agent-framework
      • ai
      • causal-memory
      • event-stream

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 5

      Skill
      Attivo

      Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters

      PythonLicenza: MIT
      • agent-skills
      • evals
      • python
      • skills

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/adewale/skill-eval-harness ~/.claude/skills/skill-eval-harness

      73stelle GitHub+4 (+5.8 %)
    • 6

      Altro
      Attivo

      AgentX python SDK. Build multi-agent AI workforce. Run evaluation. Trace your agent. Full Observability.

      PythonLicenza: Apache-2.0
      • a2a
      • agent
      • agent-monitoring
      • evaluation
      • mcp

      githubcrescita misurataApri fonte ↗

      68stelle GitHubstabile
    • 7

      Skill
      Attivo

      Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

      JavaScriptLicenza: MIT
      • aeo
      • agent-skills
      • ai
      • ai-seo
      • benchmark

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/aleclindz/seo-skill-bench ~/.claude/skills/seo-skill-bench

      51stelle GitHub-5 (-8.9 %)
    • 8

      Agente
      Dormiente

      A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

      Python
      • a2a
      • agent-to-agent
      • ai-agents
      • conversational-ai
      • llm-evaluation

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 9

      MCP
      Attivo

      Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

      TypeScriptLicenza: Apache-2.0
      • agent-management
      • agent-ops
      • agent-orchestration
      • ai-agent-platform
      • ai-agents

      githubcrescita misurataApri fonte ↗

      50stelle GitHub+2 (+4.2 %)
    • 10

      MCP
      Attivo

      A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

      GoLicenza: Apache-2.0
      • a2a
      • a2a-protocol
      • ag-ui
      • agent
      • agent-framework

      githubcrescita misurataApri fonte ↗

      1 759stelle GitHub+18 (+1.0 %)
    • 11

      Skill
      Attivo

      Real-time execution trace and cost intelligence for Claude Code

      TypeScriptLicenza: MIT
      • agentic-workflow
      • ai-productivity
      • anthropic
      • anthropic-claude
      • claude

      githubcrescita misurataApri fonte ↗

      Installa /plugin marketplace add DeibyGS/claudestat

      34stelle GitHub+1 (+3.0 %)
    • 12

      Skill
      Attivo

      Make Claude Opus 4.8 behave like Claude Fable 5 — doctrine output style, drift-catching hooks, and an eval loop against golden Fable transcripts. Claude Code plugin.

      ShellLicenza: MIT
      • anthropic
      • claude
      • claude-code
      • claude-code-plugin
      • evals

      githubcrescita misurataApri fonte ↗

      Installa /plugin marketplace add rennf93/opus-fable-playbook

      33stelle GitHubstabile
    • 13

      MCP
      Attivo

      AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

      • agent-to-agent
      • ai-gateway
      • api-gateway
      • apis-json
      • cncf

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 14

      Skill
      Dormiente

      🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

      Licenza: MIT
      • agent-debugging
      • ai-agents
      • claude-skills
      • claude-skills-creator
      • claude-skills-hub

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/OthmanAdi/langsmith-fetch-skill ~/.claude/skills/langsmith-fetch-skill

      27stelle GitHubstabile
    • 15

      Agente
      Dormiente

      Policy-enforced observability and fail-closed guardrails for MCP/A2A multi-agent systems.

      Rust
      • a2a
      • ai-agents
      • llm-security
      • mcp
      • multi-agent

      githubcrescita misurataApri fonte ↗

      26stelle GitHubstabile
    • 16

      Skill
      Attivo

      A skill creator that proves its skills work. Evidence-driven skill creation for Claude Code and Codex: baseline-tested generation, per-skill regression evals, ecosystem doctor, cross-runtime compile, and an opt-in proactive advisor.

      PythonLicenza: MIT
      • agent-skills
      • claude-ai
      • claude-code
      • claude-skills
      • codex

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/tripleyak/SkillForge ~/.claude/skills/SkillForge

      884stelle GitHub+1 (+0.11 %)
    • 17

      Agente
      Dormiente

      OpenTelemetry semantic conventions and instrumentation for agent provenance, derivation lineage, and acceptance criteria evaluation. Fills the Microsoft AI stack observability gap.

      Python
      • a2a-protocol
      • agentic-ai
      • ai-agents
      • observability
      • opentelemetry

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 18

      Skill
      Attivo

      Sentry instrumentation skill for system-behavior tracking

      ShellLicenza: MIT
      • agent-skills
      • claude-skills
      • codex-skill
      • instrumentation
      • monitoring

      githubcrescita misurataApri fonte ↗

      Installa git clone https://github.com/tortastudios/sentry-instrumentation ~/.claude/skills/sentry-instrumentation

      24stelle GitHubstabile
    • 19

      MCP
      Attivo

      Deterministic, local-only audit reports for Claude Code AI agent sessions. Rust + SQLite. Zero network calls. MCP server for agents.

      HTMLLicenza: MIT
      • agent-monitoring
      • agentic-ai
      • ai-agents
      • ai-engineering
      • audit

      githubcrescita misurataApri fonte ↗

      22stelle GitHub+2 (+10.0 %)
    • 20

      MCP
      Attivo

      Log Claude Code sessions to Opik, the open-source LLM observability and evaluation platform, built by Comet. Tracing, evaluation, and skills for observable AI applications.

      GoLicenza: Apache-2.0
      • ai-agent
      • claude-ai
      • claude-code-plugin
      • llm-observation
      • mcp-server

      githubcrescita misurataApri fonte ↗

      22stelle GitHub+1 (+4.8 %)
    • 21

      MCP
      Attivo

      Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

      PythonLicenza: MIT

        mcpcrescita misurataApri fonte ↗

        Installa claude mcp add ai-guardian -- uvx ai-guardian-aiops

        0stelle GitHubstabile
      • 22

        Altro
        Attivo

        AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether that verdict survives meaning-preserving edits. Detector-in-the-loop measurement harness. Claude…

        PythonLicenza: MIT
        • ai-detection
        • ai-detector
        • benchmark
        • claude-code
        • claude-code-skill

        githubcrescita misurataApri fonte ↗

        18stelle GitHubstabile
      • 23

        Skill
        Attivo

        Measure prompt and skill improvements with blind A/B comparison.

        PythonLicenza: MIT
        • agent-skills
        • ai-tools
        • claude-code
        • claude-code-plugin
        • claude-code-skill

        githubcrescita misurataApri fonte ↗

        Installa /plugin marketplace add shinpr/rashomon

        18stelle GitHubstabile
      • 24

        Skill
        Attivo

        OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

        PythonLicenza: Apache-2.0
        • agent
        • agent-skills
        • ai-agent
        • alignment
        • evaluation

        githubcrescita misurataApri fonte ↗

        Installa git clone https://github.com/agentscope-ai/OpenJudge ~/.claude/skills/OpenJudge

        809stelle GitHub+6 (+0.75 %)
      • 25

        Agente
        Dormiente

        An AI-powered multi-agent system that demonstrates clinical triage, OTC medication recommendations, and e-pharmacy integration for respiratory conditions. Built with modular agents that collaborate to provide safe, intelligent healthcare…

        Python
        • agent-to-agent
        • agentic-ai
        • aiagent
        • antigravity-ide
        • cursor-ai

        githubcrescita misurataApri fonte ↗

        0stelle GitHubstabile