Le descrizioni degli strumenti sono in inglese.

Osservabilità LLM

Monitoraggio, tracce, valutazione e qualità delle applicazioni LLM.

Utilizzo

Attività

Ordina per

118

Classifica degli strumenti

Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. I valori grezzi mantengono la propria finestra; una variazione richiede almeno due rilevazioni in 7 giorni.

  1. 1

    Agente
    Attivo

    Generic DeepSeek Harness (dsh) plugins: A2A protocol server, session storage mirror, and Langfuse observability.

    TypeScriptLicenza: MIT
    • agent2agent
    • ai-agents
    • cordis
    • deepseek-harness
    • dsh

    githubcrescita misurataApri fonte ↗

    1stelle GitHubstabile
  2. 2

    Agente
    Attivo

    Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.

    TypeScriptLicenza: Apache-2.0
    • a2a
    • agent-evaluation
    • ai-agents
    • benchmark
    • deterministic-replay

    githubcrescita misurataApri fonte ↗

    1stelle GitHubstabile
  3. 3

    Skill
    Attivo

    Skill instalable para Claude Code que mide si tu agente cumple las reglas establecidas. Lee el historial de sesiones de tu disco y devuelve un porcentaje por regla de cumplimiento. Sin instalar nada, sin red, biblioteca estándar.

    PythonLicenza: MIT
    • ai-evaluation
    • claude
    • claude-code
    • claude-code-plugin
    • claude-code-skill

    githubcrescita misurataApri fonte ↗

    Installa /plugin marketplace add jleonceo/skill-adherencia-reglas

    1stelle GitHubstabile
  4. 4

    Agente
    Attivo

    Agent 降智检测与自愈公评网络 — an immune system for the AI agent society

    TypeScriptLicenza: MIT
    • a2a
    • agent
    • agent-guard
    • ai-sre
    • drift-detection

    githubcrescita misurataApri fonte ↗

    1stelle GitHubstabile
  5. 5

    Altro
    Attivo

    Terminal-first validation harness for reviewing PRDs, RFCs, strategy docs, and experiment plans.

    TypeScript
    • ai-agents
    • claude-code
    • claude-code-skills
    • cli
    • evals

    githubcrescita misurataApri fonte ↗

    1stelle GitHubstabile
  6. 6

    Agente
    Attivo

    A local A2A event and continuity service for agent applications, with structured history, provenance-safe transcripts, literal search, and natural-language queries.

    PythonLicenza: BSD-2-Clause
    • a2a
    • agent-memory
    • ai-agents
    • event-sourcing
    • fastapi

    githubcrescita misurataApri fonte ↗

    1stelle GitHubstabile
  7. 7

    Skill
    Attivo

    Run many AIs on one board and keep control of all of it. Deterministic code decides who acts — never a model. A privacy floor keeps sensitive work on your machine, your own tests decide what counts as done, and every action lands on a…

    • a2a
    • agent-orchestration
    • agent-skills
    • ai-agents
    • ai-governance

    githubcrescita misurataApri fonte ↗

    Installa git clone https://github.com/sandhusukhdeep2/sc-prism-releases ~/.claude/skills/sc-prism-releases

    1stelle GitHubstabile
  8. 8

    Skill
    Attivo

    Glanceable Claude Code and Codex state in your terminal tabs: white=idle, blue=working, orange=waiting. Multi-terminal (iTerm2, WezTerm, AI Power Term), a live status bar with Anthropic usage limits, /sfl and /nil window save-and-restore,…

    ShellLicenza: MIT
    • ai-workflow-observability
    • claude-code
    • claude-code-hooks
    • claude-code-skill
    • claude-code-skills

    githubcrescita misurataApri fonte ↗

    Installa git clone https://github.com/wasulajr/headsup ~/.claude/skills/headsup

    1stelle GitHubstabile
  9. 9

    Altro
    Attivo

    🔑 HomeStream · 家园·流 — 零成本自托管多Agent协作框架，通往AI世界的那把钥匙 | Zero-cost self-hosted multi-agent framework — The key to AI world

    PythonLicenza: MIT
    • a2a-protocol
    • agent-framework
    • ai
    • causal-memory
    • event-stream

    githubcrescita misurataApri fonte ↗

    0stelle GitHubstabile
  10. 10

    MCP
    Attivo

    Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    PythonLicenza: MIT

      mcpcrescita misurataApri fonte ↗

      Installa claude mcp add ai-guardian -- uvx ai-guardian-aiops

      0stelle GitHubstabile
    • 11

      Agente
      Dormiente

      Contract-based testing for LLM agents: hybrid evaluation, multi-agent + A2A, deterministic replay.

      PythonLicenza: MIT
      • a2a
      • agents
      • contracts
      • evaluation
      • llm

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 12

      Agente
      Dormiente

      OpenTelemetry semantic conventions and instrumentation for agent provenance, derivation lineage, and acceptance criteria evaluation. Fills the Microsoft AI stack observability gap.

      Python
      • a2a-protocol
      • agentic-ai
      • ai-agents
      • observability
      • opentelemetry

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 13

      MCP
      Attivo

      AgentGateway — independent third-party profile of a public API surface, by API Evangelist. AgentGateway is an open-source, AI-native proxy and gateway for routing, observing, and governing traffic to and from AI agents, LLM providers, and…

      • agent-to-agent
      • ai-gateway
      • api-gateway
      • apis-json
      • cncf

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 14

      Agente
      Attivo

      Local-first control plane for durable, governed agent teams: DAG orchestration, approvals, memory, signed skills, trace contracts, and realtime.

      PythonLicenza: Apache-2.0
      • a2a-protocol
      • agentic-ai
      • ai-agents
      • fastapi
      • llmops

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 15

      MCP
      Attivo

      Architecture-first Python scaffold for an auditable multi-agent corporate credit desk using A2A, MCP, deterministic credit policies, model routing, and OpenTelemetry.

      Python
      • a2a-protocol
      • agentic-ai
      • auditability
      • clean-architecture
      • credit-risk

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 16

      Agente
      Attivo

      面向长程研发任务的 Java Agent Harness，支持 A2A 跨语言协作、可恢复执行、上下文工程与 Eval 驱动开发。

      JavaLicenza: Apache-2.0
      • a2a
      • agentic-ai
      • ai-agents
      • developer-tools
      • evals

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile
    • 17

      Agente
      Dormiente

      A Python proof-of-concept for tracing multi-turn Agent-to-Agent (A2A) conversations as a single unified MLflow trace for LLM observability and evaluation.

      Python
      • a2a
      • agent-to-agent
      • ai-agents
      • conversational-ai
      • llm-evaluation

      githubcrescita misurataApri fonte ↗

      0stelle GitHubstabile

    Risorse didattiche e di riferimento

    Ranked by known GitHub stars, highest first; archived repositories come after maintained repositories. Queste risorse restano accessibili separatamente e non partecipano alla classifica principale.

    1. 1

      production-ai-engineering

      Agente
      AttivoApri fonte ↗

      Handbook técnico aberto sobre engenharia de IA em produção: ML tradicional, LLMs, RAG, agentes, segurança, observabilidade, FinOps e deployment.

      Markdown
      • a2a-protocol
      • agentic-ai
      • ai
      • ai-agents
      • ai-engineering
      githubRisorsacrescita misurata
      1stelle GitHubstabile