Le descrizioni degli strumenti sono in inglese.

Osservabilità LLM

Monitoraggio, tracce, valutazione e qualità delle applicazioni LLM.

Utilizzo

Attività

Ordina per

118

Classifica degli strumenti

Ranked by creation date, newest first; undated entries come last. I valori grezzi mantengono la propria finestra; una variazione richiede almeno due rilevazioni in 7 giorni.

  1. 1

    Skill
    Attivo

    OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

    PythonLicenza: Apache-2.0
    • agent
    • agent-skills
    • ai-agent
    • alignment
    • evaluation

    githubcrescita misurataApri fonte ↗

    Installa git clone https://github.com/agentscope-ai/OpenJudge ~/.claude/skills/OpenJudge

    816stelle GitHub+11 (+1.4 %)
  2. 2

    Skill
    Attivo

    🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.

    PythonLicenza: GPL-3.0
    • a2a-protocol
    • ag-ui-protocol
    • agent-platform
    • agentic-ai
    • agents

    githubcrescita misurataApri fonte ↗

    Installa git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform

    199stelle GitHubstabile
  3. 3

    MCP
    Attivo

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    GoLicenza: Apache-2.0
    • a2a
    • a2a-protocol
    • ag-ui
    • agent
    • agent-framework

    githubcrescita misurataApri fonte ↗

    1 763stelle GitHub+15 (+0.86 %)
  4. 4

    MCP
    Attivo

    MCP server for Langfuse LLM observability — trace and observation analysis.

    TypeScriptLicenza: MIT

      mcpcrescita misurataApri fonte ↗

      Installa claude mcp add langfuse -- npx langfuse-observability-mcp-server

      80stelle GitHub+2 (+2.6 %)
    • 5

      MCP
      Attivo

      A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability

      PythonLicenza: MIT
      • agent-skills
      • ai-agents
      • claude-code
      • codex
      • developer-tools

      githubcrescita misurataApri fonte ↗

      105stelle GitHubstabile
    • 6

      Agente
      Dormiente

      A Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.

      PythonLicenza: Apache-2.0
      • a2a-protocol
      • agent-evaluation
      • agentbeats
      • ai-agents
      • benchmarks

      githubcrescita misurataApri fonte ↗

      2stelle GitHubstabile
    • 7

      Altro
      Attivo

      Mastra is the modern TypeScript framework for AI-powered applications and agents.

      TypeScript
      • agents
      • ai
      • chatbots
      • evals
      • javascript

      githubcrescita misurataApri fonte ↗

      27 712stelle GitHub+149 (+0.54 %)
    • 8

      MCP
      Attivo

      🫖 Status page with uptime monitoring & API monitoring as code 🫖

      TypeScriptLicenza: AGPL-3.0
      • alerting
      • incident-management
      • mcp
      • mcp-server
      • monitoring

      githubcrescita misurataApri fonte ↗

      9 060stelle GitHub+31 (+0.34 %)
    • 9

      Altro
      Attivo

      the LLM vulnerability scanner

      PythonLicenza: Apache-2.0
      • ai
      • llm-evaluation
      • llm-security
      • security-scanners
      • vulnerability-assessment

      githubcrescita misurataApri fonte ↗

      9 110stelle GitHub+37 (+0.41 %)
    • 10

      Altro
      Attivo

      Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…

      TypeScriptLicenza: MIT
      • ci
      • ci-cd
      • cicd
      • evaluation
      • evaluation-framework

      githubcrescita misurataApri fonte ↗

      24 825stelle GitHub+159 (+0.64 %)
    • 11

      Altro
      Attivo

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScriptLicenza: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      githubcrescita misurataApri fonte ↗

      21 643stelle GitHub+87 (+0.40 %)
    • 12

      Agente
      Attivo

      eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

      GoLicenza: Apache-2.0
      • cloud-native
      • devops
      • docker
      • ebpf
      • golang

      githubcrescita misurataApri fonte ↗

      12 068stelle GitHub+7 (+0.06 %)
    • 13

      Altro
      Attivo

      SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…

      TypeScript
      • apm
      • application-monitoring
      • distributed-tracing
      • go
      • good-first-issue

      githubcrescita misurataApri fonte ↗

      32 012stelle GitHub+42 (+0.13 %)
    • 14

      Altro
      Attivo

      A high-performance observability data pipeline.

      RustLicenza: MPL-2.0
      • agent
      • cloud-native
      • data-transformation
      • datadog
      • etl

      githubcrescita misurataApri fonte ↗

      22 511stelle GitHub+24 (+0.11 %)
    • 15

      Libreria
      Attivo

      Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

      PythonLicenza: Apache-2.0
      • automation
      • data
      • data-engineering
      • data-ops
      • data-science

      githubcrescita misurataApri fonte ↗

      23 783stelle GitHub+67 (+0.28 %)
    • 16

      Agente
      Attivo

      The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

      PythonLicenza: Apache-2.0
      • agentops
      • agents
      • ai
      • ai-governance
      • apache-spark

      githubcrescita misurataApri fonte ↗

      27 817stelle GitHub+86 (+0.31 %)
    • 17

      Altro
      Attivo

      eBPF-based Networking, Security, and Observability

      GoLicenza: Apache-2.0
      • bpf
      • cncf
      • cni
      • containers
      • ebpf

      githubcrescita misurataApri fonte ↗

      25 070stelle GitHub+42 (+0.17 %)
    • 18

      Altro
      Attivo

      The fastest path to AI-powered full stack observability, even for lean teams.

      GoLicenza: GPL-3.0
      • ai
      • alerting
      • cncf
      • data-visualization
      • database

      githubcrescita misurataApri fonte ↗

      80 432stelle GitHub+78 (+0.10 %)