ツールの説明は英語です。
LLM可観測性
LLMアプリの監視、トレース、評価、品質管理。
用途
アクティビティ
並び順
118
ツールランキング
Ranked by creation date, newest first; undated entries come last. 各値は情報源固有の期間を使用し、変化の算出には7日間で2回以上の測定が必要です。
- 1活動中
OpenJudge
スキルOpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards
github測定済み成長情報源を開く ↗
インストール
git clone https://github.com/agentscope-ai/OpenJudge ~/.claude/skills/OpenJudge812GitHubスター+7 (+0.87 %) - 2活動中
🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in.
github測定済み成長情報源を開く ↗
インストール
git clone https://github.com/Idun-Group/idun-agent-platform ~/.claude/skills/idun-agent-platform199GitHubスター安定 - 3活動中
A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.
github測定済み成長情報源を開く ↗
1 763GitHubスター+16 (+0.92 %) - 4活動中
MCP server for Langfuse LLM observability — trace and observation analysis.
mcp測定済み成長情報源を開く ↗
インストール
claude mcp add langfuse -- npx langfuse-observability-mcp-server80GitHubスター+2 (+2.6 %) - 5活動中
langfuse-mcp
MCPA Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observability
github測定済み成長情報源を開く ↗
105GitHubスター安定 - 6休止中
Agents-eval
エージェントA Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.
github測定済み成長情報源を開く ↗
2GitHubスター安定 - 7活動中
mastra
その他Mastra is the modern TypeScript framework for AI-powered applications and agents.
github測定済み成長情報源を開く ↗
27 680GitHubスター+132 (+0.48 %) - 89 059GitHubスター+31 (+0.34 %)
- 99 106GitHubスター+40 (+0.44 %)
- 10活動中
promptfoo
その他Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI…
github測定済み成長情報源を開く ↗
24 797GitHubスター+146 (+0.59 %) - 11活動中
openobserve
その他Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…
github測定済み成長情報源を開く ↗
21 630GitHubスター+88 (+0.41 %) - 12活動中
kubeshark
エージェントeBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.
github測定済み成長情報源を開く ↗
12 068GitHubスター+7 (+0.06 %) - 13活動中
signoz
その他SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined…
github測定済み成長情報源を開く ↗
32 010GitHubスター+52 (+0.16 %) - 1422 510GitHubスター+34 (+0.15 %)
- 15活動中
prefect
ライブラリPrefect is a workflow orchestration framework for building resilient data pipelines in Python.
github測定済み成長情報源を開く ↗
23 772GitHubスター+61 (+0.26 %) - 16活動中
mlflow
エージェントThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…
github測定済み成長情報源を開く ↗
27 801GitHubスター+82 (+0.30 %) - 1725 058GitHubスター+36 (+0.14 %)
- 18活動中
netdata
その他The fastest path to AI-powered full stack observability, even for lean teams.
github測定済み成長情報源を開く ↗
80 424GitHubスター+82 (+0.10 %)