Monitoring & Observability

Observability and evaluation platform built specifically for AI agents, providing session replay, cost tracking, and LLM...

Open-source AI observability and evaluation framework built on OpenTelemetry, supporting tracing, evaluation, and debugg...

Enterprise-grade LLM observability module within Datadog platform for monitoring latency, cost, errors, and quality of L...

Open-source LLM evaluation framework. 14+ metrics including hallucination, relevancy, and bias detection.

LLM evaluation and hallucination detection platform. Automated metrics for RAG quality and safety.

LLM observability platform that routes, debugs, and analyzes AI application requests with a one-line integration. Differ...

AI observability platform for tracing, evaluating, and debugging LLM applications and agents in production, with support...

Open-source LLM engineering platform providing traces, evals, prompt management, and metrics for debugging and improving...

LLM application observability and evaluation platform by LangChain, offering tracing, dataset management, and automated ...

LLM observability and evaluation platform. Captures traces, runs evaluations, and builds annotated datasets for fine-tun...

Open-source MLOps platform with native LLM tracking capabilities, supporting prompt versioning, evaluation, tracing, and...

Open-source observability for LLMs based on OpenTelemetry. Works with Datadog, Grafana, Honeycomb.

Open-source observability framework providing APIs, SDKs, and collectors for capturing distributed traces, metrics, and ...

Open-source LLM observability platform by Comet for debugging, evaluating, and monitoring LLM applications, RAG systems,...

AI gateway and observability platform providing unified API management, request routing, caching, cost tracking, and obs...

Open-source product analytics with AI feature tracking. Session replay, feature flags, A/B testing.

Error tracking with AI/LLM monitoring support. Track exceptions, performance, and LLM-specific errors.

OpenTelemetry-based LLM observability platform (OpenLLMetry) enabling distributed tracing, cost monitoring, and quality ...

LLM evaluation and tracing toolkit by Weights & Biases, enabling developers to track, visualize, and evaluate LLM calls,...

AI observability platform for monitoring ML models and LLMs using statistical profiling and data logging. Key differenti...