Evaluation & Testing

Full lifecycle AI evaluation and monitoring platform supporting ML, GenAI, and agentic systems. Offers built-in guardrai...

End-to-end LLM evaluation and development platform with dataset management, prompt playground, automated scoring, and tr...

Open-source LLM evaluation framework with 50+ research-backed metrics for testing AI applications. Differentiates with n...

Open-source ML and LLM observability platform. Provides pre-built evaluators for text quality, LLM output correctness, t...

Open-source testing and vulnerability scanning framework for LLM applications. Detects hallucinations, bias, harmful con...

LLM evaluation framework developed by the UK AI Safety Institute (AISI). Designed for safety and capability evaluations ...

Unified framework by EleutherAI for evaluating language models across hundreds of academic benchmarks and tasks. The de ...

Open-source framework for evaluating LLMs and LLM-based systems with a registry of pre-built benchmarks. Provides eval t...

Platform for testing, evaluating, and observing LLM applications with experiment tracking, human annotation, and product...

Open-source tool for testing and evaluating LLM prompts and models. Supports automated red teaming, A/B comparison of mo...

Open-source framework for evaluating Retrieval-Augmented Generation (RAG) pipelines using LLM-assisted metrics. Provides...

Evaluation and tracking library for LLM applications built by TruEra. Provides feedback functions to evaluate RAG qualit...

Open-source LLM evaluation and observability platform with 20+ pre-built checks including response quality, factual accu...