Platforms for systematically evaluating, benchmarking, and testing AI model outputs for accuracy, safety, and reliability.
AI Evaluation and Testing
Braintrust is an AI evaluation platform for testing prompts, models, and application behavior with production-like datasets and scoring workflows.
Price$249 / month
Price position: above the category median.
Workflow Orchestration
Vellum helps teams design, test, and orchestrate prompt-driven workflows and LLM-powered products with a more controlled production pipeline.
Price$50+ / month
Starting price: at the category median.AI Observability
LangWatch helps teams monitor prompts, traces, and quality signals across production LLM applications and agent workflows.
Price$67.13+ / month
Starting price: above the category median.
Code Security Scanning
Aikido Security brings together code, cloud, dependency, and runtime security workflows in a more approachable platform for modern engineering teams.
Price$314+ / month
Starting price: above the category median.
Observability Platforms
Arize helps teams monitor, evaluate, and improve LLM applications, retrieval systems, and machine learning products once they are live in production.
Price$50+ / month
Starting price: at the category median.
Prompt Engineering Tools
PromptLayer is a platform for prompt management, AI observability, evaluation workflows, and release control across LLM apps and agent systems.
Price$50+ / seat / month
Starting price: at the category median.
AI Observability
AgentOps is a developer platform for tracing, monitoring, testing, and debugging AI agents in development and production.
Price$40+ / month
Starting price: below the category median.
AI Agents & Sidekicks
Browserbase provides a reliable, managed browser infrastructure for AI agents, enabling web scraping, automated testing, and agent-based web interactions at scale.
Price$20 / month
Price position: below this category's displayed range.
Video Interview Platforms
Structured interview platform with question libraries, scorecards, and collaborative evaluation for reducing hiring bias.
Price$49+ / month
Starting price: below the category median.
AI Evaluation and Testing
Open-source ML monitoring tool for evaluating, testing, and monitoring data and model quality in production.
Price$80 / month
Price position: above the category median.
AI Evaluation and Testing
LLM testing and evaluation platform with continuous testing pipelines.
Price$299+ / month
Starting price: above the category median.
AI Evaluation and Testing
End-to-end AI evaluation and monitoring platform for LLM product teams with prompt management and datasets.
Price$39+ / user / month
Starting price: below the category median.
Architectural Design Software
ArchiCAD by Graphisoft provides BIM authoring software for architects with integrated design and documentation in a single model.
Price$245+ / month
Starting price: above the category median.
AI Observability
AI agent observability and evaluation platform reducing reliability issues in multi-agent LLM systems.
Price$99 / month
Price position: above the category median.
Behavioral Analytics Platforms
Amplitude is a digital analytics platform that helps product teams understand user behavior, run experiments, and drive growth through behavioral data analysis, A/B testing, and user journey...
Price$49+ / month
Starting price: below the category median.
AI Observability
Open-source LLM evaluation and observability platform from Comet.
Price$19 / month
Price position: below this category's displayed range.
AI Annotation and Labeling
Data labeling platform built for NLP researchers with expert-quality human annotation and quality control.
PriceUsage-based
DevSecOps Platforms
Checkmarx provides a comprehensive application security platform including software composition analysis, SAST, DAST, and API security for enterprise DevSecOps programs.
Price$2,500+ / month
Starting price: above the category median.
