Compare AI Evaluation and Testing products.
AI Evaluation and Testing
Braintrust is an AI evaluation platform for testing prompts, models, and application behavior with production-like datasets and scoring workflows.
Price$249 / month
Price position: above the category median.
Workflow Orchestration
Vellum helps teams design, test, and orchestrate prompt-driven workflows and LLM-powered products with a more controlled production pipeline.
Price$50+ / month
Starting price: at the category median.
AI Observability
Open-source LLM evaluation and observability platform from Comet.
Price$19 / month
Price position: below this category's displayed range.
DevSecOps Platforms
Checkmarx provides a comprehensive application security platform including software composition analysis, SAST, DAST, and API security for enterprise DevSecOps programs.
Price$2,500+ / month
Starting price: above the category median.
Behavioral Analytics Platforms
Amplitude is a digital analytics platform that helps product teams understand user behavior, run experiments, and drive growth through behavioral data analysis, A/B testing, and user journey...
Price$49+ / month
Starting price: below the category median.
AI Evaluation and Testing
End-to-end AI evaluation and monitoring platform for LLM product teams with prompt management and datasets.
Price$39+ / user / month
Starting price: below the category median.
AI Evaluation and Testing
LLM testing and evaluation platform with continuous testing pipelines.
Price$299+ / month
Starting price: above the category median.
AI Observability
LangWatch helps teams monitor prompts, traces, and quality signals across production LLM applications and agent workflows.
Price$65.38+ / month
Starting price: above the category median.
AI Agents & Sidekicks
Browserbase provides a reliable, managed browser infrastructure for AI agents, enabling web scraping, automated testing, and agent-based web interactions at scale.
Price$20+ / month
Price position: below this category's displayed range.
Prompt Engineering Tools
PromptLayer is a platform for prompt management, AI observability, evaluation workflows, and release control across LLM apps and agent systems.
Price$50+ / seat / month
Starting price: at the category median.
Code Security Scanning
Aikido Security brings together code, cloud, dependency, and runtime security workflows in a more approachable platform for modern engineering teams.
Price$314+ / month
Starting price: above the category median.
AI Observability
AgentOps is a developer platform for tracing, monitoring, testing, and debugging AI agents in development and production.
Price$40+ / month
Starting price: below the category median.
AI Annotation and Labeling
Data labeling platform built for NLP researchers with expert-quality human annotation and quality control.
PriceUsage-based
AI Observability
AI agent observability and evaluation platform reducing reliability issues in multi-agent LLM systems.
Price$99 / month
Price position: above the category median.
Architectural Design Software
ArchiCAD by Graphisoft provides BIM authoring software for architects with integrated design and documentation in a single model.
Price$245+ / month
Starting price: above the category median.
Video Interview Platforms
Structured interview platform with question libraries, scorecards, and collaborative evaluation for reducing hiring bias.
Price$49+ / month
Starting price: below the category median.
AI Evaluation and Testing
Open-source ML monitoring tool for evaluating, testing, and monitoring data and model quality in production.
Price$80 / month
Price position: above the category median.
Observability Platforms
Arize helps teams monitor, evaluate, and improve LLM applications, retrieval systems, and machine learning products once they are live in production.
Price$50+ / month
Starting price: at the category median.
Cubbie Points
