AI Verify (IMDA)
AI Evaluation and Testing
Open-source AI governance testing framework by Singapore's IMDA for assessing AI system trustworthiness.
Free planAI GovernanceLLM Evaluation
Alternatives to Eticas
- 1AI Evaluation and Testing, AI Governance
- 2AI Governance
Parity AI
AI Governance
AI compliance platform helping organizations meet algorithmic accountability requirements and bias regulations.
Free plan - 3AI Evaluation and Testing
Kolena
AI Evaluation and Testing
ML testing platform for comprehensive model evaluation with scenario-based testing and regression detection.
AI powered document extraction and analysisPre built agent library with industry specific workflowsContinuous model benchmarking and optimization - 4AI Evaluation and Testing, AI Governance
Giskard
AI Evaluation and Testing
Open-source AI quality and testing platform for detecting vulnerabilities, biases, and hallucinations in ML models.
Automated adversarial red teaming for llm agentsLlm vulnerability detection and classificationDomain specific quality evaluation dataset generation - 5AI Evaluation and Testing, AI Governance
Haize Labs
AI Evaluation and Testing
AI red teaming and safety platform that automatically discovers vulnerabilities in LLM applications through adversarial testing.
AI AgentsAI Governance - 6AI Evaluation and Testing, AI Governance
Openlayer
AI Evaluation and Testing
ML testing and evaluation platform for catching model failures before and after deployment to production.
AI system discovery and inventoryProduction monitoring and observabilityCost tracking and optimization - 7AI Evaluation and Testing, AI Governance
Vijil
AI Evaluation and Testing
AI trust platform providing automated evaluation and testing of LLM applications for safety and reliability.
Open source guardrails frameworkProduction monitoring and drift detection - 8AI Evaluation and Testing
Braintrust
AI Evaluation and Testing
Braintrust is an AI evaluation platform for testing prompts, models, and application behavior with production-like datasets and scoring workflows.
Real time trace inspection and loggingLlm based and custom code evaluationExperiment management and comparisonPrice$249 / month
Price position: above the category median. - 9AI Evaluation and Testing
Confident AI
AI Evaluation and Testing
LLM evaluation platform providing automated testing and benchmarking for AI applications with custom metrics.
Llm evaluation with research backed metricsDataset management and auto curationGit based prompt versioning and management - 10AI Evaluation and Testing
Promptfoo
AI Evaluation and Testing
Open-source tool for testing and evaluating LLM prompts, models, and RAG pipelines with side-by-side comparisons.
Llm red teamingVulnerability scanningPrompt evaluation and testing
