Alternatives to Relari

10 alternatives

  1. 1AI Evaluation and Testing

    Confident AI

    AI Evaluation and Testing

    LLM evaluation platform providing automated testing and benchmarking for AI applications with custom metrics.

    Llm evaluation with research backed metricsDataset management and auto curationGit based prompt versioning and management
  2. 2AI Evaluation and Testing

    BenchLLM

    AI Evaluation and Testing

    Open-source evaluation tool for testing and benchmarking LLM applications in CI/CD pipelines.

    Free planContinuous TestingLLM Orchestration
  3. 3AI Evaluation and Testing

    Vijil

    AI Evaluation and Testing

    AI trust platform providing automated evaluation and testing of LLM applications for safety and reliability.

    Open source guardrails frameworkProduction monitoring and drift detection
  4. 4AI Evaluation and Testing, AI Observability

    HoneyHive

    AI Observability

    AI evaluation and observability platform for testing, monitoring, and fine-tuning LLM applications in production.

    Distributed tracing of AI agent executionOnline evaluation and monitoringExperiment and regression tracking
  5. 5AI Evaluation and Testing, Synthetic Data Generation

    Okareo

    AI Evaluation and Testing

    AI application development platform for testing, evaluation, and deployment of LLM systems.

    Synthetic user simulation with multi turn conversationsVoice and text agent evaluationProduction monitoring and closed loop feedback
  6. 6AI Evaluation and Testing, AI Observability

    Parea

    AI Observability

    LLM observability and evaluation platform for AI teams with prompt testing and production monitoring.

    Free planFree trialTiered plansAI Evaluation and TestingLLM Orchestration
  7. 7AI Evaluation and Testing, AI Observability

    Agenta

    AI Evaluation and Testing

    Open-source platform for prompt engineering, evaluation, and deployment of LLM applications with team collaboration.

    Free planFree trialTiered plansAI AgentsAI Observability
  8. 8AI Evaluation and Testing, Synthetic Data Generation

    Patronus AI

    AI Evaluation and Testing

    AI evaluation platform for testing LLM safety, accuracy, and compliance before and during production deployment.

    Task generation and curation for AI model trainingSimulated environments and world modeling for reinforcement learningModel failure investigation and analysis
  9. 9AI Evaluation and Testing, AI Observability

    Laminar

    AI Observability

    Open source observability and evaluation platform for LLM applications with tracing.

    Automatic trace capture and visualizationAutomated failure detection and clusteringSignal cluster analysis and distribution tracking
  10. 10AI Evaluation and Testing

    Haize Labs

    AI Evaluation and Testing

    AI red teaming and safety platform that automatically discovers vulnerabilities in LLM applications through adversarial testing.

    AI AgentsAI Governance