Monitoring and analytics platforms specifically designed to track the performance, cost, latency, and quality of AI and LLM applications in production.
Datadog is a cloud-scale monitoring and analytics platform that provides full-stack observability for infrastructure, applications, logs, and security. It unifies metrics, traces, and logs i...
LangSmith is LangChain's platform for debugging, testing, evaluating, and monitoring LLM applications and agent workflows.
Axiom is a log management and observability platform offering unlimited data ingest, fast querying, and real-time dashboards at a fraction of the cost of traditional log analytics tools.
Langfuse is an open-source platform for tracing, prompt management, evaluations, and observability across LLM applications and agent systems.
LangWatch helps teams monitor prompts, traces, and quality signals across production LLM applications and agent workflows.
Arize helps teams monitor, evaluate, and improve LLM applications, retrieval systems, and machine learning products once they are live in production.
PromptLayer is a platform for prompt management, AI observability, evaluation workflows, and release control across LLM apps and agent systems.
AgentOps is a developer platform for tracing, monitoring, testing, and debugging AI agents in development and production.
LLM observability and evaluation platform for monitoring, debugging, and improving AI application performance.
Enterprise AI testing platform focused on stability and reliability testing for generative AI applications.
Invariant builds security, guardrails, and observability tooling for AI agents, including agent behavior inspection and MCP security scanning.
Open-source observability platform for LLM applications with tracing, monitoring, and prompt versioning via OpenLLMetry.
AI observability platform providing data and model monitoring with drift detection and anomaly identification.
Data observability platform that monitors pipelines for quality issues.
Data observability and governance platform monitoring data quality, freshness, and schema changes across sources.
AI platform that automatically configures security tool policies.
AI observability platform for monitoring, explaining, and analyzing ML model predictions in production.
API observability and security platform providing automated API documentation, security testing, and runtime monitoring.
AI model monitoring and data quality platform for production machine learning across multiple cloud.
AI-driven service ownership platform providing visibility into microservices and dependencies.
Open-source LLM evaluation and observability tool for production AI pipelines.
LLM app platform with prompt engineering, evaluation, and observability for teams
Dagster is an open-source data orchestration platform for building, testing, and maintaining data pipelines with integrated lineage, observability, and asset-based workflows.
AI quality management platform for monitoring model performance, explaining predictions, and testing for fairness.
AI deepfake and synthetic media detection platform for enterprises.
End-to-end AI evaluation and monitoring platform for LLM product teams with prompt management and datasets.
AI production engineering platform that troubleshoots and resolves software issues automatically.
Unified LLM API gateway and observability platform for monitoring, testing, and optimizing AI applications across multiple providers.
ML observability platform providing real-time monitoring, alerting, and investigation for production models.
API analytics and monetization platform providing visibility, alerts, and billing for API products.
Open-source platform for prompt engineering, evaluation, and deployment of LLM applications with team collaboration.
ML observability platform for monitoring model performance and data integrity with customizable metrics.
Causal AI platform for observability automatically diagnosing root causes in cloud applications.
AI evaluation and testing platform for LLM applications with synthetic data generation.
AI observability and evaluation platform for LLM and traditional ML models.
Data quality observability platform with ML-powered anomaly detection and automated incident management.
AI evaluation and observability platform for testing, monitoring, and fine-tuning LLM applications in production.
AI agent observability and evaluation platform reducing reliability issues in multi-agent LLM systems.
AI governance platform that operationalizes responsible AI policy.
AI-powered endpoint protection platform now part of Arctic Wolf.
LLM observability and evaluation platform for AI teams with prompt testing and production monitoring.
Security data pipeline platform optimizing cost and quality for SIEM and SOAR ingestion.
ML observability platform for monitoring models in production with drift and performance tracking.
Cloud native observability platform with tracing, metrics, and logs for Kubernetes
Developer platform for building, evaluating, and deploying generative AI applications to production.
Open-source LLM observability and analytics platform with logging, user analytics, and prompt templates.
Simulation and evaluation platform for voice and chat AI agents.
observIQ unified telemetry pipeline platform for collecting, processing, and routing data.
Performance and error monitoring platform for Next.js and React applications.
Autonomous data operations cloud monitoring warehouse cost, quality, and reliability.
AI runtime assistant that analyzes code behavior with AppMap traces to answer questions and generate architecture diagrams.
Identity and access risk platform with AI-powered privilege detection.
ML monitoring platform that automatically detects data quality issues and model degradation in production.
Unlimited ingest log analytics and SIEM platform for unstructured data at scale.
IDE extension from New Relic putting code review, discussion, and observability tools inside your editor.
LLM ops platform helping product teams experiment, evaluate, and observe generative AI features.
Cribl provides a data engine for IT and security teams that collects, parses, routes, and enriches observability data from any source to any destination.
Open-source APM tool for large-scale distributed systems written in Java and PHP.
Evaluation and observability platform for generative AI products.
Intergral Java APM and observability platform for Java, ColdFusion, and CFML apps.