Infrastructure platforms for building, deploying, and managing applications that chain multiple LLM calls, tools, and data sources together.
LLM Orchestration
OpenRouter is a unified API and routing layer for accessing, comparing, and managing multiple AI models through one developer-facing endpoint.
PriceUsage-based
API Gateway
LangDB gives teams an AI gateway layer for model routing, caching, tracing, and policy control across LLM-powered applications.
PriceUsage-based
Workflow Orchestration
Vellum helps teams design, test, and orchestrate prompt-driven workflows and LLM-powered products with a more controlled production pipeline.
Price$50+ / month
Starting price: at the category median.LLM Orchestration
Evaluator model platform providing AI-powered judges for evaluating LLM outputs reliably.
PriceUsage-based
LLM Orchestration
compresr provides LLM context compression technology that reduces token usage while maintaining output quality, integrated with tools like Claude Code.
PriceUsage-based
LLM Orchestration
Flowise is an open-source UI visual tool for building customized LLM orchestration flows and AI agents using a drag-and-drop interface with LangChain integration.
Price$35 / month
Price position: below the category median.
LLM Ops
LLM app analytics platform helping teams detect bugs and monitor user-LLM interactions in production.
Price$79 / month
Price position: above the category median.LLM Orchestration
LLM observability and monitoring platform detecting hallucinations, toxicity, and quality issues in production.
Price$49 / month
Price position: below the category median.
AI Observability
AI agent observability and evaluation platform reducing reliability issues in multi-agent LLM systems.
Price$99 / month
Price position: above the category median.
LLM Ops
LLM routing platform benchmarking and routing requests to the best model-provider combination for each query.
Price$75+ / month
Starting price: above the category median.
LLM Ops
LLM operations platform for managing prompts, models, and deployments in production with collaboration tools for AI product teams.
Price$5+ / month
Price position: below this category's displayed range.
LLM Orchestration
Smart LLM router that automatically selects the optimal model for each prompt based on quality and cost.
PriceUsage-based
AI Agents
Mastra is a TypeScript framework for building AI agents, workflows, and retrieval systems with a developer-first, production-oriented approach.
AI Evaluation and Testing
AI application development platform for testing, evaluation, and deployment of LLM systems.
AI Observability
LLM observability and evaluation platform for monitoring, debugging, and improving AI application performance.
LLM Orchestration
Framework for programming language models with automatic prompt optimization and pipeline compilation.
AI Evaluation and Testing
LLM evaluation platform providing automated testing and benchmarking for AI applications with custom metrics.
LLM Orchestration
Python toolkit for building LLM applications with clean abstractions for prompts, calls, and structured extraction.
