Infrastructure platforms for building, deploying, and managing applications that chain multiple LLM calls, tools, and data sources together.
OpenRouter is a unified API and routing layer for accessing, comparing, and managing multiple AI models through one developer-facing endpoint.
LangDB gives teams an AI gateway layer for model routing, caching, tracing, and policy control across LLM-powered applications.
AI application development platform for testing, evaluation, and deployment of LLM systems.
LLM observability and evaluation platform for monitoring, debugging, and improving AI application performance.
Framework for programming language models with automatic prompt optimization and pipeline compilation.
LLM evaluation platform providing automated testing and benchmarking for AI applications with custom metrics.
Python toolkit for building LLM applications with clean abstractions for prompts, calls, and structured extraction.
Evaluator model platform providing AI-powered judges for evaluating LLM outputs reliably.
Java framework for building AI applications providing abstractions for LLMs, embeddings, and vector stores.
Open-source framework for building conversational AI interfaces with LLM applications and agent workflows.
compresr provides LLM context compression technology that reduces token usage while maintaining output quality, integrated with tools like Claude Code.
Open-source evaluation tool for testing and benchmarking LLM applications in CI/CD pipelines.
Flowise is an open-source UI visual tool for building customized LLM orchestration flows and AI agents using a drag-and-drop interface with LangChain integration.
LLM monitoring and evaluation platform detecting hallucinations, toxicity, and quality issues in production AI.
LLM app analytics platform helping teams detect bugs and monitor user-LLM interactions in production.
LLM observability and monitoring platform detecting hallucinations, toxicity, and quality issues in production.
AI model router that automatically selects the best LLM for each query based on cost, latency, and quality optimization.
Open source toolkit for building LLM applications and agents in TypeScript
Out of 56 products here. A product can suit more than one size, and one that states none is in no bar.
