Curated software listings.
Groq provides the fastest AI inference platform using custom LPU hardware, delivering ultra-low latency responses for LLM applications at competitive per-token pricing.
LangDB gives teams an AI gateway layer for model routing, caching, tracing, and policy control across LLM-powered applications.
Smart LLM router that automatically selects the optimal model for each prompt based on quality and cost.
AI application development platform for testing, evaluation, and deployment of LLM systems.
LLM observability and evaluation platform for monitoring, debugging, and improving AI application performance.
Open-source observability platform for LLM applications with tracing, monitoring, and prompt versioning via OpenLLMetry.
Open-source framework for adding validation and structure to LLM outputs with customizable quality checks.
Python library for getting structured outputs from LLMs using Pydantic models for reliable data extraction.
AI gateway that logs, caches, and analyzes LLM requests for application developers.
Chinese AI lab developing Kimi, a long-context LLM assistant with 2M token capacity.
LLM monitoring and evaluation platform detecting hallucinations, toxicity, and quality issues in production AI.
LLM app platform with prompt engineering, evaluation, and observability for teams
LLM app analytics platform helping teams detect bugs and monitor user-LLM interactions in production.
Naver's hyperscale AI platform providing Korean-language LLM services and applications.
Unified LLM API gateway and observability platform for monitoring, testing, and optimizing AI applications across multiple providers.
AI platform running LLMs on everyday CPUs with compression techniques for cost-effective inference.
LLM orchestration library for building production AI applications with Python decorators.
Open-source front-end for LLMs providing character card support and roleplay features.
Universal LLM deployment engine with machine learning compilation for any device.
Open-source framework providing structured optimization, reliability, and observability for LLM applications.
Open-source LLM observability and analytics platform with logging, user analytics, and prompt templates.
LLM orchestration platform for routing prompts to optimal models based on cost, latency, and quality.
Open-source library for evaluating and tracking LLM and RAG application quality with feedback functions.
LLM routing platform benchmarking and routing requests to the best model-provider combination for each query.
Enterprise-grade inference stack letting ML teams deploy, serve, and scale open-source LLMs in production.
LLM analytics platform providing automated evaluation, monitoring, and insights for AI products.
LLM serving platform focused on private enterprise AI deployments.
ML deployment platform simplifying model serving and LLM fine-tuning on Kubernetes infrastructure.
AI development platform for building, fine-tuning, and deploying private LLM applications with observability.
Distributed training platform for accelerating LLM fine-tuning and pretraining.
LLM operations platform for managing prompts, models, and deployments in production with collaboration tools for AI product teams.