Model Inference Deployment

Prem AI

LLM Ops

AI development platform for building, fine-tuning, and deploying private LLM applications with observability.

LightOn

AI Infrastructure

European AI company building sovereign LLM infrastructure and models for enterprises with private deployments.

Verta

Machine Learning Platforms

MLOps platform for model management, deployment, and monitoring with model registry and experiment tracking.

Martian

LLM Orchestration

Smart LLM router that automatically selects the optimal model for each prompt based on quality and cost.

Tecton

Feature Stores

Enterprise feature platform for managing and serving ML features in production with real-time data pipelines.

KServe

MLOps Platforms

Kubernetes-based model inference platform for standardized serverless serving of machine learning models.

Inferless

Machine Learning Platforms

Serverless ML model deployment platform with fast scaling for custom inference at production scale.

Featurebyte

Feature Stores

Data and feature platform for creating, serving, and governing AI features.

Zipline

Feature Stores

Feature store platform for ML engineers to simplify data retrieval for machine learning.

Beam

Serverless Platforms

Serverless GPU cloud for deploying AI workloads with automatic scaling and persistent storage for model artifacts.

Open source AI platform for building, evaluating, and deploying foundation models.

Friendli

Software

Generative AI engine platform for serving LLMs with optimized inference performance.