All 31 products

European multi-modality AI gateway: LLM chat behind an OpenAI-compatible endpoint plus OCR, speech, translation and vision APIs, billed at provider cost with a 5.5% fee on credit purchases.

France company · EU region available

Cost above the model bill

5.5% to top up

No markup on tokens, fee applies when you add funds

Models

1,158

across 33–68 providers

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for Teams that need OCR, speech, translation or document parsing alongside LLM calls under one contract, one prepaid balance and EU data residency, and who are happy to build routing policy per request.

Zero-markup routing layer that fans a single Hugging Face token out to 18 third-party inference partners.

US company

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

127

across 14–18 providers

• Failover
• Spend limits
• Logs

Best for Teams calling open-weight models who want one token, one bill and genuinely zero markup across 18 serverless providers, with automatic failover they do not have to configure.

Hosted marketplace that routes one OpenAI-compatible API to models from many inference providers.

US company · EU region available

Acquisition pending

Cost above the model bill

5.5% to top up

No markup on tokens, fee applies when you add funds

Models

458

across ~83 providers

• Failover
• Spend limits
• Logs
• Caching

Best for Teams that want the broadest possible model and provider catalog behind one OpenAI-compatible key with unified billing.

Hosted router with a flat 5% fee on inference, EU data residency and enterprise governance controls.

UK company · EU region available

Cost above the model bill

+5% on tokens

Added to the underlying model price

Models

759

count not published

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for European teams that want one router with EU data residency, PII scrubbing and a predictable flat 5% fee.

Hosted access to text, image and video models through one account.

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

94

across 20+ providers

• Failover
• Logs

Best for Developers evaluating consolidated access to language and media models.

Hosted AI routing, budget enforcement and policy controls with metadata-based reporting.

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

—

across 11 providers

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for Teams evaluating hosted budget and policy controls with metadata-based reporting.

Multi-provider gateway inside Braintrust's eval and observability platform, with caching and span-level tracing.

US company · EU region available

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~100

across 9 providers

• Failover
• Logs
• Caching

Best for Teams that already run evals and tracing in Braintrust and want their model traffic to flow through the same platform.

Open-source LLM observability platform with an OpenAI-compatible AI gateway attached.

US company · EU region available

Maintenance mode

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

~100

across 20–100 providers

• Failover
• Logs
• Caching

Best for Teams whose main need is per-request, per-user LLM observability with a thin gateway bolted on, ideally self-hosted.

AI plugins on the Kong API gateway, adding LLM routing, guardrails and token limits to existing API infrastructure.

US company

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

—

across 17 providers

• Failover
• Logs
• Semantic cache
• Guardrails

Best for Enterprises already standardized on Kong for API management that want AI traffic governed by the same gateway, plugins and ops tooling.

Hosted-only LLM gateway from the Merge unified-API company, sold on intelligent cost routing, spend governance and per-customer controls; launched 31 March 2026.

US company

Cost above the model bill

+5% on tokens

Added to the underlying model price

Models

3

across 4–24 providers

• Failover
• Spend limits
• Logs
• Guardrails

Best for Teams whose LLM bill has become a margin problem and who want routing, budgets and per-customer controls as a managed service — especially B2B products that need to hand each of their own customers separate routing policies, credentials and spend limits without building that plumbing.

Managed EU-hosted AI gateway and router bundled with evaluation, observability and governance tooling.

Netherlands company · EU region available

Cost above the model bill

4.5% to top up

No markup on tokens, fee applies when you add funds

Models

~500

count not published

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for European teams that want an EU-resident managed gateway with governance, evaluations and observability in one platform rather than a bare proxy.

Open-core AI gateway with a hosted control plane for observability, prompt management and governance.

US company

Acquired

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

250–2,300

across 40–48 providers

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for Teams that want governance, guardrails and prompt management in one control plane, with the option to self-host the routing engine.

Multi-provider routing with integrated tracing, evaluations and prompt management.

US company · EU region available

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

627

count not published

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for Teams wanting gateway routing, tracing, evaluations and prompt management in one platform.

Vercel-operated gateway that routes AI SDK and OpenAI-format requests to many providers with zero token markup.

US company

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

413

count not published

• Failover
• Spend limits
• Logs
• Caching

Best for Teams already shipping on Vercel with the AI SDK who want zero token markup and no credit-purchase fee.

Rust single-binary gateway for LLM, MCP, A2A and ordinary HTTP traffic, run entirely on your own infrastructure.

Cost above the model bill

Self-hosted

Self-hosting is the only mode and it is free of vendor charges. The binary is a single Rust process (13-22 MB resident in the project's own benchmark runs), so the practical floor is one small container plus, optionally, SQLite or PostgreSQL if you want USD budgets, the cost dashboard or database-backed request logs ([Database](https://agentgateway.dev/docs/standalone/latest/setup/database/), [benchmark](https://agentgateway.dev/blog/2026-06-26-benchmarking-agentgateway-vs-litellm-part-2/)).

Models

~1,002

across 20–44 providers

• Failover
• Spend limits
• Logs
• Guardrails

Best for Platform teams that already run Kubernetes or Envoy-style infrastructure and want one Rust data plane in front of LLM, MCP, A2A and ordinary HTTP traffic, with per-key USD budgets and guardrails defined in version-controlled YAML.

AI proxy plugins for the Apache APISIX API gateway, adding LLM routing and token limits to an OpenResty data plane.

US company

Cost above the model bill

Self-hosted

No license cost at all; you run APISIX and its etcd control store on your own infrastructure. The docs are co-branded with API7, a commercial vendor offering a supported distribution, whose pricing is not published on these pages.

Models

—

across 10–20 providers

• Failover
• Logs
• Guardrails

Best for Teams already running APISIX that want basic multi-provider LLM proxying, retries and token-based rate limiting without adding another gateway.

Go-based open-source AI gateway focused on low proxy overhead, with an enterprise tier for clustering and SSO.

US company

Cost above the model bill

Self-hosted

OSS is free (Apache-2.0); infra cost only. Enterprise adds guardrails, cluster mode, adaptive load balancing, SAML/OIDC SSO, vault integration, log exports, audit logs, RBAC and SLAs at custom pricing after a 14-day trial; VPC, on-prem and air-gapped installs are enterprise options.

Models

—

across 20–23 providers

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for Teams that want a fast Go gateway they can self-host for free and later buy clustering, SSO and guardrails from a single vendor.

Kubernetes-native open-source AI gateway that adds a unified LLM and MCP data plane on top of CNCF Envoy Gateway, with a stable v1beta1 CRD API and no vendor-hosted tier.

Cost above the model bill

Self-hosted

Self-hosting is the only mode and carries no licence fee: `helm upgrade -i aieg-crd oci://docker.io/envoyproxy/ai-gateway-crds-helm` followed by `helm upgrade -i aieg oci://docker.io/envoyproxy/ai-gateway-helm` ([installation](https://aigateway.envoyproxy.io/docs/getting-started/installation)). Real cost drivers are the Envoy Gateway control plane and Envoy data plane it requires, the AI Gateway controller (documented starting requests 100m CPU / 128Mi, limits 500m / 256Mi, HPA example min 2 max 10 replicas at 70% CPU) and a Redis instance if you enable token rate limiting or quotas ([scaling](https://aigateway.envoyproxy.io/docs/capabilities/scaling); [rate limiting](https://aigateway.envoyproxy.io/docs/capabilities/traffic/usage-based-ratelimiting), 2026-09-02).

Models

—

across 16–19 providers

• Failover
• Spend limits
• Logs

Best for Platform teams already running Envoy Gateway or Gateway API on Kubernetes who want provider-agnostic LLM and MCP routing, cloud-native upstream credential handling and OpenTelemetry GenAI telemetry as ordinary infrastructure, with a stable CRD API and no vendor in the request path.

Envoy/Istio-based Kubernetes and microservice gateway from Alibaba, now a CNCF Sandbox project, whose Wasm plugin set turns it into an LLM and MCP gateway.

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

~100

across 26–31 providers

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for Teams already running Kubernetes who want one Envoy-based gateway for north-south traffic, microservices and LLM/MCP calls, and who are happy to assemble reliability and guardrail behaviour from plugin fields themselves.

Open-source AI gateway and Python SDK that puts one OpenAI-compatible API in front of many LLM providers.

US company

Cost above the model bill

Self-hosted

OSS is free (MIT); you pay only for your own containers plus Postgres and Redis. Enterprise features (SSO, RBAC, JWT auth, SCIM, audit logs, support SLAs) require a paid LiteLLM commercial license whose price is not published.

Models

—

count not published

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for Platform teams that want a free, self-hosted, maximally broad provider abstraction with virtual keys and budgets, at moderate request volumes.

AGPL-licensed OpenAI-compatible gateway available as one self-hosted Docker image or a hosted service with credit fees.

US company

Cost above the model bill

5% to top up

No markup on tokens, fee applies when you add funds

Models

~200

across ~40 providers

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for Small teams that want an OpenRouter-style hosted gateway with a genuine zero-cost self-host escape hatch and no token markup.

AI gateway that ships inside the MLflow Tracking Server: OpenAI-compatible routing over encrypted provider connections, with guardrails, budgets and every request landing as an MLflow trace.

US company

Cost above the model bill

No markup

You pay the model provider’s own prices

Models

—

across 14–100 providers

• Failover
• Spend limits
• Logs
• Guardrails

Best for Teams already running MLflow for tracing and evaluation who want governed, OpenAI-compatible LLM access on the same server — no second system to deploy, and every gateway request lands as a trace they can evaluate.

Self-hosted Go gateway that fans 30+ upstream model providers into one OpenAI-compatible endpoint, with a full user, token and quota billing system bolted on.

Cost above the model bill

Self-hosted

You pay only for your own infrastructure and upstream provider spend: the software is AGPLv3 and "can be used for free" so long as the licence is observed, with a paid commercial licence available by email for AGPL-exempt use ([Project Introduction](https://www.newapi.ai/en/docs/guide/wiki/basic-concepts/project-introduction)). Production sizing implies a MySQL and a Redis alongside the gateway ([Cluster Deployment](https://www.newapi.ai/en/docs/installation/deployment-methods/cluster-deployment)).

Models

100+

across 30+ providers

• Failover
• Spend limits
• Logs
• Guardrails

Best for Teams that want to self-host one multi-dialect gateway and also *bill* the people behind it - per-token quotas, groups, ratios, top-ups and subscription plans - with no vendor in the request path and no vendor fee ([Project Introduction](https://www.newapi.ai/en/docs/guide/wiki/basic-concepts/project-introduction), [Token Management](https://www.newapi.ai/en/docs/guide/feature-guide/user/token), [System Settings - Detailed](https://www.newapi.ai/en/docs/guide/feature-guide/admin/system-setting-advanced)).

AWS-managed service for calling foundation models from 19 model providers through one AWS API.

US company

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~100

count not published

• Caching
• Guardrails

Best for Teams already standardized on AWS that need many model vendors behind one IAM-governed, compliance-attested API.

Microsoft's Azure platform for deploying models from its own and partner catalogs, now branded Microsoft Foundry.

US company · EU region available

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~10,000

count not published

• Logs
• Guardrails

Best for Microsoft-centric enterprises that want first-party OpenAI models plus a very large partner catalog under Azure governance.

Edge proxy in front of a curated set of AI providers, with caching, rate limiting, DLP and analytics.

US company

Cost above the model bill

5% to top up

No markup on tokens, fee applies when you add funds

Models

—

across 24 providers

• Failover
• Spend limits
• Logs
• Caching
• Guardrails

Best for Teams already on Cloudflare Workers who want free caching, analytics, spend limits, DLP and guardrails at the edge.

Google Cloud's model platform for Gemini plus 200+ Model Garden models, now branded Gemini Enterprise Agent Platform.

US company · EU region available

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~200

count not published

• Caching

Best for Google Cloud customers who want Gemini alongside third-party models with strong, explicitly documented EU residency and ZDR controls.

Closed-source enterprise AI gateway sold on request tiers, deployable as SaaS or inside the customer's own cloud.

India company

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~1,000

across 27 providers

• Failover
• Spend limits
• Logs
• Semantic cache
• Guardrails

Best for Enterprises that want a fully managed or in-VPC AI gateway with guardrails, MCP governance and SSO/RBAC, and are comfortable with closed source.

Inference provider serving open-weight models on its own stack, with fine-tuning and dedicated deployments.

US company

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

~20

count not published

Best for Teams wanting fast serving of open-weight models with tiered latency options and both supervised and reinforcement fine-tuning.

Inference provider running open-weight models on its own LPU hardware for very high output speed.

US company · no EU region

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

11

count not published

Best for Latency-sensitive, user-facing applications on open-weight models where output speed matters more than catalog breadth.

Inference provider running open-weight models on its own GPUs, with fine-tuning and dedicated endpoints.

US company

Cost above the model bill

See pricing

Not published in a directly comparable form

Models

264

count not published

• Guardrails

Best for Teams that want a broad open-weight catalog plus cheap fine-tuning and the option to move to dedicated GPUs on one vendor.