Skip to Content
Control & ConfigurationGateway Provider Configuration

Gateway Provider Configuration

If you are on a Gateway plan (or provide an API Key for the Gateway), you can configure how the Gateway chooses and uses AI providers. These settings are available in Settings → Providers (or the equivalent provider settings area).

Provider ordering

You can set the order in which providers are tried when a model is requested. Providers at the top of the list are preferred; others are used if needed (e.g. for fallback or capacity). This lets you favor certain providers or regions.

  • In settings, find the Provider Order (or similar) control.
  • Add or reorder the providers you want. Providers not in the list may still be used after the ones you specified.

Provider whitelist

You can whitelist which backends the Gateway may use for models. When the whitelist is empty, all routed backends are allowed. When you add backends, only those appear in your model catalog and routing context. This is useful for compliance, cost control, or vendor preference.

  • In settings, find Provider Whitelist (or similar).
  • Leave the list empty to allow every gateway backend, or add providers to limit to that set.

Note: Provider order and provider whitelist are mutually exclusive in the UI: you configure one or the other, not both at once. Follow the in-app labels.

Zero Data Retention

Gateway plans can enable Zero Data Retention (ZDR). When ZDR is on, only providers that have a zero data retention agreement with the Gateway are used. Your prompts and responses are not stored by those providers beyond what is needed for the API call.

  • In settings, find Zero Data Retention (or similar).
  • Turn it on to restrict usage to ZDR-capable providers. Turn it off to allow all Gateway providers again.

For more on what zero data retention means for your data, see Zero Data Retention.

Where to configure

All of the above are Gateway options. Open Settings → Providers (or Provider options for the Gateway) and adjust provider order, whitelist, and zero data retention as needed. Changes apply to new requests immediately.

If you use BYOK instead of the Gateway, see BYOK Provider Configuration.

Last updated on
Model metadata & transparencyAvailable Providers