gateway¶
The gateway configuration type allows creating and updating gateways.
Root reference¶
name - (Optional) str The gateway name.¶
default - (Optional) bool Make the gateway default.¶
backend - (Required) "amddevcloud" | "aws" | "azure" | "cloudrift" | "crusoe" | "cudo" | "datacrunch" | "digitalocean" | "dstack" | "gcp" | "hotaisle" | "kubernetes" | "lambda" | "local" | "remote" | "nebius" | "oci" | "runpod" | "tensordock" | "vastai" | "verda" | "vultr" The gateway backend.¶
region - (Required) str The gateway region.¶
instance_type - (Optional) str Backend-specific instance type to use for the gateway instance. Omit to use the backend's default, which is typically a small non-GPU instance.¶
router - (Optional) object The router configuration for this gateway. E.g. { type: sglang, policy: round_robin }..¶
domain - (Optional) str The gateway domain, e.g. example.com.¶
public_ip - (Optional) bool Allocate public IP for the gateway. Defaults to True.¶
certificate - (Optional) object The SSL certificate configuration. Set to null to disable. Defaults to type: lets-encrypt.¶
tags - (Optional) dict The custom tags to associate with the gateway. The tags are also propagated to the underlying backend resources. If there is a conflict with backend-level tags, does not override them.¶
router¶
type - (Required) "sglang" The router type enabled on this gateway.. Must be sglang.¶
policy - (Optional) "random" | "round_robin" | "cache_aware" | "power_of_two" The routing policy. Deprecated: prefer setting policy in the service's router config. Options: random, round_robin, cache_aware, power_of_two. Defaults to cache_aware.¶
certificate¶
Set to null to disable certificates (e.g. for private gateways).