gateway

The gateway configuration type allows creating and updating gateways.

Root reference

name - (Optional) The gateway name.

default - (Optional) Make the gateway default.

backend - The gateway backend.

region - The gateway region.

router - (Optional) The router configuration.

domain - (Optional) The gateway domain, e.g. example.com.

public_ip - (Optional) Allocate public IP for the gateway. Defaults to True.

certificate - (Optional) The SSL certificate configuration. Defaults to type: lets-encrypt.

tags - (Optional) The custom tags to associate with the gateway. The tags are also propagated to the underlying backend resources. If there is a conflict with backend-level tags, does not override them.

router

SGLang Model Gateway

type - The router type. Must be sglang.

policy - (Optional) The routing policy. Options: random, round_robin, cache_aware, power_of_two. Defaults to cache_aware.

certificate

Let's encryptACM

type - Automatic certificates by Let's Encrypt. Must be lets-encrypt.

type - Certificates by AWS Certificate Manager (ACM). Must be acm.

arn - The ARN of the wildcard ACM certificate for the domain.