Managed gateways for serving LLMs across clouds
The dstack 0.11.1 update makes it easier to serve LLMs via public endpoints.
Services is a preview feature that allows serving LLMs via public endpoints using multiple clouds
(AWS, GCP, Azure, Lambda, etc.)
The latest update of dstack
makes the use of services much easier by introducing default gateways and wildcard domains.