The dstack 0.11.1 update makes it easier to serve LLMs via public endpoints.
Services is a preview feature that allows serving LLMs via public endpoints using multiple clouds
(AWS, GCP, Azure, Lambda, etc.)
The latest update of
dstack makes the use of services much easier by introducing default gateways and wildcard domains.