Skip to content

Changelog

dstack 0.16.0: Pools

Previously, when running a dev environment, task, or service, dstack provisioned an instance in a configured backend, and upon completion of the run, deleted the instance.

In the latest update, we introduce pools, a significantly more efficient way to manage instance lifecycles and reuse instances across runs.

dstack 0.15.1: Kubernetes integration

In addition to a few bug fixes, the latest update brings initial integration with Kubernetes (experimental) and adds the possibility to configure a custom VPC for AWS. Read below for more details.

dstack 0.14.0: OpenAI-compatible endpoints preview

The service configuration deploys any application as a public endpoint. For instance, you can use HuggingFace's TGI or other frameworks to deploy custom LLMs. While this is simple and customizable, using different frameworks and LLMs complicates the integration of LLMs.

dstack 0.12.3: Vast.ai integration

dstack simplifies gen AI model development and deployment through its developer-friendly CLI and API. It eliminates cloud infrastructure hassles while supporting top cloud providers (such as AWS, GCP, Azure, among others).

While dstack streamlines infrastructure challenges, GPU costs can still hinder development. To address this, we've integrated dstack with Vast.ai, a marketplace providing GPUs from independent hosts at notably lower prices compared to other providers.