What is dstack?

dstack is an open-source container orchestration engine for running AI workloads across diverse cloud providers and on-prem data centers. It simplifies provisioning compute resources, managing dev environments, executing tasks on clusters, and deploying services.

Cloud and on-prem

dstack allows workload orchestration on both cloud and on-prem servers. Supported cloud providers include AWS, GCP, Azure, OCI, Lambda, TensorDock, Vast.ai, RunPod, and CUDO. For on-prem servers, see fleets.

Accelerators

dstack supports NVIDIA GPUs and Google Cloud TPUs out of the box.

How does it work?

Before using dstack, install the server and configure cloud credentials and other settings for each backend that you intend to use.

1. Define configurations

dstack supports three types of run configurations:

• Dev environments — for interactive development using a desktop IDE
• Tasks — for any kind of batch jobs or web applications (supports distributed jobs)
• Services— for production-grade deployment (supports auto-scaling and authorization)

Each type of run configuration allows you to specify commands for execution, required compute resources, retry policies, auto-scaling rules, authorization settings, and more.

Configuration can be defined as YAML files within your repo.

2. Run configurations

Run any defined configuration either via dstack CLI or API.

dstack automatically handles provisioning, interruptions, port-forwarding, auto-scaling, network, volumes, run failures, out-of-capacity errors, and more.

3. Manage fleets

Use fleets to provision and manage clusters and instances, both in the cloud and on-prem.

Where do I start?

1. Proceed to installation
2. See quickstart
3. Browse examples
4. Join Discord