Lambda Cloud GA, and Docker support¶
The 0.10.5 release improves Lambda Cloud integration and adds support for Docker.
In the previous update, we added initial integration with Lambda Cloud. With today's release, this integration has significantly improved and finally goes generally available. Additionally, the latest release adds support for custom Docker images.
In this update, we've added a possibility to create Lambda Cloud projects via the user interface.
All you need to do is provide your Lambda Cloud API key, and specify an S3 bucket and AWS credentials for storing state and artifacts.
Once the project is configured, feel free to run dev environments and tasks in Lambda Cloud using the
Custom Docker images¶
dstack uses its own base Docker images to run
dev environments and tasks. These base images come pre-configured with Python, Conda, and essential CUDA drivers.
However, there may be times when you need additional
dependencies that you don't want to install every time you run your dev environment or task.
To address this,
dstack now allows specifying custom Docker images. Here's an example:
type: task image: ghcr.io/huggingface/text-generation-inference:0.9 env: - MODEL_ID=tiiuae/falcon-7b ports: - 3000 commands: - text-generation-launcher --hostname 0.0.0.0 --port 3000 --trust-remote-code
Dev environments require the Docker image to have
openssh-server pre-installed. If you want to use a custom Docker
image with a dev environment and it does not include
openssh-server, you can install it using the following
type: dev-environment image: ghcr.io/huggingface/text-generation-inference:0.9 build: - apt-get update - DEBIAN_FRONTEND=noninteractive apt-get install -y openssh-server - rm -rf /var/lib/apt/lists/* ide: vscode
Give it a try¶
Getting started with
dstack takes less than a minute. Go ahead and give it a try.
$ pip install "dstack[aws,gcp,azure,lambda]" -U $ dstack start