Examples

Fine-tuning

Axolotl

Fine-tune Llama 4 on a custom dataset using Axolotl.

TRL

Fine-tune Llama 3.1 8B on a custom dataset using TRL.

Clusters

NCCL tests

Run multi-node NCCL tests with MPI

RCCL tests

Run multi-node RCCL tests with MPI

A3 Mega

Set up GCP A3 Mega clusters with optimized networking

A3 High

Set up GCP A3 High clusters with optimized networking

Distributed training

Ray+RAGEN

Fine-tune an agent on multiple nodes with RAGEN, verl, and Ray.

Inference

SGLang

Deploy DeepSeek distilled models with SGLang

vLLM

Deploy Llama 3.1 with vLLM

TGI

Deploy Llama 4 with TGI

NIM

Deploy a DeepSeek distilled model with NIM

TensorRT-LLM

Deploy DeepSeek models with TensorRT-LLM

Accelerators

AMD

Deploy and fine-tune LLMs on AMD

TPU

Deploy and fine-tune LLMs on TPU

Intel Gaudi

Deploy and fine-tune LLMs on Intel Gaudi

Tenstorrent

Deploy and fine-tune LLMs on Tenstorrent

LLMs

Deepseek

Deploy and train Deepseek models

Llama

Deploy Llama 4 models

Misc

Docker Compose

Use Docker and Docker Compose inside runs