Benchmarking Llama 3.1 405B on 8x AMD MI300X GPUs
At dstack, we've been adding support for AMD GPUs with SSH fleets,
so we saw this as a great chance to test our integration by benchmarking AMD GPUs. Our friends at
Hot Aisle , who build top-tier
bare metal compute for AMD GPUs, kindly provided the hardware for the benchmark.
