Overview
Nvidia’s new RTX 5090 and RTX 5080 GPUs require CUDA 12.8. As of April 24, 2025, the latest stable release of PyTorch (2.7.0) supports this, and you should find success with the official pytorch docker images for CUDA 12.8.If you intend to run a workload both on 50-series gpus and older 40- or 30-series gpus, you will need to maintain
separate docker images. As of the time of this writing, older GPUs and their drivers do not have cuda 12.8 support, so
the image you have to build for the 50-series will not work on older GPUs.