Skip to content

CUDA 13.2 and torch 2.12.1 compatible Dockerfile. Volta (SM70) support dropped#110

Merged
azrael417 merged 9 commits into
masterfrom
tkurth/cuda-13-upgrade
Jul 8, 2026
Merged

CUDA 13.2 and torch 2.12.1 compatible Dockerfile. Volta (SM70) support dropped#110
azrael417 merged 9 commits into
masterfrom
tkurth/cuda-13-upgrade

Conversation

@azrael417

Copy link
Copy Markdown
Collaborator

This MR updates the Dockerfile to support CUDA 13.2.

@azrael417 azrael417 requested a review from romerojosh July 7, 2026 13:17
@azrael417 azrael417 self-assigned this Jul 7, 2026
…t dropped

Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
@azrael417 azrael417 force-pushed the tkurth/cuda-13-upgrade branch from a519140 to bd68e86 Compare July 7, 2026 13:19
azrael417 and others added 8 commits July 7, 2026 06:22
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
…u 24.04 (#111)

Mirror the CUDA 13.2 + torch 2.12.1 upgrade into Dockerfile_gnu (CUDA base
image 13.2.0, HPCX cuda13 build, updated pip deps). Move both Dockerfile and
Dockerfile_gnu to ubuntu24.04, which requires:
- --break-system-packages on pip installs (PEP 668 / externally managed py3.12)
- python3.10 -> python3.12 dist-packages paths

Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Match the other Dockerfiles: bump base to ubuntu:24.04 and CPU torch to
2.12.1. Ubuntu 24.04 ships Python 3.12 (PEP 668 externally managed), so add
--break-system-packages to pip installs and update the python3.10 -> python3.12
dist-packages path.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
The CUDA -devel base image ships no NCCL, so cmake's fallback system search
for nccl.h failed. Install nvidia-nccl-cu13 via pip, add the libnccl.so
symlink, and set TORCHFORT_NCCL_ROOT to it -- matching the nvhpc Dockerfile.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
torch 2.12.1/cu132 requires libnvshmem_host.so.3, which the plain CUDA devel
image does not ship (the NVHPC SDK does, which is why the nvhpc Dockerfile
works without it). Without it `import torch` fails, breaking the cmake
CMAKE_PREFIX_PATH query. Install nvidia-nvshmem-cu13==3.4.5 (torch's pin) and
add its lib dir to LD_LIBRARY_PATH.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
Signed-off-by: Thorsten Kurth <tkurth@nvidia.com>
@azrael417 azrael417 merged commit ff96d77 into master Jul 8, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants