宿主机系统 CUDA Toolkit12.8不用改动 NVIDIA 驱动是向下兼容的高驱动可以跑容器内 CUDA11.8 程序。1、安装 nvidia-container-toolkitdistribution$(. /etc/os-release;echo $ID$VERSION_ID) curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | sed s#deb https://#deb [signed-by/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list sudo apt update sudo apt install -y nvidia-container-toolkit sudo nvidia-ctk runtime configure --runtimedocker sudo systemctl restart docker2、直接使用 NGC 官方预构建镜像# 启动容器 docker run -it --gpus all \ --name trt85_infer \ -v /home/server/code:/workspace/code \ -v /home/server/data:/workspace/data \ nvcr.io/nvidia/tensorrt:22.12-py3