看 nvidia 官网教程:https://docs.nvidia.com/datacenter/cloud-native/container-too...

一下子就胜利了!

╰─➤  sudo docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.6.2-base-ubuntu20.04 nvidia-smiThu Aug 24 15:57:43 2023       +---------------------------------------------------------------------------------------+| NVIDIA-SMI 530.30.02              Driver Version: 530.30.02    CUDA Version: 12.1     ||-----------------------------------------+----------------------+----------------------+| GPU  Name                  Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC || Fan  Temp  Perf            Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. ||                                         |                      |               MIG M. ||=========================================+======================+======================||   0  Tesla M60                       On | 00000000:83:00.0 Off |              1048576 || N/A   27C    P8               15W / 150W|      0MiB /  7680MiB |      0%      Default ||                                         |                      |                  N/A |+-----------------------------------------+----------------------+----------------------+|   1  Tesla M60                       On | 00000000:84:00.0 Off |                  264 || N/A   35C    P8               14W / 150W|      0MiB /  7680MiB |      0%      Default ||                                         |                      |                  N/A |+-----------------------------------------+----------------------+----------------------+                                                                                         +---------------------------------------------------------------------------------------+| Processes:                                                                            ||  GPU   GI   CI        PID   Type   Process name                            GPU Memory ||        ID   ID                                                             Usage      ||=======================================================================================||  No running processes found                                                           |+---------------------------------------------------------------------------------------+