How to Install Nvidia K80 Graphics Card on Proxmox Linux Ubuntu 22.04 Virtual Machine

1. Update and Upgrade
2. Run the following commands to install Cuda Compute on your Virtual Machine

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-4

Source: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=22.04&target_type=deb_network

3. Install Nvidia Container Toolkit in order to pass the Graphics Card into the Docker Container
 

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
  && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
    sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
    sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

  Run this Command:

sed -i -e '/experimental/ s/^#//g' /etc/apt/sources.list.d/nvidia-container-toolkit.list

Then Run this Command:

sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit

Source: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html