1. Setup realtime kernel.
  2. Setup nvidia driver, extra steps needed when on a self-compiled rt kernel.
  3. Install NVIDIA Container Toolkit
  4. check nvidia status
     watch -n 1 nvidia-smi
    
  5. Install docker via apt. Do the post-installation setup.
  6. Run a sample for nvidia docker

install nvidia driver on self compiled rt ubuntu kernel:

gist