After searching the internet for some time I found this link which is the only one explaining how to manually install the needed version in Option 2: https://www.linuxcapable.com/install-nvidia-510-47-xx-drivers-on-ubuntu-20-04-lts/
Basically the method is that you need to download the drivers from the NVIDIA's site and use their documentation as to how to install the drivers on Linux as it is not straight forward. Docs can be found here.
Here are all the commands you need in order to install the drivers you download from NVIDIA:
sudo apt install linux-headers-$(uname -r) build-essential libglvnd-dev pkg-config dkms -y
sudo nano /etc/modprobe.d/blacklist-nouveau.conf
Once inside the file add:
blacklist nouveau
options nouveau modeset=0
and then we continue with:
sudo update-initramfs -u
sudo systemctl set-default multi-user.target
sudo reboot now
After reboot you will be in terminal only mode, so you need to have another way to open this page to read the next commands, which are:
#navigate to the folder where you downloaded the drivers
sudo bash NVIDIA-Linux-x86_64-510.{version-number}.run
sudo bash NVIDIA-Linux-x86_64-510.*.run
After this you do "Continue" and only "Yes" until installation is finished (of course read what you click on and decide for your self)
then you finally you do:
sudo systemctl set-default graphical.target
sudo reboot now
This should give you your desired NVIDIA older drivers.