Finally got it working, it took just an hour or so to figure it out.
Unfortunately I do not have detailed documentation on how I did it, but here are a couple of small notes
- First I did was remove everything I did prior and went to the built in noveau driver.
- After a bit of research I tried 575 but it did not work so I went up to driver version 580
- So I already had nvidia access, some day will figure out how I got that probably some in repo enabled.
- First I reset dnf module reset -y nvidia-driver
- I listed what was available dnf module list nvidia-driver
- I then set the driver level and I opted for the open version dnf module enable -y nvidia-driver:580-open
- Then install and reboot dnf install -y nvidia-driver nvidia-driver-cuda
Now I can proceed with LLM stuff.
Final note, Seahawks Championship Parade was today.
Weight: 321.2