Getting Foot Into Local LLM

Purchased an RTC 5060 ti with 16GB of VRAM with the sole intent of using it to learn openllama.

Of course this leads to a rabbit hole like is my gear up to the task. I am wondering if I need a new motherboard and or CPU.

Or maybe a sign to rotate my gear, bring in new faster machine, and this one in front of me becomes an AI box.

Another thing I did today was figure out was for my Demo NAS, the chipset matters for smart, luckily I had another nvme to sata adapter and it works. The hard drives all appear normal.

Only 6 channels though, I need 8. Oh well it works enough.

Weight: 326.6

This entry was posted in New Toys, Technical, Training, Weigh In. Bookmark the permalink.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.