{"id":15122,"date":"2026-01-10T22:55:45","date_gmt":"2026-01-11T06:55:45","guid":{"rendered":"https:\/\/www.apolonio.com\/blog\/?p=15122"},"modified":"2026-01-10T23:35:27","modified_gmt":"2026-01-11T07:35:27","slug":"getting-foot-into-local-llm","status":"publish","type":"post","link":"https:\/\/www.apolonio.com\/blog\/?p=15122","title":{"rendered":"Getting Foot Into Local LLM"},"content":{"rendered":"\n<p>Purchased an RTC 5060 ti with 16GB of VRAM with the sole intent of using it to learn openllama.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.apolonio.com\/blog\/wp-content\/uploads\/2026\/01\/RTX-5060ti.jpg\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"573\" src=\"https:\/\/www.apolonio.com\/blog\/wp-content\/uploads\/2026\/01\/RTX-5060ti.jpg\" alt=\"\" class=\"wp-image-15124\" srcset=\"https:\/\/www.apolonio.com\/blog\/wp-content\/uploads\/2026\/01\/RTX-5060ti.jpg 1024w, https:\/\/www.apolonio.com\/blog\/wp-content\/uploads\/2026\/01\/RTX-5060ti-300x168.jpg 300w, https:\/\/www.apolonio.com\/blog\/wp-content\/uploads\/2026\/01\/RTX-5060ti-768x430.jpg 768w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>Of course this leads to a rabbit hole like is my gear up to the task.  I am wondering if I need a new motherboard and or CPU.<\/p>\n\n\n\n<p>Or maybe a sign to rotate my gear, bring in new faster machine, and this one in front of me becomes an AI box.<\/p>\n\n\n\n<p>Another thing I did today was figure out was for my Demo NAS, the chipset matters for smart, luckily I had another nvme to sata adapter and it works.  The hard drives all appear normal.<\/p>\n\n\n\n<p>Only 6 channels though, I need 8.  Oh well it works enough.<\/p>\n\n\n\n<p>Weight: 326.6<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Purchased an RTC 5060 ti with 16GB of VRAM with the sole intent of using it to learn openllama. Of course this leads to a rabbit hole like is my gear up to the task. I am wondering if I &hellip; <a href=\"https:\/\/www.apolonio.com\/blog\/?p=15122\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14,11,3,9],"tags":[],"class_list":["post-15122","post","type-post","status-publish","format-standard","hentry","category-new-toys","category-technical","category-training","category-weighin"],"_links":{"self":[{"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15122","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15122"}],"version-history":[{"count":2,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15122\/revisions"}],"predecessor-version":[{"id":15125,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15122\/revisions\/15125"}],"wp:attachment":[{"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15122"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15122"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.apolonio.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15122"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}