IM just genuinely curious - trying to read up and learn..
I want to fool around with a few things, but mostly i want to teach myself about things like - hosting and training a local - offline AI.
What ive learned so far (big picture atleast) is that
AI loves nvidia, or modern nvidia, etc.
Apple doesnt love NVIDIA
But there are alot of LLMs out there - variations of chatgpt, ollama and many more im unaware of.
these LLMs may feel differently about gpu vs ram and connections with CPUs.
I have an option to get a mp5,1 for 150.00 working, with OS..
+ I also intend to dual boot debian and macOS.
+ My intended use base is basically to train it on specific things important and relevant in my life. (writings)
+ second goal - something that i can train to recognize things in pictures and pull up pictures (not generate, but pull up existing)
SO really the questions might be
1) any words of wisdom on which models might work best with a 5,1?
2) better options hardware wise? the caveat on hardware is, im searching best bang for the buck, and im not likely to spend more than 400.00 total on this.. Fortunately i have spare KVM, so that gives me like $10 extra to spend..
3) while i much rather maintain a working macOS as well, if i took just the hardware, but wiped drive and installed linux? or windows? and didnt dual boot - would that open up a little more hardware options? I mean i know im still limited by can the PSU support, can the pcie slot support, can the ram support.....
Id appreciate any thoughts- but I am really limited by funds and trying to make the best i can within that..
id love to buy 3 mac studios and make a cluster as well. but..$$$
I want to fool around with a few things, but mostly i want to teach myself about things like - hosting and training a local - offline AI.
What ive learned so far (big picture atleast) is that
AI loves nvidia, or modern nvidia, etc.
Apple doesnt love NVIDIA
But there are alot of LLMs out there - variations of chatgpt, ollama and many more im unaware of.
these LLMs may feel differently about gpu vs ram and connections with CPUs.
I have an option to get a mp5,1 for 150.00 working, with OS..
+ I also intend to dual boot debian and macOS.
+ My intended use base is basically to train it on specific things important and relevant in my life. (writings)
+ second goal - something that i can train to recognize things in pictures and pull up pictures (not generate, but pull up existing)
SO really the questions might be
1) any words of wisdom on which models might work best with a 5,1?
2) better options hardware wise? the caveat on hardware is, im searching best bang for the buck, and im not likely to spend more than 400.00 total on this.. Fortunately i have spare KVM, so that gives me like $10 extra to spend..
3) while i much rather maintain a working macOS as well, if i took just the hardware, but wiped drive and installed linux? or windows? and didnt dual boot - would that open up a little more hardware options? I mean i know im still limited by can the PSU support, can the pcie slot support, can the ram support.....
Id appreciate any thoughts- but I am really limited by funds and trying to make the best i can within that..
id love to buy 3 mac studios and make a cluster as well. but..$$$
