minus-squarePlantObserver@lemmy.worldtoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMslinkfedilinkEnglisharrow-up2·5 months agoYou could try llamaCPP, I think its configured to run better on cpu’s linkfedilink
You could try llamaCPP, I think its configured to run better on cpu’s