I also recently got into selfhosting LLM. Having an AMD card meant I had to scourge for solutions since everything expects to have CUDA suppport which means having Nvidia cards. Koboldcpp has a fork with ROCM support which works on my machine, so I’m content with that for now.

I shudder imagining that a stupid company could make .cum domains actually happen. Looking at you Google and your .zip trolling.

There has to be a cultural shift as well. It’s not the early 2000s anymore where a substantial portion of internet users could tinker around their desktop computers. I recently got fiber at home and we’re locked behind CGNAT. I could look for a solution for myself since I grew up opening ports on my router, but imagine someone who grew up with bubble-wrapped smartphones trying to navigate their way through that bs.

So that explains why it’s so cheap.

Porkbun has been fair to me. Recommended.

Choice, huh? I can’t choose where the config files are stored unless I am willing to either dig into an obscure setting, modify the source code and recompile (repeat every time there’s an update), or contact the developer’s smug beard using smoke signals.