It abstracts away llama.cpp in a way that, frankly, leaves a lot of performance and quality on the table.

OP, do you have any telemetry you can show us comparing the performance difference between what you setup on this guide and an Ollama setup? Otherwise, at face value, I’m going to assume this is another thing on the internet i have to assume is uncorroborated bullshit. Apologies for sounding rude.

I don’t like some things about the devs. I won’t rant, but I especially don’t like the hint they’re cooking up something commercial.

This concerns me. Please provide links for us to read here about this. I would like any excuse to uninstall Ollama. Thank you!

deleted by creator

I’m self hosting Vaultwarden and my home server got killed by the hurricane, yet I can still access my passwords just fine on the app because it stores them locally encrypted on my phone from the last time it synced. I just can’t update or change anything until I can bring everything back on.

So, host your own shit you cowards, it’ll be fine.

Yeah, either secure copy (SCP) or rsync are the ways to do this securely.

Why not use this and select whatever LLM to leverage as a RAG? It literally allows you to self host the model and select any model for both chat and RAG analysis. I have it set to Hermes3 8B for chat and a 1.3B Llama3 as the RAG.

OPNsense is the best firewall, IPS, and IDS I’ve used. If they made a Linux version of that OS I’d switch to that in a heart beat becuase of driver compatibility

I just heard some of their tracks and I feel like it wasn’t a huge loss not being able to hear a Duran Duran or Depeche Mode wannabe band while I’m murdering hookers in GTA6

No other reason

Yep 🙄

I’ve used other options and carefully elaborated them all, vim remained a superior tool.

So you’re saying it’s essentially BSD but wastes more of my time. Got it.

What is the point of this when the OG Jellyfin has an android app?

Tesla likes to lock shit down tighter than a nun’s panties.

Because I am dumb and don’t know what I am talking about.

These guys are the Tesla of PC distributors, and the Framework laptop is trash tier Cybertruck equivalent.

Agreed, but their entire fab process was stolen via corporate espionage and is not a novel design in any way.

Gives me Ready Player One distopian trailer-homes stacked on top of each other Section-8/shitty favela housing vibes.

Ironically, ChromeOS Flex would run smooth on those specs, since it does so on my dogshit Samsung Chromebook 3 with shittier specs.

Toss OpenWRT into the trash and install OPNSense instead.

Looks like that are switching over from a generic Linux into android

Most of the entire internet cannot run without Cloudflare for a reason. Just buy directly from the source.