Between wanting to do more with local LLMs, wsl annoyances, and the direction tech companies have been going lately, I think it's time I start exploring a full Linux migration
I'm a software dev, I'm comfortable in the command line, and I used to write the node configuration piece of something similar to chef (flavor/version agnostic setup of cloud environments)
So for me, Linux has always been a "modify the script and rebuild fresh" kind of deal... Even my dev VMs involved a lot of scripts and snapshots. I don't enjoy configuration and I really hate debugging it, but I can muddle through when I have to
Web searches have pushed me towards Ubuntu for LLM work, but I've never been a big fan of the window Managers. I like little flourishes like animation and lots of options I can set graphically, I use multiple desktop multiple monitors
I've tried the one it comes standard with, gnome, and kde (although it's been about 5 years since I've last given them a real shot).
I'm mostly looking for the most reasonable footprint that is "good enough", something that feels polished to at least the Windows XP level - subtle animations instead of instant popups, rounded borders, maybe a bit of transparency here and there.
I'm looking at Ubuntu w/
-
kde w/ plasma (I understand it's very configurable, I don't love the look and it seems to be a bigger footprint
-
budgie (looks nice, never heard of it before today)
-
kylin (looks very Windows 10 which is nice, a bit skeptical about the Chinese focus)
-
mate (I like the look, but it seems a bit dubiously centralized)
-
unity (looks like the standard Ubuntu taken to it's natural conclusion)
-
rhino Linux (something new which makes me skeptical, but pretty and seems more like existing tools packaged together which makes me think the issues might not impact actual workflow)
-
anything the community is big on for this, personally I'd pick opensuze, but I need to maximize compatibility with bleeding edge LLM projects
My hardware and hard requirements are:
- nvidia 1060ti
- ryzen 5500u
- 16g ram
- 4 drives nearly full, because it's a computer of Theseus running the same (upgraded) vista license that came with the case like 15 years ago
- multi desktop, multi monitor
- can handle a lot of browser Windows/tabs
- ideally the setup is just a package mana ger install script with all my dependencies
- gaming support would be nice, but I'll be dual booting for VR anyways
I've been out of the game for a while, I'd love to hear what the feeling is in the community these days
(Side note, is pine as cool a company as it seems?)
Basically it's this system to do all kind of directional acyclic tasks, primarily based around data ingestion. It's very flexible and powerful, which also means there's a steep learning curve.
To give an example, you could have a task that gatherers a list of instances and updates the database. It could also spawn a new task for each one to check if the server is up and get the version number, and you could even have it email you to create an account for new instances.
Then from the task that made sure the server is up, you could spawn a new task that gets communities, which then spawns new tasks to ingest posts from it
And when this whole process is done, you could have it kick off a new set of tasks to do the indexing or whatever else on the up to date data set
It has some nice visualization of the process, you can allocate workers across devices, you can kick off the process through an API... You can use it to do anything from monitoring to scraping and doing map reduce on it. You could even federate and wire into activity pub directly, use their apis, or mix and match with scraping
I've never worked with crawlers and I'm not sure what angle you're going to attack this from, but if normal crawlers don't play well with the fediverse this is an option