Are you 14?

One can also mine Monero on normal everyday computers.

But what makes this AI model unique is that it’s lightweight enough to work efficiently on a CPU, with TechCrunch saying an Apple M2 chip can run it.

An Apple M2 can run bigger, higher-precision models than this FWIW. More important than this is perhaps whether older CPUs can run it with acceptable performance.

AI models are often criticized for taking too much energy to train and operate. But lightweight LLMs, such as BitNet b1.58 2B4T, could help us run AI models locally on less powerful hardware. This could reduce our dependence on massive data centers and even give people without access to the latest processors with built-in NPUs and the most powerful GPUs to use artificial intelligence.

This is definitely relevant to my interests especially with NPU support for such models coming. Dirt cheap ARM-based PCs based on e.g. the RK3588 are shipping with small NPUs

Love me some Bouguereau style

I’m planning to keep a shitphone just for such apps.

Although purported interest has never been higher, all the soft white libs I know are still deep in their full-of-shit phase and not doing a single fucking thing to prepare. It’s only the far leftists and people in the center that are on the uptake thus far from my vantage point.

Check out ServeTheHome’s “Project TinyMiniMicro” on Youtube for a great overview of ultra-small form factor (“1 liter”) business PCs.

The big three PC makers each have standardized products in this form factor with (relatively speaking, compared to smaller manufacturers) tons of spare parts available.

Personally I’d go for as big a UPS as I could afford, but I serve some public-facing stuff from my homelab and I live in an area with outdated infrastructure and occasional ice storms. I currently have a small UPS and have been too tired/overwhelmed to set up automated shutdown yet. It’s not too hard though, I’ve done it before. And even without that in place, my small UPS has kept things going thru a bunch of <10 minute outages.

I would never open those types of services to the Internet. Wrap it in a VPN first yeah?

I have this exact model machine as a web app server running Proxmox btw. Works great. I did need to get a genuine power supply for it as it refused to run above 800MHz with a generic!

There isn’t a guide yet that I’ve found. I slowly & painfully assembled all the info and beat my head against the task until I had something working & stable.

I’m currently building a comprehensive one, but due to circumstances beyond my control, it’s taking forever.

I think civilization just hasn’t gotten there yet, but I suspect I’m not the only one working on this, so I bet the reverse proxy tunnel HOWTO situation will be way better in a year or two…

FWIW I use nginx on the front end, and rathole for my tunnels - the latter is a very straightforward way to set up the tunnels.

Currently I have a bastion host running a hardened distro, which establishes a reverse proxy tunnel to its ssh port via my $4/mo VPS using rathole, an excellent reverse proxy utility I switched to from frp.

I also maintain a Tor hidden service pointed at the bastion host’s ssh port and another on a different internal host. These are so that I can still get in if the bastion host, my VPS, or certain aspects of networking are down for some reason.

Eventually I will implement port knocking / single packet authorization by deploying fwknop on some or all of these services to further enhance security.

But my hate for Snap runs so deep that I’ve started using Debian w/ GNOME more and more often over the last year or so.

As a Linux Mint user I’ve seen the writing on the wall and will be switching to Linux Mint Debian Edition next time I reinstall my desktop.

And also seemingly a lack of understanding of the word federation.

All this can be solved easily if you just go somewhere else.

no u

You aren’t even a user of SDF Lemmy. So why are you spamming everyone here with your irrelevant opinions?

Do you have the same level of confidence in children and people who are deeply mentally ill?

This instance, which you are not a member of, is for adults who can decide what they want to read for themselves.

Maybe you should stick to discussing issues about the instance you’re actually on, instead of wasting people’s time in discussions which don’t involve you.

If you don’t like the decisions of an instance you go to another one. If this instance defederates from rammy.site I’m staying, if not I’m leaving. You’re free to leave if they defederate too, and if you felt the need to leave because of it I’d be happy to have you gone.

Please stop drawing the process out and find somewhere better suited to your preferences.

It’s okay, not great, still needs UX work. That being said, it stores all its files in Markdown and they are also accessible in the Files app.

Not actually sure if it can be made public, they grafted some unnecessary features onto it in order to call it “Collectives” which might make it a bad fit for such, but I haven’t actually looked to see if it’s possible.

Thanks for posting this. It’s nice that people are working on more accessible ways to do this, every way I’ve done it so far has been pure command line. And while that’s fine, it takes longer to understand and set up for simple installs.

Edit: posted to wrong tab, doh