In the next ~6 months I’m going to entirely overhaul my setup. Today I have a NUC6i3 running Home Assistant OS, and a NUC8i7 running OpenMediaVault with all the usual suspects via Docker.
I want to upgrade hardware significantly, partially because I’d like to bring in some local LLM. Nothing crazy, 1-8B models hitting 50tps would make me happy. But even that is going to mean a beefy machine compared to today, which will be nice for everything else too of course.
I’m still all over the place on hardware, part of what I’m trying to decide is whether to go with a single machine for everything or keep them separate.
Idea 1 is a beefy machine and Proxmox with HA in a VM, OMV or TrueNAS in another, and maybe a 3rd straight Debian to separate all the Docker stuff. But I don’t know if I want to add the complexity.
Idea 2 would be beefy machine for straight OMV/TrueNAS and run most stuff there, and then just move HA over to the existing i7 for more breathing room (mostly for Frigate, which could also separate to other machine I guess).
I hear a lot of great things about Proxmox, but I’m not sold that it’s worth the new complexity for me. And keeping HA (which is “critical” compared to everything else) separated feels like a smart choice. But keeping it on aging hardware diminishes that anyway, so I don’t know.
Just wanting to hear various opinions I guess.
You must log in or register to comment.
No.
Don’t use Proxmox, use incus. It’s way easier to run and doesn’t give a care about your storage.
I’m running Proxmox and hate it. I still recommend it for what you are trying to do. I think it would work quite nicely. Three of my four nodes have llama.cpp VMs hosting OpenAI-compatible LLM endpoints (llama-server) and I run Claude Code against that using a simple translation proxy.
Proxmox is very opinionated on certain aspects and I much prefer bare metal k8s for my needs.
I like ProxMox too, I’m quite happy that I dove in with it. Just one word of warning - if you mount a drive volume in a container, destroy the container and restore it from a backup, it wipes out the mounted drive. I, uh, lost a bunch of data that way. Not super important data, but still.
I’m still glad I went with ProxMox though. It makes spinning up something a breeze, and I also went with HA in a VM, and another Debian VM for Docker, and a bunch of random LXCs.
If you can replicate it, you should really file a bug report so that the next guy doesn’t lose data.
Is this separate from a bind mount? Cause that doesn’t happen with bind mounts.
In my opinion, Proxmox is worth it for two reasons:
-
Easy high-availability setup and control
-
Proxmox Backup Server
Those two are what drove me to switch from KVM, and I don’t regret it at all. PBS truly is a fantastic piece of software.
-
From an earlier post I made much like yours, I decided to go with incus. I’d be fully migrated if real life hadn’t kicked me in the taint for a few weeks.
It’s great if you need what it offers. Otherwise, it’s simpler to set up something like Ubuntu Server.
I use Proxmox to run my email service, https://port87.com/, because I can have high-availability services that can move around the different Proxmox hosts. It’s great for production stuff.
I also use it to run my seedbox, because graphics in the browser through Proxmox is really easy.
For everything else (my Jellyfin, Nextcloud, etc), I have a server that runs Ubuntu Server and use a docker compose stack for each service.
I had never heard of Port87 before, how do you like it? And I assume you pay no monthly fee by hosting your own domain?
Proxmox is a convenient gui wrapper around libvirt but you can do everything without it.
but you can do everything without it.
yes but why would you? There’s a reason we use GUIs, especially when new to a field (like virtualization).
Once you get to know the GUI well enough and start scripting, the GUI becomes less relevant.
libvirt comes with some gui tool of its own, though I haven’t used it. I generally prefer to understand what I’m doing, so I use command line tools or API’s at first. GUI’s are a convenience to use later, once it’s clear how they work.
It’s got more than just VM management, but yeah, it’s a frontend for a bunch of other services, that you don’t need Proxmox for.
I’ve been using Ganeti for like 15 years now, and I’m not sure what proxmox offers besides a nice GUI. I know how Ganeti works and getting up to speed on a new one doesn’t seem super interesting to me. Is anyone here familiar with both?
For me, I’m Team Proxmox. It’s just easy to spin up containers for pretty much anything I need. No need for the resource overhead of a full-on virtual machine if I simply need to run a LAMP app. Anything you really have an issue transitioning from Docker to LXC can still be run inside a container with Docker installed. And if you need to set up a VM for Windows or pfSense or some other OS for whatever reason, it’s insanely easy to do.
