I have spent a lot of time rethinking my homelab setup. The way it is currently set up works fine but it has started to become quite messy. While I did start reorganising quite a lot of things, there are some bigger changes that I want to make.
The first one would be to maybe replace my current Single Node Proxmox Host with 6 new nodes. I am still unsure if I should create 2 seperate clusters or 1 single cluster.
The first cluster will be a low power 3x EliteDesk 800 G4 Mini (i5-8500T) cluster. The reason why is because I got a good deal for them and they come with v-pro support, 2 m.2 slots (compared to the single slot of previous generations) and are also "upgradable" with their flex-io slot. Sadly the 10GbE nic costs $200+ here in switzerland.
This cluster will probably be just a standard HA cluster that will mainly run DNS, reverse proxy (maybe traefik) including Crowdsec and Authentik (currently running NPM, Fail2ban and authelia) and whatever I dont or cant run in kubernetes.
Here is a STH review from their TinyMiniMicro Project Series.
The second cluster will be a MS-01 cluster running CEPH and will serve as the big kubernetes cluster.
The MS-01 is a relatively new product from Minisforum. It offers SFP+ 10GbE networking, 2x2.5GbeE Networking, a PCIe slot, and 3x M.2 slots.
My plan is to set up ceph on 2x Samsung PM983 3.84TB either utilising a thunderbolt ring network set up or just the 10GbE in case the thunderbolt doesnt work out.
With the i9-13900H I can also run 2x48GB RAM per node, for better powerefficiency there are also i7 and i5 12th gen variants. A user from the STH forums says that the 17-12600H variant also supports 2x48GB RAM.