scarecrow365

u/scarecrow365@reddthat.com
0 posts · 17 comments

Recent posts

No posts.

Recent comments

I've run mine as a VM for several years now. I haven't noticed any appreciable impact on performance vs bare metal. I am able to max out my 1000/40 WAN.

That being said, the platform you use to virtualize it on will have an impact. I am running mine on a 3 node proxmox cluster with 10gig networking and SSD backed Ceph storage, so my benchmarks for performance grossly outweigh what my WAN bandwidth can accommodate.

This is very similar to how I run mine, except that I use Ceph instead of ZFS. Nightly backups of the CephFS data with Duplicati, followed by staggered nightly backups for all VMs and containers to a PBS VM on a the NAS. File backups from unraid get sent up to CrashPlan.

Slightly fewer retention points to cut down on overall storage, and a similar test pattern.

Yes, current sysadmin.

My 10G is far from saturated, but I do try and keep things using RAM where possible. I figure that with 100gb of DDR4 in my main server, that should be able to provide enough speed for a 10G link.

I've got ceph running on Intel Enterprise SSDs, so they are pretty quick.

I also tried running ceph on 1G. I found it unreliable as well.

I've got a 3 node Proxmox/ceph cluster with 10G, plus a separate Nas. They are all rack mount with dual PSU. Add in the necessary switching, and my average load is about 800w. Throw my desktop (also on 10G) into the mix and it runs 1.1kw.

That's roughly $50-60 extra in electricity costs for me monthly.

I expose quite a few services to the web, so having that extra layer of protection is nice. And it allows me to control what leaves my network from an application perspective, not just TCP/UDP

I run a pretty hefty home lab, so my costs are fairly high compared to some.

  • Electricity: $70/mo
  • Internet: $55/mo (1000x35)
  • Cloud backup: $20/mo
  • Web firewall/IDS/IPS: $8.30/mo ($99/yr)
  • Domain/email: $15/yr
  • VPS: $1/mo

Overall: $155/mo

I'm a Sysadmin, so my names are purely functional:

host-pmx-01 through 03, my 3 node Proxmox cluster

vm-[SERVICE], optional 01-03 if needed

ct-[SERVICE], for LXC containers

It makes it easy to reference things via DNS for service discovery.

Unless someone has physical access to the ports/switch that the traffic flows through, they would not be able to see anything besides broadcast/multicast traffic if they were just snooping with Wireshark. The internal switch of proxmox and any hardware switch you have will forward unicast traffic to the ports those Mac's reside on, so without port mirrors setup, no one but you should be able to see that traffic.

We use RoyalTS and I've been very happy with it. I've used mRemoteNG and Mobaxterm in the past, and there really isn't much that would have me switch back. Plus, it supports plenty of other protocols besides SSH, so more of our teams can leverage it.

Between 3 switches, 4 servers, and my desktop also using one of my UPS units, I average about 850w, with peaks up to 1.1kw when my desktop is running. Luckily, electricity where I live is only 13cents/kwh.