• 0 Posts
  • 9 Comments
Joined 1Y ago
cake
Cake day: Jun 23, 2023

help-circle
rss

Are you running them from your user session? If so, when you log out it will stop your processes, unless you have enabled ‘linger’ mode.


Yea it’s very easy to learn enough to run, it has built-in service discovery and secrets now, and writing parameterized jobs feels so much nicer than a helm chart in k8s.

10/10, would orchestrate again


I use k8s at work a lot - I choose to use Nomad at home, you may want to add that to your shortlist.


I am nearly complete migrating my ceph cluster and nomad compute cluster to arm :shrug:


A year or two ago (whenever docker changed the business license of docker for Mac) I changed to podman and aliased docker=podman. It behaves the same, you would just about never know rootful podman vs docker.

Rootless podman is super cool and a much better security ideal - but comparing more apples to apples would be podman running as root vs docker.


Nomad is a breath of fresh air after working with k8s professionally.

Don’t get me wrong, love k8s, but it’s a bit much (until you need it)


How excellent for my MQTT behind nginx next to my pihole

:)


I run drone.io with gitea, it’s nice, doesn’t do much when it’s not working.

Gitea added their own CI tooling that is configured like GitHub actions as well - I haven’t tried it yet though.


Ceph (rbd,s3) on 4 poweredges.

Nomad, Consul servers running in a 3 node raft on some ARM SBCs.

Nomad clients on 2 poweredges and 3 arm SBCs running:

  • s3 CSI (media and large file storage is all on s3)
  • rbd CSI (all the stateful jobs have rbd block devices)
  • NATS cluster with Jetstream to enable MQTT support
  • mosquito mqtt (had to run mosquito for mqtt v5)
  • mosquito<->nats bridge (via benthos)
  • nodered (just for easy Google home integration)
  • zwavejs2mqtt
  • zigbee2mqtt
  • frigate (can only talk mqtt v5 so had to run mosquito just for this)
  • grafana
  • gotify
  • gitea
  • drone CI
  • postgresql
  • BitTorrent client
  • ceph rgw s3 gateways
  • NATS based home automation lambdas - I wrote these in go
  • Adguard home
  • traefik as main ingress
  • Prometheus
  • prom node exporter
  • jellyfin
  • jackett
  • a program I wrote that manages torznab->acquisiton->s3 lifecycle
  • a website
  • wireguard servers

And that is just in the server room - I also have more like the 3d printer and CNC machine controllers etc.