Running services, network usage, memory usage, bandwidth, disk I/O, successful logins, whether the thing is even alive, etc…
So far my only method has been “hope and pray”.
You must log in or # to comment.
I sync my podcasts hourly with Nextcloud and poddersync, so when my servers go down, my phone beeps at me.
Uptime Kuma for monitoring web service status (just like if the jellyfin, etc. website is up), and Zabbix for monitoring system metrics like CPU/Memory/Disk I/O, etc. Zabbix can do a whole lot, but can also get a little complicated. There are plenty of guides out there for configuring it though.
Cockpit. Total gamechanger for me. I don’t have to ssh to my boxes individually to see what’s going on. Instead it’s a web UI AND you can connect basically every server you want to one instance.
https://github.com/cockpit-project/cockpit
That said. For individual servers?
htop/nmon(Get nmon straight from the source! https://nmon.sourceforge.io/pmwiki.php) for a birds-eye sysmon view of thingsps -ef | grep <whatever you're looking for>for investigating stuck/hung/zombie processesdmsegtail -f /var/log(or whatever log file you care about)netstatfor net statistics (i think ntop used to be a thing but idk anymore>…)df -hto look at disk usagethose are all that come to mind right away.
EDIT: formatting and quick explanation of what each tool does
It’s amazing the risk profile of that.
How do you configure adding multiple servers to the same instance?
Lol I go to all of my server’s specific cockpit addresses, sounds like I’m doing it wrong, I’ll need to look at connecting them
So it turns out… you can’t connect them anymore… The feature is deprecated
https://docs.cockpit-project.org/cockpit-guide/latest/guide/feature-machines.html
(also, I wanted to just link my response from another user who had asimilar question but for whateVER reasyon, Alx won’t let me??)
Lights are on, server is on.
Kernel panic?
My kernel is chill.
I recently found out that this is not always true.
I never said anything about it responding.
I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it’s down. Doesn’t use any electricity, but does consume a good amount of Cheerios and mac & cheese.
Lies! It uses electricity!
Indirectly. But as another commenter pointed out, it balances out with the tax rebates.
Does this monitoring system also happen to be a dependent on your taxes?
I’ve got a few of those services running.
I use nagios
I use Alloy to collect Metrics of the host (Disk usage, CPU, Ram, etc.) and different logs. With Grafana the data is then displayed as a daschboard. If everything goes south, Alertmanager sends Mails to me
I usually just walk down the hall and move the mouse. I don’t really need remote monitoring. 😅
That’s the neat part, I don’t.
SNMP.
The old engine was nagios. The new engine will be telegraf -> mqtt -> brokerfest -> timescale -> Prometheus.
I guess. Not sure yet. The brokerfest is a series of broker pubsub between sites to both split out data from the stream for off-site CC, or pull it’s own subscriptions in. Data could go host <- telegraf -> broker -> remote broker -> remote timescale -> remote Prometheus
Zabbix
Prometheus + grafana. It’s overkill tbh, most of the services restart automatically and I mostly ignore it. (it’s an artifact from life where I cared about it)
Exactly this scenario at my place as well. 😄
Grafana dashboard
You can find more details and the source code here: https://erasmus.works/Ooooo, that looks nice.
It’s running the private DNS for my phone. If it goes down, I realise quite quickly.
I use FreeBSD so I don’t need to check it to make sure it’s working properly
Wasn’t there an RCE recently discovered with AI?
You’d need to be running kerberised NFS in the kernel, give the attacker access to your NFS server, and have a valid kerberos login
I don’t know anyone sharing NFS access let alone opening it up on the open internet
