How do you monitor your servers?

Comments

• timochka@lemmy.zip ⁨1⁩ ⁨hour⁩ ago

  I use Signoz and OTel collectors to bring in everything from Kubernetes (and also SNMP-to-OTel for the network and NAS stats.)

  That covers dashboards and basic alerting. Then on top of that I have an n8n workflow that runs every morning - it pulls all the main stats out of Signoz, as well as issues and their status from my infrastructure repo in Gitlab, and feeds it all into a local LLM (Qwen-3.8-Flash-Next at the moment), which emails me a report on overall cluster health. It also automatically opens a ticket in Gitlab for anything that might need fixing.

  It works really nicely, gotta say.

  source
• motruck@lemmy.zip ⁨1⁩ ⁨hour⁩ ago

  Gatus. Works and easy incremental set up.

  source
• Foofighter@discuss.tchncs.de ⁨2⁩ ⁨hours⁩ ago

  Use service, wait for 404 or data loss…

  source
• bertlewirth@lemmy.world ⁨10⁩ ⁨hours⁩ ago

  You guys are monitoring your servers?

  source

  • InFerNo@lemmy.ml ⁨10⁩ ⁨hours⁩ ago

    “can’t access this thing, server must be down”

    source

    • TrollTrollrolllol@lemmy.world ⁨3⁩ ⁨hours⁩ ago

      I’ll fix it when I get home

      source
  • user224@lemmy.sdf.org ⁨9⁩ ⁨hours⁩ ago

    I plan to perhaps, just maybe, I am not sure, to try self-hosting an email server. But I’ll need a good uptime.
    Although I am really scared about security.

    source

    • communism@lemmy.ml ⁨4⁩ ⁨hours⁩ ago

      I self-host my own email, have done so for years. I’ve not gotten pwned. Use an SSH key and a firewall, only expose the ports that should be public, have reasonable access controls, etc, just practise general cybersecurity—it applies to servers too.

      I know everyone complains about hosting email. But I’ve not run into major problems. My emails get through spam filters and I have good uptime. It’s also a fun learning experience.

      source

      • -> View More Comments
    • InFerNo@lemmy.ml ⁨8⁩ ⁨hours⁩ ago

      Been running one for many years, mostly issue-free. Had to request whitelists way in the beginning, but things turned out ok.

      Check out this super great guide. workaround.org/ispmail-trixie

      source
    • bertlewirth@lemmy.world ⁨9⁩ ⁨hours⁩ ago

      Well, it’s a good learning experience. But…… don’t. Good luck getting around the major email providers’ smart screen shit. It’s probably not gonna happen. I tried a few years ago, and even microslop couldn’t figure out why their shit screen crap wouldn’t allow my emails. But it’s worth doing it in the short term to learn how to do it.

      source

      • -> View More Comments
• Samsy@lemmy.ml ⁨1⁩ ⁨hour⁩ ago

  Beszel & Pangolin.

  source
• CompactFlax@discuss.tchncs.de ⁨9⁩ ⁨hours⁩ ago

  I notice something stopped working, or someone in the household notices.

  Then I go fix it.

  source

  • DeathByDenim@lemmy.world ⁨9⁩ ⁨hours⁩ ago

    And the best time to notice that the backups weren’t working is when you need access to the backup. 😅

    source

    • electric_nan@lemmy.ml ⁨2⁩ ⁨hours⁩ ago

      Backups are pretty much the only thing I get notifications for. Otherwise, one app or another on my phone will complain if it loses connection to my server.

      source

      • -> View More Comments
    • CompactFlax@discuss.tchncs.de ⁨8⁩ ⁨hours⁩ ago

      Backups? In this economy?

      source

      • -> View More Comments
• owenfromcanada@lemmy.ca ⁨22⁩ ⁨hours⁩ ago

  I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it’s down. Doesn’t use any electricity, but does consume a good amount of Cheerios and mac & cheese.

  source

  • ten8tp@reddthat.com ⁨21⁩ ⁨hours⁩ ago

    Lies! It uses electricity!

    source

    • owenfromcanada@lemmy.ca ⁨21⁩ ⁨hours⁩ ago

      Indirectly. But as another commenter pointed out, it balances out with the tax rebates.

      source
• Tealk@rollenspiel.forum ⁨3⁩ ⁨hours⁩ ago

  Icinga and Phare Uptime

  source
• blackshirt@lemmy.world ⁨4⁩ ⁨hours⁩ ago

  Ultime Kuma and Beszel

  source
• kurcatovium@piefed.social ⁨16⁩ ⁨hours⁩ ago

  That’s the neat part, I don’t.

  source
• Carrots@quokk.au ⁨22⁩ ⁨hours⁩ ago

  Lights are on, server is on.

  source

  • Reannlegge@lemmy.ca ⁨20⁩ ⁨hours⁩ ago

    I recently found out that this is not always true.

    source

    • Carrots@quokk.au ⁨8⁩ ⁨hours⁩ ago

      I never said anything about it responding.

      source
  • bertlewirth@lemmy.world ⁨10⁩ ⁨hours⁩ ago

    Kernel panic?

    source

    • Carrots@quokk.au ⁨8⁩ ⁨hours⁩ ago

      My kernel is chill.

      source
• RIotingPacifist@lemmy.world ⁨7⁩ ⁨hours⁩ ago

  Monit, simple to setup, gets the job done, runs on my router too.

  source

  • Cyber@feddit.uk ⁨2⁩ ⁨hours⁩ ago

    I have this on my NAS, works well

    source
• blarth@thelemmy.club ⁨22⁩ ⁨hours⁩ ago

  Whining from end users.

  source
• pHr34kY@lemmy.world ⁨13⁩ ⁨hours⁩ ago

  It’s running the private DNS for my phone. If it goes down, I realise quite quickly.

  source
• moldy_rice@piefed.keyboardvagabond.com ⁨8⁩ ⁨hours⁩ ago

  I go the easy route with munin and wazuh. It comes with a ton of stuff preconfigured

  source
• frongt@lemmy.zip ⁨22⁩ ⁨hours⁩ ago

  I pay a group of schoolchildren to refresh a group of browser tabs and yell if anything isn’t responding.

  There are plenty of previous threads with recent answers if you search.

  source
• curbstickle@anarchist.nexus ⁨21⁩ ⁨hours⁩ ago

  Well I used to use VGA for my monitors, now its mostly displayport.

  Seriously though, prom+Loki+alloy+a few other things to Grafana, with alerting in grafana.

  source
• hsedr@lemmy.zip ⁨5⁩ ⁨hours⁩ ago

  I am using prometheus-nodeexporter which is scraped by Prometheus and then visualized in Grafana

  source
• lIlIlIlIlIlIl@lemmy.world ⁨22⁩ ⁨hours⁩ ago

  Uptime Kuma! For HDDs I have them report their “ping” as percentage full

  source

  • WeirdGoesPro@lemmy.dbzer0.com ⁨20⁩ ⁨hours⁩ ago

    Can you teach me this wizardry?

    source

    • lIlIlIlIlIlIl@lemmy.world ⁨7⁩ ⁨hours⁩ ago

      Sure! In Uptime Kuma, add a monitor with type Push. It gives you a URL with a unique token, and the monitor goes into “down” state if nothing calls that URL within the heartbeat interval. Then have a cron (or a systemd timer or whatever) run this on the machine with the drive every 5 or 10 minutes:

      use=$(df --output=pcent /mnt/yourdrive | tail -1 | tr -dc ‘0-9’)
      curl -fsS -G “http://your-kuma:3001/api/push/TOKEN --data-urlencode “status=up” --data-urlencode “msg=${use}% used” --data-urlencode “ping=${use}”
      

      Ping is of course meant to be response time, but Kuma will graph any number you toss in, so you get a “filled” chart for the drive. I also send status=down once usage passes a threshold. And if the box itself should fall over for some reason, the missing check-ins trigger the alert too.

      (I typed this quick on my phone, so please double-check and probably don’t blindly copy-paste)

      source

      • -> View More Comments
• Legion739@piefed.zip ⁨14⁩ ⁨hours⁩ ago

  Grafana dashboard

  image You can find more details and the source code here: https://erasmus.works

  source

  • user224@lemmy.sdf.org ⁨14⁩ ⁨hours⁩ ago

    Ooooo, that looks nice.

    source
• Decronym@lemmy.decronym.xyz [bot] ⁨10⁩ ⁨hours⁩ ago

  Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

  Fewer Letters	More Letters
  AP	WiFi Access Point
  DNS	Domain Name Service/System
  LXC	Linux Containers

  ---

  [Thread #122 for this comm, first seen 9th Oct 2026, 13:00] [FAQ] [Full list] [Contact] [Source code]

  source
• Dultas@lemmy.world ⁨11⁩ ⁨hours⁩ ago

  Uptime Kuma for outages, Prometheus for metrics, rsyslog to Loki backend for logs. Grafana for ingesting Prometheus and Loki data.

  source
• happy_wheels@lemmy.blahaj.zone ⁨22⁩ ⁨hours⁩ ago

  Cockpit. Total gamechanger for me. I don’t have to ssh to my boxes individually to see what’s going on. Instead it’s a web UI AND you can connect basically every server you want to one instance.

  github.com/cockpit-project/cockpit

  That said. For individual servers? htop/nmon (nmon is FANTASTIC)
  ps -ef | grep <whatever you’re looking for> dmseg tail -f /var/log (or whatever log file you care about) netstat

  those are all that come to mind right away.

  source

  • corsicanguppy@lemmy.ca ⁨15⁩ ⁨hours⁩ ago

    It’s amazing the risk profile of that.

    source
  • nosuchanon@lemmy.world ⁨15⁩ ⁨hours⁩ ago

    How do you configure adding multiple servers to the same instance?

    source

    • happy_wheels@lemmy.blahaj.zone ⁨10⁩ ⁨hours⁩ ago

      So I actually just went to make a guide on this, demonstrating on my ubuntu 26.04 lab vps, and it appears the connect option is not there.

      However on my 24.04 lab vps, it’s there. Same with my local 22.04 systems (yes I know I have to upgrade lmao)

      I went to cockpit docks and sure enough, the feature is deprecated :( Dang.

      docs.cockpit-project.org/…/feature-machines.html

      It was really cool though while it worked.

      source
  • Owljfien@piefed.world ⁨17⁩ ⁨hours⁩ ago

    Lol I go to all of my server’s specific cockpit addresses, sounds like I’m doing it wrong, I’ll need to look at connecting them

    source

    • happy_wheels@lemmy.blahaj.zone ⁨10⁩ ⁨hours⁩ ago

      So it turns out… you can’t connect them anymore… The feature is deprecated

      docs.cockpit-project.org/…/feature-machines.html

      (also, I wanted to just link my response from another user who had asimilar question but for whateVER reasyon, Alx won’t let me??)

      source
• lka1988@lemmy.dbzer0.com ⁨7⁩ ⁨hours⁩ ago

  My 3-node Proxmox cluster has a dashboard, my NAS has a dashboard, and Home Assistant has a dashboard. Hell, my gaming PC has a dashboard, too (Webmin and Cockpit).

  source
• testgoofy@infosec.pub ⁨18⁩ ⁨hours⁩ ago

  I use Alloy to collect Metrics of the host (Disk usage, CPU, Ram, etc.) and different logs. With Grafana the data is then displayed as a daschboard. If everything goes south, Alertmanager sends Mails to me

  source
• shadshack@piefed.world ⁨7⁩ ⁨hours⁩ ago

  Uptime Kuma for monitoring web service status (just like if the jellyfin, etc. website is up), and Zabbix for monitoring system metrics like CPU/Memory/Disk I/O, etc. Zabbix can do a whole lot, but can also get a little complicated. There are plenty of guides out there for configuring it though.

  source
• Kolanaki@pawb.social ⁨7⁩ ⁨hours⁩ ago

  I just look at the console.

  source
• i_stole_ur_taco@lemmy.ca ⁨21⁩ ⁨hours⁩ ago

  I get a text pretty quickly.

  source
• popekingjoe@lemmy.world ⁨18⁩ ⁨hours⁩ ago

  I usually just walk down the hall and move the mouse. I don’t really need remote monitoring. 😅

  source
• helix@feddit.org ⁨8⁩ ⁨hours⁩ ago

  Netdata, looking at dashboards when something breaks :)

  source