Skip to content

bug: only send server and node status notifications that make sense - #468

Merged
lukepolo merged 4 commits into
mainfrom
bug/offline-notifications-review
Sep 30, 2026
Merged

lukepolo merged 4 commits into
mainfrom
bug/offline-notifications-review

Conversation

@lukepolo

Copy link
Copy Markdown
Contributor

Admins were getting offline/RCON alerts for servers they had just disabled or restarted, for nodes nobody uses, and duplicate or orphaned node/region alerts. This keeps only the alerts that point at a real, unexpected outage.

  • No offline alerts for disabled servers, or for disabled nodes and GPU nodes with every workload off. A node still hosting an enabled dedicated server counts as in use.
  • When a whole node goes down you get one node alert, not one per server as well.
  • Restarts and rebuilds get a 5 minute grace, and the minute RCON ping only reports a server that has been unreachable for 2 minutes. The ping no longer marks unreachable servers connected.
  • "Back online" alerts (node and region) only follow a matching offline alert.
  • A node set to not accept new matches stays that way after an outage, using the new game_server_nodes.accepting_new_matches column. Toggling a node that is down no longer marks it Online.

- no offline alerts for disabled servers, disabled/unused nodes, or servers
  whose node is already down (the node alert covers it)
- intentional restarts/rebuilds get a 5 minute grace before any down alert
- RCON-down alerts from the minute ping only fire after 2 minutes unreachable
- online alerts only close a matching offline alert (node and region)
- a node set to not accept new matches keeps that state across an outage
…ions-review

# Conflicts:
#	src/dedicated-servers/dedicated-servers.service.spec.ts
- a server on a node that died is checked again once the node is back, so
  one that never returns is still reported
- offline state is written right away; only the alert waits out a restart
- Ranked RCON alerts respect the restart grace
- unreachable streak restarts after a gap in pings, tolerates a missing
  entry, and only records an alert once it was sent
@lukepolo
lukepolo merged commit b904a4d into main Sep 30, 2026
2 checks passed
@lukepolo
lukepolo deleted the bug/offline-notifications-review branch September 30, 2026 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant