Monitoring Service
This service monitors the health of your DCS servers.
It detects crashes or unwanted popups, full disks, too low server FPS or too high RAM usage.
It also generates load information to be used with the /serverload command.
Servers that are considered RUNNING, PAUSED, or STOPPED will be monitored for any unusual popup (login or lua error) or crashes of the respective DCS.exe or DCS_server.exe process. A heartbeat will be sent to DCS every minute. The maximum number of heartbeats a server can miss can be configured in your instance configuration in nodes.yaml
If you do not have a static IP address, you can use this service to auto-restart your servers on IP changes.
Configuration
The (optional) configuration file for this service has to be placed into config\services\monitoring.yaml:
# config/services/monitoring.yaml
DEFAULT:
time_sync: true # sync the PC time with a time-server every 12 hrs, default: false
time_server: pool.ntp.org # and use this non-default time-server for it, default: Windows default
ignore_ip_changes: false # If you don't have a fixed IP, the bot will automatically restart your servers on a change of your public IP. If you don't want that, set this to true.
messages:
ip_change: Server is being restarted due to an IP change!
thresholds:
Drive: # You cannot disable the drive check. If you do not specify anything, these values will be taken as default.
warn: 10 # Warn, if your drive where DCS is installed (or your C: drive), gets below 10% (default: 10)
alert: 5 # Send an alert if your DCS drive (or your C: drive) gets below 5% (default: 5)
message: "Available space on drive {drive} has dropped below {pct}%!\nOnly {bytes_free} out of {bytes_total} free."
FPS: # Optional FPS-check
min: 30 # if FPS reaches a min of 30 (default: 30)
period: 5 # for at least 5 minutes (default: 5)
message: "Server {server} FPS ({fps}) has been below {min_fps} for more than {period} minutes."
mentioning: true # and mention the admins (default: true)
RAM: # Optional RAM-check
max: 32 # if RAM exceeds 32 GB (default: 32)
period: 5 # for at least 5 minutes (default: 5)
message: "Server {server} RAM usage is {ram} GB, exceeding the maximum of {max_ram} GB for more than {period} minutes."
mentioning: true # and mention the admins (default: true)
DCS Server keep-alive Check
To configure the DCS server monitoring, you can change these values in your nodes.yaml and scheduler.yaml:
nodes.yaml
# config/nodes.yaml
MyNode:
DCS.dcs_serverrelease:
max_hung_minutes: 5 # maximum heartbeats a server can miss (default: 3)
plugins/scheduler.yaml
# config/plugins/scheduler.yaml
DCS.dcs_serverrelease:
schedule:
00-24: YYYYYYY # the server (and its DCS_server.exe process) should run 24x7
Configuration reference
| Key | Type | Description | Example |
|---|---|---|---|
DEFAULT |
map | Applies to every instance. | |
DEFAULT
| Key | Type | Description | Example |
|---|---|---|---|
DEFAULT.time_sync |
bool | Sync the PC clock with a time server twice a day. | true |
DEFAULT.time_server |
str | NTP server used for the automated time sync. (range: min 1) | pool.ntp.org |
DEFAULT.thresholds |
map | Warn and alert limits for the drive, FPS and RAM checks. | Drive: |
DEFAULT.thresholds.Drive |
map | Free-space warnings for the DCS and system drives. | warn: 10 |
DEFAULT.thresholds.Drive.warn |
int | Free-space percentage that raises a warning. (range: min 1, max 50) | 10 |
DEFAULT.thresholds.Drive.alert |
int | Free-space percentage that raises a full alert. (range: min 1, max 25) | 5 |
DEFAULT.thresholds.Drive.message |
str | Message sent when a drive drops below a threshold. (range: min 1) | Available space on drive {drive} dropped below {pct}%! |
DEFAULT.thresholds.Drive.mentioning |
bool | Mention the admin role in the drive warning. | true |
DEFAULT.thresholds.FPS |
map | Warn when the server FPS stays too low. | min: 30 |
DEFAULT.thresholds.FPS.min |
int | FPS floor that triggers the warning. (range: min 1, max 60) | 30 |
DEFAULT.thresholds.FPS.period |
int | Minutes FPS must stay low before warning. (range: min 1, max 30) | 5 |
DEFAULT.thresholds.FPS.message |
str | Message sent when server FPS stays too low. (range: min 1) | Server {server} FPS ({fps}) has been below {min_fps} for more than {period} minutes. |
DEFAULT.thresholds.FPS.mentioning |
bool | Mention the admin role in the FPS warning. | true |
DEFAULT.thresholds.RAM |
map | Warn when the server RAM usage stays too high. | max: 32 |
DEFAULT.thresholds.RAM.max |
int | RAM ceiling in GB that triggers the warning. (range: min 8) | 32 |
DEFAULT.thresholds.RAM.period |
int | Minutes RAM must stay high before warning. (range: min 1, max 30) | 5 |
DEFAULT.thresholds.RAM.message |
str | Message sent when server RAM usage stays too high. (range: min 1) | Server {server} RAM usage is {ram} GB, exceeding the maximum of {max_ram} GB. |
DEFAULT.thresholds.RAM.mentioning |
bool | Mention the admin role in the RAM warning. | true |
<(.+)>
| Key | Type | Description | Example |
|---|---|---|---|
<(.+)> |
any | (one of: element_schema, instance_schema) | |