From 709ca977aa17e1c4fb75068e0738b93f0343e0cf Mon Sep 17 00:00:00 2001 From: Catalina A Date: Thu, 30 Jul 2026 12:48:37 +0300 Subject: [PATCH 1/5] alert status changes --- documentation/docs/alert/alert_status.md | 59 ++++++++++++++++++++++++ documentation/mkdocs-base.yml | 2 + 2 files changed, 61 insertions(+) create mode 100644 documentation/docs/alert/alert_status.md diff --git a/documentation/docs/alert/alert_status.md b/documentation/docs/alert/alert_status.md new file mode 100644 index 00000000000..fe707b97ead --- /dev/null +++ b/documentation/docs/alert/alert_status.md @@ -0,0 +1,59 @@ +# View alert status by node or service + +When you need the full alert picture for a node or service, go to **Alerts > Status**. It shows every active alert and its current state in a single view. + +This page is only available when **Percona Alerting** is enabled. To check, go to **Configuration > Settings > Advanced settings**. + +## Check alerts for a specific node + +To see all alerts affecting a single node: +{.power-number} + +1. Go to **Alerts > Status**. +2. Toggle **Group by node** in the toolbar. +3. Find your node and expand it to see its individual alerts and their states. + +## Filter alerts by state + +Use the **State** dropdown in the toolbar to show only alerts in a specific state: **Normal**, **Pending**, **Firing**, **Recovering**, **No Data**, **Error** or **Silenced**. + +## Check alerts for a specific service + +To filter the alert list by service: +{.power-number} + +1. Go to **Alerts > Status**. +2. Click **Show/Hide filters** in the toolbar to reveal the column filters. +3. In the **Service** column filter, enter the service name. + +The table updates to show only alerts associated with that service. + +## Get details on an alert + +Click any alert row to open the details pane. From here you can: + +- **See what triggered the alert**: the **Details** tab shows the summary, description, state and duration, node, service, severity, triggered at timestamp, and the MetricsQL expression. Check **Rule configuration** to see evaluation settings, template name, folder, and rule health. +- **Debug custom templates or verify label values**: switch to **Raw data** to inspect the full label set and JSON payload. +- **Move between alerts**: use the arrow buttons in the pane header to go to the next or previous alert without closing the pane. + +## Silence an alert + +You need **Editor** role or higher to silence alerts. +{.power-number} + +1. Click the actions menu on the alert row. +2. Click **Silence**. PMM opens the **Silences** page with the alert labels pre-filled. +3. Set the duration and confirm. + +Silenced alerts stay visible in the table with a **Silenced** badge. To unsilence, open the actions menu and click **Unsilence**. + +## Make custom alerts appear in this view + +Built-in PMM alert templates automatically include the labels that this page uses to group alerts by node and service. + +If your custom templates do not show up correctly, add these labels to the template definition: + +- `node_name`: identifies the monitored node. +- `service_name`: identifies the monitored service. + +For instructions, see [Alert rules and alert templates](../alert/templates.md). \ No newline at end of file diff --git a/documentation/mkdocs-base.yml b/documentation/mkdocs-base.yml index 376187d5785..0d376470a98 100644 --- a/documentation/mkdocs-base.yml +++ b/documentation/mkdocs-base.yml @@ -395,10 +395,12 @@ nav: - Percona Alerting: - alert/index.md - alert/alert_rules.md + - alert/alert-status.md - alert/contact_points.md - alert/templates_list.md - alert/silence_alerts.md - alert/disable_alerts.md + - Back up and restore: - backup/index.md - backup/prepare_storage_location.md From 842df5e17003bbbf6656a2580c15c421c6a9b52a Mon Sep 17 00:00:00 2001 From: Catalina A Date: Thu, 30 Jul 2026 13:26:02 +0300 Subject: [PATCH 2/5] icon --- documentation/docs/release-notes/3.9.0.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/documentation/docs/release-notes/3.9.0.md b/documentation/docs/release-notes/3.9.0.md index 487010993f4..73bbd583aa1 100644 --- a/documentation/docs/release-notes/3.9.0.md +++ b/documentation/docs/release-notes/3.9.0.md @@ -259,7 +259,7 @@ To lower your exposure in the meantime: - [PMM-15114](https://perconadev.atlassian.net/browse/PMM-15114): Fixed the **Scanned and Moved Objects** panel in the **MongoDB Instance Summary** dashboard showing blank labels in the legend instead of the operation type (`scanned`, `scanned_objects`). -## Known issues +## 🔶 Known issues ### UI upgrade progress bar stops when upgrading to PMM 3.9.0 ([PMM-15266](https://perconadev.atlassian.net/browse/PMM-15266)) From ce681a96e984af21524a52066407f60efee50e6f Mon Sep 17 00:00:00 2001 From: Catalina A Date: Fri, 31 Jul 2026 11:19:51 +0300 Subject: [PATCH 3/5] reword --- documentation/docs/alert/alert_status.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/documentation/docs/alert/alert_status.md b/documentation/docs/alert/alert_status.md index fe707b97ead..ddf056da7aa 100644 --- a/documentation/docs/alert/alert_status.md +++ b/documentation/docs/alert/alert_status.md @@ -1,8 +1,9 @@ # View alert status by node or service -When you need the full alert picture for a node or service, go to **Alerts > Status**. It shows every active alert and its current state in a single view. +Use the **Alert Status** page to see all active alerts for a node or service in one place, check their states, and silence them without switching views. + +This page is only available when Percona Alerting is enabled. To check, go to **Configuration > Settings > Advanced settings**. -This page is only available when **Percona Alerting** is enabled. To check, go to **Configuration > Settings > Advanced settings**. ## Check alerts for a specific node From 7c41ccfbf5cb8760acf034d1a90c62e6dc24f9ab Mon Sep 17 00:00:00 2001 From: Catalina A Date: Mon, 3 Aug 2026 23:54:08 +0300 Subject: [PATCH 4/5] feedback from Shruti --- documentation/docs/alert/alert_status.md | 14 ++++++++++---- documentation/docs/alert/templates_list.md | 8 ++++---- documentation/docs/release-notes/3.9.0.md | 13 +++++++++++-- 3 files changed, 25 insertions(+), 10 deletions(-) diff --git a/documentation/docs/alert/alert_status.md b/documentation/docs/alert/alert_status.md index ddf056da7aa..e2ab617f4a9 100644 --- a/documentation/docs/alert/alert_status.md +++ b/documentation/docs/alert/alert_status.md @@ -1,8 +1,5 @@ # View alert status by node or service - -Use the **Alert Status** page to see all active alerts for a node or service in one place, check their states, and silence them without switching views. - -This page is only available when Percona Alerting is enabled. To check, go to **Configuration > Settings > Advanced settings**. +When alerts fire, you need to know which nodes or services are affected and what state each alert is in. Use the **Alert Status** page to get that picture at a glance, triage by state, and silence alerts without switching pages. ## Check alerts for a specific node @@ -52,6 +49,15 @@ Silenced alerts stay visible in the table with a **Silenced** badge. To unsilenc Built-in PMM alert templates automatically include the labels that this page uses to group alerts by node and service. +The following templates show data even when no alert is firing, so you can see how close a node or service is to triggering an alert before it does: + +- **Node high CPU load** +- **MongoDB DBPath disk space utilization** +- **PostgreSQL high rate of transaction rollbacks** +- **PostgreSQL connections in use** + +Support for more templates to show data when no alert is firing will be added in future releases. + If your custom templates do not show up correctly, add these labels to the template definition: - `node_name`: identifies the monitored node. diff --git a/documentation/docs/alert/templates_list.md b/documentation/docs/alert/templates_list.md index 387668bdef5..ad4c4a76e80 100644 --- a/documentation/docs/alert/templates_list.md +++ b/documentation/docs/alert/templates_list.md @@ -17,7 +17,7 @@ The table below lists all the alert templates available in Percona Monitoring an | Area | Template name | Description | Database technology | | :----|:------------- | :---------- | :------------------ | -| OS | **Node high CPU load** | Monitors node CPU usage and alerts when it surpasses 80% (default threshold). Provides details about specific nodes experiencing high CPU load, indicating potential performance issues or scaling needs. | MySQL, MongoDB, PostgreSQL | +| OS | **Node high CPU load** | Monitors node CPU usage and alerts when it surpasses 80% (default threshold). Provides details about specific nodes experiencing high CPU load, indicating potential performance issues or scaling needs. Visible in the **Alert Status** page even when CPU usage is within the threshold, so you can monitor load before it becomes a problem. | MySQL, MongoDB, PostgreSQL | | OS | **Memory available less than a threshold** | Tracks available memory on nodes and alerts when free memory drops below 20% (default threshold). Helps prevent system instability due to memory constraints. | MySQL, MongoDB, PostgreSQL | | OS | **Node high swap filling up** | Monitors node swap usage and alerts when it exceeds 80% (default threshold). Indicates potential memory pressure and performance degradation, allowing for timely intervention. | MySQL, MongoDB, PostgreSQL | @@ -36,7 +36,7 @@ The table below lists all the alert templates available in Percona Monitoring an | :----|:------------- | :---------- | :------------------ | | MongoDB | **MongoDB down** | Detects when a MongoDB instance becomes unavailable, enabling rapid response to maintain database accessibility. When monitoring MongoDB sharded clusters, alerts using this template detect outages in any cluster component (configuration servers, Mongos routers, data-bearing nodes, and arbiters). | MongoDB | | MongoDB | **MongoDB restarted** | Detects recent MongoDB restarts, alerting if an instance has been restarted within the last 5 minutes (default threshold). Facilitates investigation of unexpected downtime and potential issues. | MongoDB | -| MongoDB | **MongoDB DBPath disk space utilization** | Monitors disk space usage in MongoDB's data directory and alerts when it exceeds set thresholds. Helps prevent storage-related issues and ensures adequate space for database operations. | MongoDB | +| MongoDB | **MongoDB DBPath disk space utilization** | Monitors disk space usage in MongoDB's data directory and alerts when it exceeds set thresholds. Helps prevent storage-related issues and ensures adequate space for database operations. Visible in the Alert Status page even when disk usage is within the threshold, so you can monitor usage before it becomes a problem. | MongoDB | | MongoDB | **MongoDB host SSL certificate expiry** | Tracks SSL certificate expiration dates for MongoDB hosts and alerts when certificates are approaching expiry. Enables timely certificate renewal to maintain secure connections. | MongoDB | | MongoDB | **MongoDB oplog window** | Monitors the oplog window size and alerts when it falls below the recommended threshold (typically 24-48 hours). Ensures sufficient time for secondary nodes to replicate data and maintain cluster consistency. | MongoDB | | MongoDB | **MongoDB read tickets** | Tracks read ticket availability in the WiredTiger storage engine and alerts when it falls below set thresholds. Helps optimize read performance and identify potential bottlenecks. | MongoDB | @@ -75,12 +75,12 @@ The table below lists all the alert templates available in Percona Monitoring an | :----|:------------- | :---------- | :------------------ | | PostgreSQL | **PostgreSQL down** | Detects when PostgreSQL instances become unavailable, enabling quick response to maintain database services. Provides details about affected services and nodes. | PostgreSQL | | PostgreSQL | **PostgreSQL restarted** | Identifies recent PostgreSQL restarts, alerting if an instance has been restarted within the last 5 minutes (default threshold). Aids in investigating unexpected downtime and potential issues. | PostgreSQL | -| PostgreSQL | **PostgreSQL connections in use** | Monitors PostgreSQL connection usage and alerts when the percentage of active connections exceeds 80% of the maximum allowed (default threshold). Helps prevent performance degradation due to excessive connections. | PostgreSQL | +| PostgreSQL | **PostgreSQL connections in use** | Monitors PostgreSQL connection usage and alerts when the percentage of active connections exceeds 80% of the maximum allowed (default threshold). Helps prevent performance degradation due to excessive connections. Visible in the Alert Status page even when connection usage is within the threshold, so you can monitor connections before it becomes a problem. | PostgreSQL | | PostgreSQL | **PostgreSQL index bloat is high** | Detects excessive index bloat and alerts users. Helps identify performance degradation due to bloated indexes, enabling timely maintenance to improve query performance. | PostgreSQL | | PostgreSQL | **PostgreSQL high number of dead tuples** | Monitors the accumulation of dead tuples in relations and alerts when they exceed set thresholds. Indicates potential issues with vacuum settings and helps optimize storage and query performance. | PostgreSQL | | PostgreSQL | **PostgreSQL has a high number of statement timeouts** | Tracks and alerts on frequent query cancellations due to statement timeouts. Helps identify various issues such as high load, poorly written queries, or inadequate resource allocation. | PostgreSQL | | PostgreSQL | **PostgreSQL table bloat is high** | Detects excessive table bloat and alerts users. Indicates a need to adjust vacuum settings for specific relations or globally, helping to maintain optimal query performance and storage efficiency. | PostgreSQL | -| PostgreSQL | **PostgreSQL high rate of transaction rollbacks** | Monitors the ratio of transaction rollbacks to commits and alerts on high rates. Helps identify potential application or database issues leading to frequent transaction failures. | PostgreSQL | +| PostgreSQL | **PostgreSQL high rate of transaction rollbacks** | Monitors the ratio of transaction rollbacks to commits and alerts on high rates. Helps identify potential application or database issues leading to frequent transaction failures. Visible in the Alert Status page even when the rollback rate is within the threshold, so you can monitor transaction health before it becomes a problem. | PostgreSQL | | PostgreSQL | **PostgreSQL tables not auto analyzed** | Identifies tables that are not being auto-analyzed and alerts users. Crucial for maintaining accurate statistics and generating proper query execution plans. | PostgreSQL | | PostgreSQL | **PostgreSQL tables not auto vacuumed** | Detects tables that are not being auto-vacuumed and alerts users. Essential for managing bloat, optimizing storage, and maintaining overall database health. | PostgreSQL | | PostgreSQL | **PostgreSQL unused replication slot** | Identifies and alerts on unused replication slots. Helps prevent excessive WAL retention and potential disk space issues, especially when replicas are offline. | PostgreSQL | diff --git a/documentation/docs/release-notes/3.9.0.md b/documentation/docs/release-notes/3.9.0.md index 73bbd583aa1..6f181472851 100644 --- a/documentation/docs/release-notes/3.9.0.md +++ b/documentation/docs/release-notes/3.9.0.md @@ -15,11 +15,20 @@ PMM 3.9.0 introduces the **Alert Status** page for viewing all active alerts by This release also removes the provisioned PostgreSQL datasource as a security measure, adds Ubuntu 26.04 LTS support for PMM Client, and includes a large number of dashboard, UI, and stability fixes. -### Alert Status page: view alerts by node or service +## Alert Status page: view alerts by node or service You can now check the full alert picture for any node or service in a single view. Go to **Alerts > Status** and filter by service or group by node to see every associated alert rule and its current state, so you don't have to piece together the situation from alerts grouped by alert name. -All built-in PMM alert templates work with this view automatically. If you use custom templates, you can add `node_name` and `service_name` labels to make your alerts appear here too. To learn how, see [View alert status by node or service](../alert/alert_status.md). +All built-in PMM alert templates appear in this view when alerts are firing. Four templates also show data even when no alert is firing, so you can see how close a node or service is to triggering an alert before it does. + +- **Node high CPU load** +- **MongoDB DBPath disk space utilization** +- **PostgreSQL high rate of transaction rollbacks** +- **PostgreSQL connections in use** + +Support for continuous reporting will be extended to more templates in future releases. + +If you use custom templates, you can add `node_name` and `service_name` labels to make your alerts appear here too. To learn how, see [View alert status by node or service](../alert/alert_status.md). ![Alert status page](../images/Alert_status.png) From ed490a9f0e730ef1d2ec8550f7ae01b68bd6417f Mon Sep 17 00:00:00 2001 From: Catalina A Date: Mon, 3 Aug 2026 23:59:34 +0300 Subject: [PATCH 5/5] links --- documentation/docs/alert/alert_status.md | 2 +- documentation/docs/alert/silence_alerts.md | 2 +- documentation/mkdocs-base.yml | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/documentation/docs/alert/alert_status.md b/documentation/docs/alert/alert_status.md index e2ab617f4a9..f22bafba92b 100644 --- a/documentation/docs/alert/alert_status.md +++ b/documentation/docs/alert/alert_status.md @@ -63,4 +63,4 @@ If your custom templates do not show up correctly, add these labels to the templ - `node_name`: identifies the monitored node. - `service_name`: identifies the monitored service. -For instructions, see [Alert rules and alert templates](../alert/templates.md). \ No newline at end of file +For instructions, see [Alert rules and alert templates](../alert/alert_rules.md). \ No newline at end of file diff --git a/documentation/docs/alert/silence_alerts.md b/documentation/docs/alert/silence_alerts.md index 9b9be71107c..e2a19ed4556 100644 --- a/documentation/docs/alert/silence_alerts.md +++ b/documentation/docs/alert/silence_alerts.md @@ -7,7 +7,7 @@ You can also schedule a silence for a future date and time. This is referred to During a silence, PMM continues to track metrics but does not trigger alerts or send notifications to any specified contact points. Once the silence expires alerts and notifications will resume. -Silenced alerts are still recorded under **Alerting > Fired Alerts** so that you can review them later. Silenced alerts show up as **Suppressed** and are disabled for as long as it's specified in the **Silence Duration**, or until you remove a silence. +Silenced alerts are still recorded under **Alerting > Fired Alerts** so that you can review them later. Silenced alerts show up as **Silenced** and are disabled for as long as it's specified in the **Silence Duration**, or until you remove a silence. ## Using silences diff --git a/documentation/mkdocs-base.yml b/documentation/mkdocs-base.yml index 0d376470a98..0c8a3330cb1 100644 --- a/documentation/mkdocs-base.yml +++ b/documentation/mkdocs-base.yml @@ -395,7 +395,7 @@ nav: - Percona Alerting: - alert/index.md - alert/alert_rules.md - - alert/alert-status.md + - alert/alert_status.md - alert/contact_points.md - alert/templates_list.md - alert/silence_alerts.md