🏏 450 million fans watched the last IPL. What is 'Cricket Scale' for SREs? Know More

Feb 27th, ‘24/Changelog

Dashboard Health Monitoring: Improving the Embedded Grafana & Alerting Experience

Monitor the health of dashboards created in Levitate's Embedded Grafana using Alert Studio without losing the comfort of the dashboards

Dashboard Health Monitoring: Improving the Embedded Grafana & Alerting Experience

Levitate comes with Embedded Grafana, which allows you to create dashboards for various metrics and components. Levitate also comes with Alert Studio and Changeboards to monitor the health of services and components.

So far, these two operations – visualization and alerting – have been at two different places. You could create and visualize the metrics in dashboards and set up and monitor health with Alert Studio and Changeboards. They were two separate views within Levitate. But that's not how one would go about monitoring their services. The first step is to create a dashboard.

But while looking at a dashboard, service owners also want to know if there is anything broken on this dashboard. Or add alerts for the dashboard. If they can do this, they can:

  1. Take quick actions to mitigate the incident.
  2. Perform impact analysis right there with additional system information via panels.
  3. Leverage the dashboard to inspect over longer ranges to understand health degradation better.
Most notably in a single view, without switching tabs or context.

Dashboards with Alert Monitor

Monitoring Dashboards in Embedded Grafana
Monitoring Dashboards in Embedded Grafana

You can see if any alert is failing alongside the dashboard. You can also see alert groups linked to a dashboard.

Alert Groups linked to the Dashboard
Alert Groups linked to the Dashboard

Creating an alert group from a Dashboard

Click on Create Synced Group and follow along. You can import metrics from across dashboard panels or only specific ones.

Create Alert Group for a Dashboard
Create Alert Group for a Dashboard
Import Dashboard Metrics
Import Dashboard Metrics

This will import all selected metrics as indicators in the synced Alert Group. This massively reduces the need to create alert rules manually via complicated PromQL queries. You define the dashboard and then, in a single click, import all metrics to define alert rules.

Imported Metrics as Indicators
Imported Metrics as Indicators

There is no limit on how many alert groups you can link to a dashboard. Additionally, you can also link an existing alert group as well.

Link an existing alert group to a Dashboard
Link an existing alert group to a Dashboard

Monitoring Health

Using the Alert Monitor view, it becomes straightforward to keep monitoring the health of alert rules linked to the Grafana Dashboard.

The Alert Monitor view auto-refreshes every minute, so the status is real-time.
Monitoring Health of a Dashboard
Monitoring Health of a Dashboard

You can also link Changeboards to a Dashboard.

Changeboard linked to a Dashboard
Changeboard linked to a Dashboard
Filters for Changeboard
Filters for Changeboard
💡
Sign up on Levitate and unlock High Cardinality monitoring that doesn’t die on you.