Logs panel in dashboards and Slack mention picker

Feature Improvements Fixes

TL;DR

Dashboards get a Logs panel that lists individual log lines, and alerts tag real Slack people and teams. Webhooks can also trust a private CA certificate.

Logs panel in dashboards and Slack mention picker

During an incident, a dashboard could show how many logs arrived, but not what they said. The panel editor in Dashboards now has a Logs visualization that lists one row per log line, so a feed such as Kubernetes events can sit next to your metric panels.

  • A Logs panel cannot aggregate, so the aggregate stage is disabled in its query builder.
  • The Log Settings section sets Rows (1 to 1000, default 1000), Order (Newest first by default, or Oldest first), and the Severity color switch (on by default).
  • The Columns setting picks from Timestamp, Reason, Severity, Kind, Service, and Body. A new panel shows Timestamp, Severity, Service, and Body.
  • When a query returns more rows than the limit, the panel header shows a chip such as 1000+ rows. Clicking a row opens Log details.

Improvements

  • Dashboards: Added Field name pattern (RE2 regular expression) and Data type matchers to Field Overrides, and a Hide from display switch that hides the matching series or table columns. Series name is renamed Field name.
  • Alerting
    • Rules
      • Added Exception types and Operations filters to alerts created from Discover Exceptions, so one rule covers every exception of a service. Alert groups created from Discover Exceptions, Discover Services, and Discover Databases are editable.
      • Added an Operations filter with Include and Exclude to alerts created from the throughput, availability, and error distribution charts in Discover Services.
      • Dropped the “Scheduled Search -” prefix from alert groups created by a scheduled search. The group takes the rule name and follows renames.
    • Channels
      • Pick Special (@here, @channel), Teams, or Members from your Slack workspace in the @Mention field of a Slack channel. Typed mentions keep working. Needs the Last9 Slack app; reinstall it to list teams. See Slack integration.
      • Added a Trusted Certificate (PEM) field to webhook channels, for endpoints signed by a private certificate authority. Hostname verification stays on.

Fixes

  • Dashboards: The field and value pickers of the query builder in the panel editor ignored the editor’s time range.
  • Logs and Traces: The Visualization tab drew a line across time buckets with no data, so a gap looked like a steady value.
  • Logs, Metrics, and Synthetic Monitoring: In dark mode, selected text in the Logs query editor, the PromQL editor, and the Synthetic Monitoring script editor was unreadable.
  • Synthetic Monitoring: The Create Check and Edit Check form was hard to read in dark mode, including the Security Notice.
  • Alerting
    • Monitor: Adaptive alerts appeared under Static in the Algorithm filter, not Anomaly.
    • Rules: Inspect on a notification for a rule created from a Discover chart panel opened the service page instead of the alert modal. Rules created before this fix keep the old link.
  • Agent Observability
    • The Conversations tab showed few or no sessions on busy tenants.
    • The Overview cards and charts disagreed: the Conversations card grew with the time range, and the charts always showed the last 24 hours.