Jul 29th, ‘23/2 min read
Ingest OpenTelemetry metrics with Prometheus natively
Native support for OpenTelemetry metrics in Prometheus
OpenTelemetry and Prometheus are two critical projects in the monitoring and observability world. Prometheus supports metrics monitoring, and OpenTelemetry also allows metrics besides logs and traces.
The semantic convention for metrics in OpenTelemetry(OTLP metrics) does not align with Prometheus' native metrics naming convention.
To address this disparity, there is a module in otel-collector-contrib that offers centralized functions that facilitate the conversion of OpenTelemetry metrics into metrics compliant with Prometheus.
This package translates and maps metric names, units, and labels between the OpenTelemetry and Prometheus conventions. This translation allows sending OTLP metrics to Prometheus using an OpenTelemetry collector. But the native support for ingesting OTLP metrics was absent in Prometheus.
Native support for OpenTelemetry metrics in Prometheus
Recently a pull request by Goutham - Prometheus maintainer and Product Manager at Grafana Labs, was merged in the Prometheus codebase, which adds support for ingesting OpenTelmetry metrics using a new OTLP-compatible ingestion endpoint.
"🚀 Prometheus is integrating OpenTelemetry natively, starting with the next release. 🎉 The initial pull request has been merged, paving the way for a combined pull-based model and OTLP metrics, so no matter how you generate your metrics, we get you covered. 📈" said Prometheus maintainer Julien Pivotto.
A new feature flag otlp-write-receiver has been added, enabling the feature for natively ingesting OpenTelemetry metrics.
The OpenTelemetry metrics can be sent on /otlp/v1/metrics the endpoint and ingested natively.
This change is still experimental, and before the final release, a lot of documentation updates will also happen; I will update this post with the changes and add the final Prometheus release version in which this change will be present!
There is already a discussion in Cortex issue tracker of reusing this capability.
Check out the HackerNews discussion on this post.
I had given a talk at Conf42 Devops 2024 on "The complete handbook to OpenTelemetry Metrics" where I discussed about Prometheus and OpenTelemetry Metrics in more details.
Check the video below:
Contents
Newsletter
Stay updated on the latest from Last9.
Handcrafted Related Posts
Prometheus vs. VictoriaMetrics (VM)
Comparing Prometheus vs. VictoriaMetrics (VM) - Scalability, Performance, Integrations
Last9
Latency is the new downtime
In the early days of Google, a lot of users were asking for 30 results on the first page of search results. So after long deliberation, Marissa Mayer, then the Product Manager for google.com, decided to run the A/B test for ten vs 30 results. When the results came in, they were in for a surprise.
Sahil Khan
mv aws-security-group shoot-foot
How you can run into an unplanned downtime while making a seemingly harmless change of renaming an AWS security group through Terraform?
Saurabh Hirani