Cloud Native Computing Foundation / PromCon Online EU 2021

Add meeting Rate page Subscribe

Cloud Native Computing Foundation / PromCon Online EU 2021

These are all the meetings we have in "PromCon Online EU 2021" (part of the organization "Cloud Native Computi…"). Click into individual meeting pages to watch the recording and search or read the transcript.

21 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Sponsored Keynote - Fun and Games: Using Prometheus to aggregate disparate metric data formats at a major gaming company - Matvey Arye, Timescale

In this session, you’ll learn how and why a major gaming company used Prometheus to simplify querying, dashboarding, and reporting on their load testing data, by aggregating disparate metric formats. You’ll learn about the challenge of centralizing monitoring data from disparate sources, why it's becoming increasingly common, and an example of how to overcome it by using Prometheus in an innovative way. You’ll also walk away with a nuanced understanding of the importance of flexibility in observability systems, as well as frameworks to advocate for more Prometheus adoption inside your organization.
We’ll focus on one story, but the problem of aggregating disparate metric sources is an all too common one.
In this case, a major gaming company uses Prometheus to conduct load testing before releasing its games into production, so that every game runs reliably and performantly. Each online game is composed of many services, run by independent engineering teams. Given the mammoth scale of the company, it was not possible to standardize on one tool to monitor metrics. Each team used its favorite metrics monitoring tool, which includes all the usual suspects, like Prometheus, DataDog, Graphite, Zabbix, New Relic, StatsD, etc.

This gave rise to an interesting technical challenge: how to efficiently centralize load testing metrics and monitoring data from disparate metrics sources into a consistent format and data store?
The gaming company solved this problem by using Prometheus and Promscale -a versatile long-term store for observability - to centralize, store and analyze the disparate load testing metrics. The result is a simple, unified system that allows the team to run queries, deliver useful dashboards, and generate reports to analyze load test results in an on-demand and self-serve fashion.
We’ll also discuss some other dimensions of storage flexibility we believe are beneficial to support complex, hybrid environments, often found in the real world.
  • 1 participant
  • 9 minutes
prometheus
analytics
testing
observability
centralize
users
monitored
scale
time
staging
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

A New Kid in Histogram Town - Björn Rabenstein, Code Fresh & RedHat

“Bedecke deinen Himmel, Zeus! A new kid is in town.”

That was the beginning of Prometheus's README.md in the olden days of your favorite monitoring system. Prometheus changed how the world was doing monitoring. Now it is time to change how Prometheus is doing histograms.

After a lot of research and even more delays, we finally have a design doc with the momentous title “Sparse high-resolution histograms for Prometheus”. Guided by this document, we are currently working on making better histograms for Prometheus a reality. This talk will tell you about what already works and what the next steps will be."
  • 1 participant
  • 22 minutes
prometheus
prequel
newer
topic
observation
project
ancient
histogram
read
populated
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Auto-suggesting and generating recording rules for Prometheus - Shreyas Srivatsan & Gibbs Cullen, Chronosphere

"High cardinality metrics often cause alerts and dashboards to time out when they try to fetch too much data. Prometheus provides recording rules to speed up queries by pre-generating the queries, however, they have to be configured manually and require reconfiguring alerts and dashboards to point to the recorded series. The performance degradation often happens as new metrics are introduced with more instances or deploys and a working query may break all of a sudden.

In this talk, we will show you how slow queries can be preemptively detected and automatically sped up without any manual reconfiguration. This is done by automatically analyzing the widely available inbuilt Prometheus query log and generating suggested recording rules for frequently queried metrics that take considerable time to execute.

We’ll walk through a concrete demo of the tool which can also use parameters min-query-time and min-query-count to help suggest the most impactful recording rules: https://github.com/chronosphereio/high-cardinality-analyzer."
  • 1 participant
  • 23 minutes
dashboarding
dashboard
monitoring
aggregation
analyzing
efficient
advisor
speeding
data
container
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

How we converted our Cortex data to TSDB blocks - Peter Štibraný, Grafana Labs

Cortex has recently gained support for storing data in Prometheus TSDB format (using so-called "blocks engine", also reusing some parts of Thanos). In Grafana Labs, we had hundreds of terabytes of data in previous format, and we wrote scalable tooling to convert it all to TSDB blocks. In the talk, I would like to present the tooling, show some details from Prometheus TSDB internals, and show how simple it is to generate TSDB blocks using Go code and what pitfalls to avoid.
  • 1 participant
  • 23 minutes
cortex
storing
tsdb
memory
schemas
sdb
replication
chunks
gigabytes
prometheus
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Leveraging Prometheus’ TSDB for conprof (Continuous Profiling) - Matthias Loibl

"conprof - github.com/conprof/conprof - is an open-source project that collects profile samples of CPU and memory over time, which can be used for performance analysis amongst other things. Conprof has its roots in Prometheus, this talk elaborates on the similarities that have prevailed as well as the optimizations that had to be made to make it more suitable for continuous profiling. We will first demonstrate how conprof works by analyzing an application with a memory leak.

Prometheus’ time-series database (TSDB) stores tuples of timestamp and float64 value, for each time series and thus, is optimized for storing these as efficiently as possible. conprof, on the other hand, needs to store tuples of timestamp and the raw, recorded profile that can be arbitrarily large. We needed to adapt the TSDB for a completely new use case.

Every conprof workflow starts by looking at the timestamps of each series and only afterwards individual profiles are requested. We explored optimizing for timestamp-reads to ignore the profiling data to save CPU and memory. Separating timestamps and profiles would make it easier and maybe we could improve the compression for profiles?
This talk will take us on a journey to see how we've answered these questions so far!"
  • 1 participant
  • 24 minutes
profiling
benchmarking
profiler
dashboard
instrumentation
cpu
metamata
routine
latency
prometheus
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: How to fill in historical data for new recording rules - Jessica Grebenschikov, Prometheus

Have you ever created a new recording rule and wished there was historical data for that rule right away? If so, you're in luck because now there is a way to fill in historical data when new recording rules are created. Find out how in this talk.
  • 1 participant
  • 5 minutes
recording
save
executed
rules
demo
prometheus
documentation
data
logs
past
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Load testing your Prometheus Remote Write endpoints - Daniel González Lopes, k6.io

"Remote write storage is supported by several systems (Cortex, Thanos, M3DB, InfluxDB) and since 2.25.0 by Prometheus itself.

In this lightning talk, you will learn how to load test these systems using the open-source tool k6 and its fresh new xk6 remote write extension. Also, we'll briefly talk about additional use cases and how to export the results to Prometheus."
  • 1 participant
  • 5 minutes
testing
cortex
kubernetes
remote
experimental
k6
microservices
prometheus
kisis
repository
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Prometheus rules validation one step further - Martin Chodur, Seznam

Introduction of a new tool for validation of Prometheus rules metadata and expression properties to align with the infrastructure setup.
  • 1 participant
  • 6 minutes
validated
validation
validate
validating
validator
validators
alerting
ensure
tool
repository
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: SNMP done quick - tuning JunOS for metrics extraction - Ben Kochie, GitLab
  • 1 participant
  • 5 minutes
snmp
performance
scrape
slow
cache
improved
tools
logs
mapped
port
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Making Prometheus even more open - Richard Hartmann, Grafana Labs

We are actively working to make the Prometheus community even more open and even more welcoming. We want to give an overview of where we're at with this.
  • 1 participant
  • 18 minutes
open
expose
prometheus
openmetrics
observability
version
synchronize
promises
deploying
caching
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Monitoring the monitor - David Leadbeater, G-Research

There are various ways to make sure Prometheus is working. We’ll cover these from cloud based services to Prometheus instances monitoring each other. Then we’ll explain why we developed a component to help with this.
  • 1 participant
  • 14 minutes
monitoring
monitored
prometheus
monitor
alerting
device
critical
deploying
essentially
cloud
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Observability for Air Conditioners: An IoT Story with Talos - William Gathright, Talos IoT

The internet of things (IoT) is all about connecting real-world objects to get timeseries data out of them. And what better thing to do with timeseries data than feed it to Prometheus? Hear the story of how start-up company Talos IoT is applying Prometheus and the rest of the observability stack to critical equipment like air conditioners. The talk covers why Prometheus is a natural fit for IoT data before going into some of the challenges that happen when we stop monitoring Kubernetes Pods and start getting real!
  • 1 participant
  • 25 minutes
iot
technologies
devices
monitoring
prometheus
telos
useful
hvac
coil
kubernetes
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Opening Remarks - Richard Hartmann, Community Director, Grafana Labs
  • 1 participant
  • 9 minutes
vaccinated
vaccines
concern
2023
having
announcement
expect
kovacs
compliance
promcom
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

PromQL Compatibility Testing - Verifying Vendor Claims for End User Benefit - Julius Volz, PromLabs

Prometheus' query language PromQL is one of the most important interfaces in the Prometheus ecosystem. Organizations rely on it to build their dashboards, critical alerting, and automation. With Prometheus becoming more popular, we are seeing more and more PromQL implementations outside of Prometheus itself, both in open-source projects and in hosted monitoring providers. While this is great, not all implementations that claim to be PromQL-compatible actually implement PromQL correctly. To avoid user confusion, ecosystem fragmentation, and vendor lock-in, we want to encourage fully compatible implementations and at the same time increase transparency around the actual compatibility of different solutions.

In this talk, Prometheus co-founder Julius Volz will present an open-source PromQL compliance testing suite that can shine a light on the compatibility situation. He will also outline test results of actual vendor PromQL implementations, dive into some of the encountered behavioral differences, and give recommendations for anyone wanting to implement PromQL in their own product or service.
  • 1 participant
  • 23 minutes
promlabs
prometheus
promql
promlance
interoperability
prom
monitoring
compatibility
consulting
promises
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Sponsored Keynote: Upstream-First, High Scale Prometheus Ecosystem - Kemal Akkoyun, Software Engineer, RedHat

Welcome to the beautiful world of cloud-native observability. Where things that your application is doing are understandable, clear, and non-surprising. Where you get notified only when the user is impacted or will be soon. Where you can in minutes drill down to what’s wrong, where the impact is and why. Where running the observability does not mean deploying 4 separate big, expensive systems with different UI and endpoints.

This is what is achievable right now with open source projects, we help maintain at Red Hat. Prometheus is no longer just one binary. It’s the way of thinking, a way of simplifying observability on all fronts. Join us to learn more about how Red Hat runs Prometheus and other open-source projects that share the same principles and patterns.
  • 1 participant
  • 10 minutes
telemeter
monitoring
telemetry
remote
functionality
users
openshift
prometus
information
workflows
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

The Future is Bright, the Future is Prometheus Remote Write - Tom Wilkie, Grafana Labs

"Prometheus remote write was introduced almost 5 years ago as a way for Prometheus to send samples to external storage. Since then the protocol has been implemented by ~30 different metrics systems - and in version 2.25, Prometheus itself accepts remote write!

In this talk we'll discuss the use cases for pushing data to Prometheus via remote write - and more importantly, what it's not meant for. We'll present a more thorough specification of the protocol, and some of the future plans and what a remote write v2 might look like - streaming? metadata? exemplars?"
  • 1 participant
  • 21 minutes
remote
prometheus
right
edge
future
sharding
protocol
cortex
help
telemetry
youtube image

14 May 2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Ups, let's revert! 🔥 Automating Kubernetes Rollouts with Argo and Prometheus for HA - Bartlomiej Płotka & Anais Urlichs, Codefresh

"Thanks to Kubernetes, deploying and running applications in the cloud was never easier. Unfortunately, with the capabilities, desire for highly reliable services with strict minimal downtime SLO grows too. And we all know what increases risk of incidents: Upgrades!
Vanilla rollouts functionality works great for basic needs, but it lacks many advanced deployment strategies which can drastically reduce distruption time during critical production promotions, especially those failed ones. That’s were Argo Rollouts comes in, solving this need by introducing tiny shim over Kuberentes Deployment object. But with the power, comes the complexity and without proper observability and monitoring it can become unmanagable pretty quickly.

In this talk you will see demo showing an efficient way of setting up critical Prometheus monitoring and alerting for advanced Kubernetes deployment operations Argo allows. You will learn how to observe the progress of your rollouts, Blue-Green or Canary deployments, how to perform rollbacks without human intervention and how to only alert when humans have to be called!"
  • 2 participants
  • 27 minutes
microservices
platform
users
2021
sivo
conference
thanos
prepared
prometheus
argo
youtube image