Cloud Native Computing Foundation / Prometheus

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Meeting notes - https://docs.google.com/document/d/12QylAyrWgKzfDJ1ApTwNWSUBQjiZEo3kfp5c2wi6JO0

Behind the Iron Curtain: Getting Metrics From the Browser into Prometheus [I] - Tom Wilkie, Weaveworks

Prometheus has so far been pigeon holed as a monitoring technology for the backend; well, no more! With the rise of single-page apps, gathering metrics from within the browser has never been more important - latency as experienced by the user is much more important than any measurements taken from individual backend services. And if you can’t track Javascript errors that could potentially lead to blank screens, you should feel bad.

This talk presents a method for tracking UI metrics and errors with Prometheus. By getting this data into Prometheus, you can reuse the dashboarding and alerting options that you've grown to love. And by using a common monitoring stack across frontend and backend, you can finally claim the throne of the king of fullstack!

About Tom Wilkie
Tom is a Software Engineer at Weaveworks. Previously he was at Google as a Site Reliability Manager for Google Analytics. Before that he was Founder, VP Eng and CTO at Acunu, and before that a Software Engineer at XenSource. In his spare time, Tom likes to make craft beer and build home automation systems - and distributed tracers!
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Configuring Prometheus for High Performance [A] - Björn Rabenstein, SoundCloud Ltd.

A key to Prometheus's success is its operational simplicity. It takes only minutes to get a server with a meaningful configuration up and running from scratch. However, once you need to run your Prometheus server a bit hotter, you will quickly find yourself practicing the dark art of tuning Prometheus command line flags. This talk will shed some light on how to handle various scenarios: How to run Prometheus on a tiny machine or how to utilize a large amount of RAM. How to optimize for very high ingestion rates or for a lot of time series. How to get the most out of your old spinning disk or how to limit the wearout of your expensive SSD. There will also be a sneak preview of ongoing efforts to reduce the required amount of flag tuning.

About Björn Rabenstein
Björn is a Production Engineer at SoundCloud and one of the Prometheus core developers. Previously, he was a Site Reliability Engineer at Google and a number cruncher for science.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Monitor My Socks: Using Prometheus in a Polyglot Open Source Microservices Reference Architecture [I] - Phil Winder, Winder Research/Container Solution

This presentation describes how Prometheus was integrated into a polyglot microservices application. We will use the "Sock Shop", a cloud-native reference microservices architecture to demonstrate some of the best practices and pitfalls of attempting to unify monitoring in real life. Attendees will be able to use this application as a reference point, or as a real life starting point for their own applications.

Specifically, we will cover:
- Integrating Prometheus in Java/Go/Node.js/Haskell
- Best practices: what to monitor and how to structure the monitoring code
- Pitfalls: what goes wrong and why
- Demonstrations and descriptions how attendees can try it for themselves

About Phil Winder
Phil Winder is a multi-disciplinary freelance architect working towards the research and development of cutting-edge technology. Most recently he has been developing cloud-based full-stack microservice systems for a range of clients but has a significant past in machine learning and electronics. His company, WinderResearch.com, is collaborating with Container Solutions, a container consultancy, to provide R&D services in the container space. Phil has Ph.D. and Masters degrees from the University of Hull, UK in Electronics, with a focus on embedded signal processing.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Ops for Developers - Monitor Your Java Application with Prometheus [I] - Alexander Schwartz, msg systems ag

Prometheus is ready-to-go to monitor your infrastructure and your containers. Capturing simple metrics from a Java application can be done automatically. But Developers need to go one step further to provide useful application and business metrics. This talk shows how to collect meaningful metrics in Vert.x and Spring based Java applications. It applies Dropwizard Metrics to gather internal application statistics, and Hystrix to provide metrics of the external interfaces the application consumes. It also shows how to fill gaps by writing your own collector. By providing end-to-end examples this talk enables developers to make their application ready for production.

About Alexander Schwartz
Alexander Schwartz is Principal IT Consultant at msg systems. He’s been in Web development for more than 15 years and enjoys productive working environments, agile projects and automated tests. At conferences and user group meetings he talks about the things he is passionate about.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Prometheus: The Unsung Heroes [I] - Alejandro Ramirez, Swisscom Directories AG

Prometheus is a fantastic tool, Prometheus/Kubernetes integration is amazing, PromQL is expressive…. We have all heard the superlatives and the articles, but this talk explores those tools of the Prometheus ecosystem that are not under the spotlight, but should not be discarded as mere footnotes to the saga.

We will discuss how mtail and the snmp_exporter allowed us to instrument our load balancer appliance and give us more insights into our performance in such a critical component of our system.

About Alejandro Ramírez
Alejandro Ramirez Local.ch (Swisscom Directories AG) Senior System Engineer Zürich, Switzerland Alejandro works at local.ch, one of the country’s highest traffic websites, ensuring that the platform runs smoothly while at the same empowering other engineers in the team to accelerate development getting software as quickly and reliably as our users expect it, embracing DevOps and breaking old silos.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Alerting in Cloud Native Environments [I] - Fabian Reinartz, CoreOS

In a Cloud Native infrastructure, component failure is normal and expected. The loss of a single node or a dozen hard drives is automatically handled by the systems running a datacenter, removing the need to page someone at 4am.

This calls for an alerting system that understands service availability at a global scope, yet is still able to give detailed reports if and when there is a service-impacting incident. Prometheus achieves this by defining alerting conditions directly on time series data. The resulting alerts are grouped and aggregated into comprehensive and meaningful notifications.

Fabian will walk through the philosophy of time series based alerting, the Prometheus architecture behind it, and how practical anomaly detection can be implemented.

About Fabian Reinartz
| Fabian Reinartz is a software engineer at CoreOS and one of the core developers of Prometheus, a monitoring system and time series database. | Previously, he was a production engineer at SoundCloud and worked on information retrieval during his time at Saarland University.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Counting with Prometheus [I] - Brian Brazil, Robust Perception

Counters are one of the two core metric types in Prometheus, allowing for tracking of request rates, error ratios and other key measurements. Learn why are they designed the way they are, how client libraries implement them and how rate() works.

About Brian Brazil
Brian Brazil is a core developer of Prometheus, and the founder of Robust Perception. He has developed and maintains components and features across the Prometheus ecosystem including the Python and Java clients, and many exporters. He wrote many of the best practices and guidelines for those looking to use Prometheus, and publishes regularly on the Reliable Insights blog.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Grafana is Not Enough: DIY User Interfaces for Prometheus [I] - David Kaltschmidt, Weaveworks

This talk gives a quick overview of the currently available Prometheus UIs and shows ways to build your own interfaces to enable your workflows. Most popular among the UIs is Grafana, which works well with Prometheus and is lovely for dashboarding, but terrible for troubleshooting. What do you do if you want to slightly modify queries based on your dashboards? How can you explore the keys and values of your metric labels quickly? Having trouble remembering PromQL syntax? This talk presents small building UI blocks to get to your results faster and save the day.

David Kaltschmidt
David has been building UIs for the networking industry for over a decade. He is currently with Weaveworks and heads their Berlin office.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Integrating Long-Term Storage with Prometheus [A] - Julius Volz, Prometheus

While Prometheus's built-in storage does not support long-term data retention and durability, Prometheus provides nascent interfaces for integration with external long-term storage systems. This talk explains how these interfaces work, and how you can integrate with them to create custom long-term storage solutions. It will also showcase some real-world integration examples and highlight the key challenges in implementing them.

About Julius Volz
Julius co-founded Prometheus and lead the project to success at SoundCloud and beyond. He now focuses on growing the Prometheus community and is the main organizer of PromCon, the first conference around Prometheus. In a previous life, Julius was a Site Reliability Engineer at Google.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Keynote: Prometheus: From Berlin to Bonanza - Brian Brazil, CEO, Robust Perception

From its humble beginnings right here in Berlin in 2012, the Prometheus monitoring system has grown a substantial community with a comprehensive set of integrations. This talk will go over the core ideas behind Prometheus, give a brief tour of its end-to-end feature set and show how these combine with other CNCF projects to allow you to scale your systems and culture in a dynamic cloud native world.

About Brian Brazil
Brian Brazil is a core developer of Prometheus, and the founder of Robust Perception. He has developed and maintains components and features across the Prometheus ecosystem including the Python and Java clients, and many exporters. He wrote many of the best practices and guidelines for those looking to use Prometheus, and publishes regularly on the Reliable Insights blog.
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Beyond Nagios: Modern Monitoring of Bronze-Age Applications with Prometheus - Ben Kochie, SRE/Systems Engineer

"Prometheus is a high-performance, time-series-based monitoring system. We wanted to improve the monitoring and alerting for a mature Rails application that relied on a variety of tools, which each had their own limitations. Using Prometheus, we were able to consolidate these tools while gaining deep, user-focused insight about the application performance.

With minor changes to the legacy codebase, we gained insights about Rails performance that were not possible with the existing tools. This allowed us to consolidate metrics collection, improve the quality of alerting, and reduce our dependency on expensive third-party monitoring services.

We also improved the state of the art for MySQL monitoring, which allowed us real-time visibility into database performance problems.

But the story doesn't end here. There are still monitoring challenges to overcome. In the last part of the talk, I will cover future plans and problems that we haven't solved yet."
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Chronix as Long Term Storage for Prometheus - Moritz Kammerer, QAware GmbH

"Prometheus is great when it comes to monitoring and alerting. But the long term storage opportunities are comparatively weak compared to related time series databases (missing data distribution, sharding etc.). At this point Chronix [1] enters the stage. Chronix is an open source time series database. It focuses on an efficient long term storage both in terms of storage volume and access times. Chronix achieves a compression rate of 98% compared to data in CSV files while an average query took 21 milliseconds, determined in a benchmark asking 96 queries for different time ranges and time series. Chronix offers a multi-dimensional generic data model for storing all kinds of time series, functions for anomaly detection used in the frameworks EGADS [2] and SAX [3], and an integration with Apache Spark [4] allows for distributed time series processing.
In this code-intense session we show the integration of Prometheus and Chronix. We also dig into the details of Chronix and explain why Chronix loves Prometheus and vice versa. Furthermore we demonstrate a toolchain: collect data with Prometheus, pipe them to Chronix, visualize both data sources in Grafana [5], and easily analyze tons of data with Spark and Apache Zeppelin [6].

[1] www.chronix.io
[2] https://github.com/yahoo/egads
[3] https://github.com/jMotif/SAX
[4] http://spark.apache.org/
[5] http://grafana.org/
[6] https://zeppelin.apache.org/"

About
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Keynote: Monitoring Kubernetes Clusters with Prometheus - Fabian Reinartz, Software Engineer, CoreOS

"Kubernetes is a powerful system to build, operate, and grow a Cloud Native architecture. But how can we stay on top of what’s happening across thousands of pods that are dynamically scheduled across hundreds of nodes?
It needs a system capable of monitoring all individual units across the entire stack while enabling users to drill down from a global view to individual instances. Prometheus is an open source monitoring system designed with exactly this goal in mind. As it turned out, Kubernetes and Prometheus is a match made in open source heaven. Fabian will explain common challenges when monitoring large scale infrastructure and how Prometheus provides high-level observability without giving up low-level insight."

About
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Prometheus Is Good for Your Small Startup - Ignacio P. Carretero, ShuttleCloud

"ShuttleCloud is a small startup specialized in email and contacts migrations. We developed a reliable migration platform in high availability used by clients like Gmail, Gcontacts and Comcast. For example, Gmail alone has imported data for 3 million users with our API and we process hundreds of terabytes every month.

In this talk we'll explain our journey from having near-zero monitoring to having all of our infrastructure monitored with the necessary metrics and alerts. We will share with the audience some of the mistakes we did and what lessons we have learned. We currently have around 200 instances monitored with a comfortable cost-effective in-house monitoring stack based on Prometheus.

We want to demonstrate that you don't need to have a big fleet to embrace Prometheus and that it is a non-expensive solution for monitoring."
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Weave Cortex: Horizontally Scalable, Multitenant Prometheus as a Service - Tom Wilkie, Weaveworks

"In this talk we'll present Weave Cortex - a multitenant, horizontally scalable Prometheus as a service.

Our solution turns a lot of the Prometheus architectural assumptions on its head, by marrying a scale-out PromQL query engine with a storage layer based on DynamoDB and S3. We have disaggregated the Prometheus binary into a microservices-style architecture, with separate services for query, ingest, alerting rules and recording rules. By designing all these services as fungible replicas, this solution can be scaled out with ease and failure of any individual replica can be dealt with gracefully."

About
Join us for KubeCon + CloudNativeCon in Barcelona May 20 - 23, Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.