Cloud Native Computing Foundation / PrometheusDay NA 2022

Add meeting Rate page Subscribe

Cloud Native Computing Foundation / PrometheusDay NA 2022

These are all the meetings we have in "PrometheusDay NA 2022" (part of the organization "Cloud Native Computi…"). Click into individual meeting pages to watch the recording and search or read the transcript.

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Keynote: A 10 Step Guide for Integrating Security Metrics Into Your Observability Stack - Anais Urlichs, Developer Advocate, Aqua Security

The Prometheus ecosystem makes it possible to integrate all your metrics and their management in one tool. This provides several benefits such as correlating metrics from different services, which in turn enhances decision making and acting upon changes of your application. The health of our application is highly dependent on its security. Thus, integrating your security tooling with your observability stack will not only make it possible to utilise existing processes but also make your application stack more robust.

In this lightning talk, Anais will walk you through a 10 step guide for integrating Trivy metrics with Prometheus and its benefits. Trivy is an open source security scanner, and will be used as an example. However, alternative tools such as Kubescape will be mentioned.
  • 1 participant
  • 16 minutes
security
vulnerability
deployments
monitoring
important
observability
services
strategies
workflows
repository
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Centralized vs Decentralized Prometheus Scraping Architecture with DoorDash - Rabun Kosar, Doordash & Ales Koprivnikar, Chronosphere

There are two primary approaches to scrape and collect metrics using Prometheus - using a centralized set of dedicated scrapers or decentralized scrapers that run as an agent. With centralized scraping, Prometheus is deployed as a central scraper to pull metrics from all discoverable endpoints and sometimes can be split across multiple centralized instances using a few different approaches. However, with a decentralized approach, Prometheus runs as an agent and in Kubernetes is deployed as a DaemonSet on each node in a cluster and only collects metrics from the node it runs on. Each model has pros and cons - especially when operating at large scale - which can make it difficult when deciding which model to use. In this session, Rabun and Ales will provide an overview of Prometheus metrics collection at DoorDash, where having highly reliable resources, easy endpoint discovery, and real-time insights is critical. They will share insights and best practices into DoorDash’s decision to implement a decentralized model by offering pros and cons of each approach. Leave with a better understanding of the “right” model for your use case(s).
  • 5 participants
  • 26 minutes
decentralized
observability
infrastructure
data
tracking
doordash
progresses
discovering
process
scraping
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Film Premiere - Inside Prometheus: An Open Source System That Changed Technology

Witness the journey from inception to adoption of the technical triumphs that changed an entire industry’s approach to monitoring systems as we know it today. This dynamic documentary film takes viewers into the world of Prometheus and provides unique access to how it became a game-changing open source technology celebrated by hundreds of thousands of developers and companies across the globe. In the film are some of the most prominent pioneers, executives and engineers from the Prometheus community to provide a comprehensive and thought-provoking view into the origins and meteoric rise of one of the highest-velocity open source projects in the world.
  • 10 participants
  • 27 minutes
soundcloud
microservices
servers
kubernetes
startups
docker
managed
cloud
cluster
technologists
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

How Not to Scale Your Prometheus in Production? - Kush Trivedi & Nikola Collins, DevRev

DevRev, The World’s First Developer CRM, has seen a 10X increase in the number of microservices during the past year. DevRev, since its inception, has adapted the cloud-native way of running its microservices; with recent migration to the service mesh architecture, DevRev has a strong appreciation for the cloud-native community. After migrating to service mesh and onboarding the customers to the public beta offering, we had seen a massive increase in the metrics ingestion, our observability costs, and new dashboards on top of the custom metrics. It was a matter of a few weeks when we realized that we needed more flexibility, customization, and control of our observability setup. This talk will guide you through the journey of our learnings while adapting and scaling the Prometheus, our learnings on various sort of Prometheus management strategies we went through, and how we efficiently controlled our costs without compromising the flexibility service-owners needed to manage and visualize their custom metrics.
  • 6 participants
  • 20 minutes
prometheus
deployments
rollout
scaling
devrip
dashboards
microservices
kubernetes
trouble
thanos
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Keda with Prometheus: Scaling Your Kubernetes Application with Custom Metrics - David Lorite Solanas & Jesus Angel Samitier, Sysdig

When you're working with a complex application, for example an e-commerce and one day, let’s say the Black Friday, you get 1000% request more than on a normal day, your application stops working, and you lose a lot of money. It Is At that moment when you start thinking that it would have been nice to have an autoscaler in the first place, but you were always afraid to use one. Native Kubernetes HPA can scale your application with some system metrics (cpu, memory). ​​However, you cannot use custom metrics from your application. For example, if your application is exposing saturation metrics, such us the number of connections, latency or buffer length, it would be amazing to use them to trigger the autoscaler. In this talk, Jesus and David will show how Keda uses your custom metrics to scale your application, even with a secure Prometheus remote endpoint.
  • 3 participants
  • 18 minutes
vpas
cluster
scaling
hp
kubernetes
servers
microservice
systic
monitoring
deployment
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Prometheus in the MLOps Lifecycle - Rishit Dagli, Narayana Junior College; Incoming University of Toronto & Shivay Lamba, Meilisearch

MLOps is widely talked about and used to make the practice of deploying, managing, and monitoring ML models in production easier. Monitoring ML training or evaluation jobs is obviously very important however it is more important to monitor once an ML model is deployed. This talk first starts by giving a gentle introduction about how ML deployments should be monitored, briefly talking about edge cases in production, data drift, concept drift, model metrics as well as the standard system and resource metrics. We give the audience an overview of observability and monitoring in the context of MLOps. This monitoring could also provide valuable results in terms of whether a model should be retrained, if more data should be collected, if different kinds of data should be collected, and more. We show how one can handle the very important task of monitoring and performing the aforementioned tasks in the context of MLOps with Prometheus. We also show how one could take their existing deployments and add the power of easy and useful monitoring with Prometheus. Finally, we also show demos about how one could use Prometheus paired with their Flyte or Seldon Core, or FastAPI ML deployments.
  • 2 participants
  • 28 minutes
monitoring
monitored
monitor
prometheus
closely
mlops
important
follow
observability
live
youtube image

1 Nov 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

⚡Lightning Talk: Leveraging Prometheus Monitoring to Maximize Business Metrics with Iter8 - Alan Cha, IBM

Prometheus has grown to become one of the most popular tools for collecting and aggregating metrics for Kubernetes applications. These days, you’ll be hardpressed to find a Kubernetes application that is not using Prometheus. In this talk, we will present Iter8 (https://iter8.tools), an open source tool that takes advantage of Prometheus’ ubiquity in order to perform SLO validation and A/B tests for your Kubernetes apps and ML models. Iter8 conducts metrics-driven experiments to ensure that your apps and models are performant and maximize business value. During an experiment, Iter8 will query a metrics source, such as Prometheus, and use those metrics to determine which versions of your apps and ML models work the best. Best of all, you can set up these experiments in a simple and declarative way. We also want to show some of Iter8’s latest features, such as autoX, custom metrics, and multi-loop experiments, which allow Iter8 to automatically detect new versions and launch experiments, use metrics from any database or Kubernetes resource, and conduct experiments over a period of time, respectively.
  • 2 participants
  • 15 minutes
iterate
itera
experimentation
testing
instrumentation
monitoring
performance
process
tutorial
application
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Achieving Zero-Instrumentation Monitoring with eBPF - Kemal Akkoyun, Polar Signals

Metrics are powerful tools that exist in the cloud-native ecosystem using Prometheus. However, using facilities to enable monitoring requires instrumenting the code. Everyone wants observability, but nobody wants to go the extra mile to instrument their clusters or applications. This is where eBPF comes in. eBPF, a promising technology for observability tooling, is not news. To observe the infrastructure and applications, eBPF-based system-wide agents can help us to capture events without requiring recompilation or redeployment of applications. In this talk, attendees will discover alternative ways to collect metrics from applications and infrastructure using system-wide eBPF agents. The presenters will demonstrate what level of observability could be accomplished without instrumentation.
  • 2 participants
  • 25 minutes
instrumentation
monitoring
prometheus
ebpr
project
observability
paradigm
important
horizon
verifiers
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Automate Your SLO Validation with Prometheus & Flagger - Sanskar Jaiswal & Kingdon Patrick Barrett, Weaveworks

Flagger is a progressive delivery tool that automates the release process for applications running on Kubernetes, by gradually shifting traffic to the new version while validating metrics and running conformance tests. Prometheus is a great monitoring and observability tool. Another way to look at it, is that it’s an easy way of validating Service Level Objectives(SLOs) and Key Performance Indicators(KPIs). Flagger leverages this feature of Prometheus by ensuring that the new version of their application behaves as desired, letting developers be confident about their code, before exposing it to users. In this talk, we will discuss about how Flagger utilizes Prometheus to automate canary deployments using progressive delivery. Furthermore, we will see how Flagger integrates with KEDA ScaledObjects which lets you scale your workloads during a canary analysis using a Prometheus scaler to simulate real world conditions.
  • 3 participants
  • 33 minutes
progressive
delivery
advanced
deployments
services
server
project
gateway
derby
kubernetes
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Boost Your Logs with Prometheus! From Logs to Metrics - Jaime Yera Hidalgo, Sysdig

Sometimes, finding useful metrics from applications is not easy. Prometheus is the Cloud Native standard for monitoring, but some applications still have more info in their logs than what they provide as metrics. Logs have always been used to track application problems and warnings, but with observability technologies like Prometheus and all those metrics, it could be tough to open that logs and gather that information. Using open source projects, such as Fluentd, mtail, Grok exporter, and others, we can generate new information as Prometheus metrics from these logs. This useful information can be combined with actual Prometheus metrics collected by exporters or directly from the application itself. This way, we have Prometheus as a complementary tool to the logs for troubleshooting problems and alerting on issues. In this talk, Jaime will explain how to create Prometheus metrics from another pillar of observability: log files. The audience of this talk will learn: - Scrap useful information from logs - Turn information from logs into Prometheus metrics - Combine scrapping tools with monitoring applications
  • 1 participant
  • 16 minutes
logs
log
metrics
exporter
kubernetes
configuration
data
cluster
glock
reasons
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Building a Runbook Automation System for Prometheus and Kubernetes - Natan Yellin, Robusta.dev

Natan will describe Robusta.dev, an open source runbook automation platform that was built for Kubernetes and Prometheus. You will learn about the motivation and challenges of building a production-ready runbook automation system. The talk will also include hands-on demos and examples. By the end of this talk, you will be comfortable writing YAML that automates away your job. You will be able to sleep at night and let your Prometheus alerts investigate themselves and tell you in Slack what the problems are.
  • 2 participants
  • 24 minutes
automations
runbook
monitoring
advanced
software
functioning
kubernetes
runs
demos
mit
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Keynote: Reality Check: Is it Time to Raise Your Metrics Game? - Martin Mao, Co-founder and CEO, Chronosphere & Yash Kumaraswamy, Senior Staff Engineer, Robinhood

How do you know when you have a world class metrics function? While we obsess about the metrics of our infrastructure and apps, how often do we take the time to inspect our own function? When was the last time you benchmarked your spend, people impact, and time it takes to remediate issues? This session will cover the KPIs you need to consider when benchmarking your own metrics function - and crucially, how to demonstrate the business value that you and your team provide to the business. Join both Martin Mao, Chronosphere co-founder and CEO and former observability engineering leader at Uber, and Yash Kumaraswamy, Senior Staff Engineer at Robinhood and observability tech lead to hear about their major takeaways from their past experience and lessons learned.
  • 2 participants
  • 7 minutes
metrics
monitoring
productivity
value
increasing
critical
approach
reversing
robinhood
mttd
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: How Not to Use Prometheus? - Shivangi Motwani, Zeta Suite

Today Prometheus is one of the standard tools used for monitoring and alerting. Like any other tool/library we use, there tend to be common mistakes we make as beginners. This presentation aims to highlight the flaws made and overlooked while using Prometheus. Few of them being, Are all your metrics coming up in Prometheus on time? Are you using the rate/increase function correctly? How do you get metric value as instant/time series when using PromQL? Why alerts are not getting triggered? Why is the latency of your query high? Is the choice of your labels correct? Let's make your journey of using Prometheus as your Monitoring buddy easier. Along with that presentation seeks to provide a crisp and handy checklist you can use while making your dashboards and creating alerts. This checklist would also help review the Prometheus queries for your colleagues, making the review process faster and your dashboards and alerts bug-free, functionally correct, and uniformly interpreted (at least from the Prometheus point of view).
  • 1 participant
  • 8 minutes
prometheus
careful
matrix
monitoring
avoiding
help
expectations
mistakes
beginner
thanos
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Real Time Prediction for Autoscaling with Prometheus Metrics - Ravi Hari, Intuit

Prometheus is a defacto standard for monitoring in kubernetes. Prometheus metrics are consumed by multiple addons in Kubernetes for monitoring, alerting, autoscaling etc., This talk will walkthrough how the prometheus metrics can be used for real time prediction so the application pods can be scaled horizontally or vertically. Getting the right sizing of pods is an important task especially when running kubernetes in cloud environments so we can optimise the cost. This talk will walk through the framework used for predicting the right sizing of the pods based on prometheus metric and how we can leverage a custom pod-autoscaler to scale the pods dynamically.
  • 1 participant
  • 5 minutes
forecasting
monitoring
predict
models
trend
data
aggregated
scaling
prometheus
optimize
youtube image

28 Oct 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Welcome + Opening Remarks - Richard Hartmann, Director of Community, Grafana Labs
  • 1 participant
  • 5 minutes
centralized
keynotes
ior
monitoring
slos
conference
topic
security
deployments
ukraine
youtube image